Jul 23 13:07:37.626270 ip-10-0-128-48 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.055556    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065537    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065557    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065563    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065568    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065572    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065578    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065586    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:07:38.122491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065590    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065594    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065604    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065608    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065613    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065618    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065625    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065631    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065635    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065639    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065643    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065648    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065652    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065657    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065665    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065669    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065673    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065677    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065681    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065686    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:07:38.123521 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065690    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065694    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065699    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065703    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065708    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065712    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065721    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065725    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065728    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065733    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065737    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065741    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065744    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065748    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065757    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065763    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065768    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065772    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065781    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065787    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:07:38.124331 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065793    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065798    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065804    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065808    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065812    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065817    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065821    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065825    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065829    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065833    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065841    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065845    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065849    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065853    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065857    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065861    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065864    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065869    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065873    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:07:38.124947 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065876    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065881    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065885    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065888    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065901    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065905    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065909    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065914    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065919    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065924    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065928    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065933    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065937    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065941    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065945    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065949    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065953    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065961    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065965    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065969    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:07:38.125582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065976    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065980    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.065999    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.066003    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.066007    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.066011    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.066015    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.066020    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.066028    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.066032    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.066035    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.066040    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.066044    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068596    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068607    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068611    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068617    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068626    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068632    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068636    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:07:38.126287 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068642    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068646    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068651    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068655    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068664    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068668    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068672    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068677    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068681    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068686    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068690    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068694    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068698    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068703    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068707    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068711    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068719    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068724    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068728    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068732    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:07:38.126932 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068737    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068741    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068745    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068749    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068753    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068757    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068761    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068766    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068769    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068778    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068782    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068786    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068791    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068795    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068799    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068803    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068809    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068817    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068822    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068826    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:07:38.127583 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068830    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068839    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068842    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068847    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068850    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068854    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068859    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068864    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068870    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068874    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068878    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068883    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068887    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068896    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068900    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068904    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068910    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068918    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068922    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:07:38.128200 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068927    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068931    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068940    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068945    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068949    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068958    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068962    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068966    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068970    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068976    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.068995    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069000    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069005    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069009    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069013    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069023    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069027    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069031    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069039    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069043    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:07:38.128689 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069047    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069051    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069056    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069060    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069064    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069068    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069072    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069076    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069080    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069083    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069087    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069096    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.069103    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070027    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070034    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070042    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070048    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070058    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:07:38.129313 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070070    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070076    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070081    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070086    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070091    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070095    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070100    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070106    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070110    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070116    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070120    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070129    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070133    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070137    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070141    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070145    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070149    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070153    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070156    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070160    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:07:38.129798 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070166    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070170    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070174    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070182    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070186    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070189    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070193    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070197    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070201    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070205    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070209    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070213    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070220    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070229    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070233    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070236    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070245    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070249    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070253    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070257    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:07:38.130558 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070260    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070266    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070270    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070273    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070277    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070281    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070285    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070289    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070296    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070300    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070304    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070307    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070311    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070315    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070319    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070323    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070327    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070331    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070335    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070339    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:07:38.131147 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070343    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070351    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070354    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070358    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070364    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070368    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070372    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070376    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070386    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070391    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070394    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070398    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070402    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070412    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070416    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070421    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070425    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070429    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070433    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:07:38.131969 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070437    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070441    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070445    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070449    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070453    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070458    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070466    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070470    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070474    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070477    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070481    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070485    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070489    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070493    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.070497    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070619    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070630    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070647    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070653    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070660    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070664    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 13:07:38.132491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070672    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070682    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070688    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070693    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070698    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070706    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070711    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070716    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070720    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070728    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070733    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070737    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070743    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070748    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070753    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070757    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070762    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070771    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070776    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070781    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070786    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070791    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070795    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070800    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 13:07:38.133102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070804    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070809    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070819    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070824    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070829    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070834    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070838    2570 flags.go:64] FLAG: --enable-server="true"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070843    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070850    2570 flags.go:64] FLAG: --event-burst="100"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070854    2570 flags.go:64] FLAG: --event-qps="50"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070869    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070875    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070880    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070887    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070892    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070897    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070901    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070906    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070911    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070918    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070924    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070928    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070933    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070937    2570 flags.go:64] FLAG: --feature-gates=""
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070943    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 13:07:38.133973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070948    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 13:07:38.134126 ip-10-0-128-48 systemd[1]: Started Kubernetes Kubelet.
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070952    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070961    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070965    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070970    2570 flags.go:64] FLAG: --help="false"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070975    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.070980    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071000    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071005    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071011    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071016    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071031    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071036    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071041    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071045    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071049    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071055    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071059    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071064    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071077    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071084    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071089    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071094    2570 flags.go:64] FLAG: --lock-file=""
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071099    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 13:07:38.135350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071104    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071108    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071117    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071121    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071130    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071135    2570 flags.go:64] FLAG: --logging-format="text"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071139    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071144    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071148    2570 flags.go:64] FLAG: --manifest-url=""
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071153    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071159    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071165    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071175    2570 flags.go:64] FLAG: --max-pods="110"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071179    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071188    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071193    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071198    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071203    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071207    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071213    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071228    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071232    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071237    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 13:07:38.138825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071242    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071246    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071255    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071259    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071268    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071275    2570 flags.go:64] FLAG: --port="10250"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071280    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071285    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06bf19a828b1aedb3"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071289    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071294    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071299    2570 flags.go:64] FLAG: --register-node="true"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071303    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071309    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071317    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071322    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071326    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071332    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071337    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071342    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071346    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071350    2570 flags.go:64] FLAG: --runonce="false"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071359    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071364    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071368    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071373    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 13:07:38.139632 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071377    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071382    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071387    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071391    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071398    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071406    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071411    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071415    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071420    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071424    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071428    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071436    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071446    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071460    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071467    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071471    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071476    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071480    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071485    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071489    2570 flags.go:64] FLAG: --v="2"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071499    2570 flags.go:64] FLAG: --version="false"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071505    2570 flags.go:64] FLAG: --vmodule=""
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071511    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.071516    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071836    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:07:38.226107 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071842    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071847    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071852    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071857    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071861    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071865    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071870    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071880    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071885    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071890    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071894    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071900    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071904    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071908    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071912    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071916    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071920    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071924    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071928    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071939    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:07:38.226919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071943    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071948    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071952    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071956    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071960    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071964    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071968    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071972    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071976    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071994    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.071998    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072002    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072009    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072013    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072017    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072021    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072025    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072030    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072033    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072038    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:07:38.227742 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072042    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072045    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072049    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072055    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072059    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072067    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072071    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072075    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072079    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072083    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072087    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072092    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072096    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072100    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072105    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072110    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072114    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072121    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072126    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072129    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:07:38.228431 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072133    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072137    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072140    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072145    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072148    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072152    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072156    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072161    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072165    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072169    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072177    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072182    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072192    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072198    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072204    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072211    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072215    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072219    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072222    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:07:38.229032 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072226    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072230    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072234    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072242    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072248    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072252    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072256    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072260    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072265    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072268    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072273    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072277    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072281    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072285    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072289    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072293    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072300    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072304    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:07:38.229627 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.072308    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.072955    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.080212    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.080228    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.080250    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.080256    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080316    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080321    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080326    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080329    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080332    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080336    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080339    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080342    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:07:38.230175 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080344    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080347    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080350    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080353    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080356    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080359    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080362    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080364    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080367    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080370    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080375    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080379    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080383    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080386    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080388    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080392    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080394    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080398    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080400    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080403    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:07:38.230644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080406    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080409    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080412    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080416    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080419    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080422    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080425    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080428    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080431    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080436    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080439    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080442    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080444    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080447    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080450    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080453    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080456    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080460    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080462    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:07:38.231236 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080465    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080467    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080470    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080473    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080476    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080478    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080481    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080483    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080486    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080489    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080492    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080495    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080497    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080500    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080502    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080505    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080507    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080510    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080512    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080515    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:07:38.231781 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080517    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080520    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080524    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080527    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080530    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080532    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080535    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080537    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080540    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080542    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080546    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080549    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080552    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080554    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080557    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080559    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080562    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080566    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080569    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080572    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:07:38.232372 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080575    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080578    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080581    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080584    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080587    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080589    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080592    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080595    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080597    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080600    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080602    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080605    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.080610    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080725    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080730    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:07:38.232919 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080735    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080738    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080741    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080743    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080746    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080749    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080751    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080756    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080758    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080761    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080764    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080766    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080769    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080772    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080774    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080777    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080779    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080782    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080784    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080787    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:07:38.233378 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080789    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080792    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080795    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080798    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080800    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080803    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080807    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080810    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080813    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080816    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080819    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080821    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080825    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080827    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080830    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080833    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080835    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080838    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080840    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:07:38.233925 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080844    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080847    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080849    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080852    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080854    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080857    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080859    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080862    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080865    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080868    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080870    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080873    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080876    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080880    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080882    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080886    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080889    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080891    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080894    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080897    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:07:38.234449 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080899    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080902    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080904    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080907    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080909    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080913    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080915    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080918    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080921    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080923    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080926    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080928    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080932    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080935    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080937    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080940    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080942    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080945    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080948    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080951    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:07:38.235013 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080953    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080956    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080958    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080960    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080963    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080965    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080968    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080970    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080973    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080976    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080978    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080996    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.080999    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.081003    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.081006    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.081009    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.081012    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:07:38.235728 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:38.081016    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:07:38.236383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.081021    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 13:07:38.236383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.081136    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 13:07:38.236383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.084369    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 13:07:38.236383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.085714    2570 server.go:1019] "Starting client certificate rotation"
Jul 23 13:07:38.236383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.085807    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 13:07:38.236383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.085837    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 13:07:38.236383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.088135    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 13:07:38.236383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.090123    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 13:07:38.236383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.100134    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 23 13:07:38.236383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.102206    2570 log.go:25] "Validated CRI v1 image API"
Jul 23 13:07:38.236383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.103636    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 13:07:38.236383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.107297    2570 fs.go:135] Filesystem UUIDs: map[4f174941-c381-4bf1-903e-92b49a226e33:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ba878719-d5a8-461c-b723-607bf624bffb:/dev/nvme0n1p4]
Jul 23 13:07:38.237254 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.107311    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 13:07:38.237441 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.113665    2570 manager.go:216] Machine: {Timestamp:2026-07-23 13:07:38.11232786 +0000 UTC m=+0.365853727 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105803 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26d27a0fed3ee48fa2a72ac4dd0da0 SystemUUID:ec26d27a-0fed-3ee4-8fa2-a72ac4dd0da0 BootID:169eabe2-8e6a-47c5-8274-8f39cada7675 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9b:bd:25:49:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9b:bd:25:49:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:4f:b1:11:32:01 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 13:07:38.237441 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.113924    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 13:07:38.237441 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.114171    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 13:07:38.237441 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.115634    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 13:07:38.237441 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.117324    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 13:07:38.237441 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.117354    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 13:07:38.237441 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.118086    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.118096    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.118104    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.118877    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.120116    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.123017    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.123168    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.123199    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.123213    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.123228    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.123242    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.123255    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.123694    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.123716    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.126066    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.128052    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.128079    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.129126    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.129140    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.129146    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.129151    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.129160    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.129168    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.129179    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.129184    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.129190    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.129196    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.129204    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.129211    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.130008    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.130016    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.133272    2570 server.go:1268] "Started kubelet"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.133359    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.133351    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.133420    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.136067    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.138482    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.143183    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wp47t"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.143359    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.143408    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-48.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 13:07:38.240368 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.143442    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.143469    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.143552    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wp47t"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.144623    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.144624    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.144745    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.145234    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.145243    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.145250    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.145383    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.145392    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.145628    2570 factory.go:55] Registering systemd factory
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.145642    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.145845    2570 factory.go:153] Registering CRI-O factory
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.145857    2570 factory.go:223] Registration of the crio container factory successfully
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.145893    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.145913    2570 factory.go:103] Registering Raw factory
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.145923    2570 manager.go:1196] Started watching for new ooms in manager
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.146586    2570 manager.go:349] Starting recovery of all containers
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.145608    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-48.ec2.internal.18c4ed1c4bdb3aa7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-48.ec2.internal,UID:ip-10-0-128-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-48.ec2.internal,},FirstTimestamp:2026-07-23 13:07:38.133084839 +0000 UTC m=+0.386610706,LastTimestamp:2026-07-23 13:07:38.133084839 +0000 UTC m=+0.386610706,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-48.ec2.internal,}"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.154050    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.156440    2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-48.ec2.internal\" not found" node="ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.167724    2570 manager.go:354] Recovery completed
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.172310    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.174354    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.174382    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.174391    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.174884    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.174894    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.174894    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.174934    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.175568    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.175623    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.175635    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.176058    2570 policy_none.go:49] "None policy: Start"
Jul 23 13:07:38.357144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.176070    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.176080    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.176923    2570 policy_none.go:47] "Start"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.236832    2570 manager.go:337] "Starting Device Plugin manager"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.236880    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.236892    2570 server.go:87] "Starting device plugin registration server"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.237189    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.237201    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.237445    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.237511    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.237519    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.238060    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.238109    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.337855    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.339051    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.339075    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.339085    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.339114    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.348344    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.348371    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-48.ec2.internal\": node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.350204    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.351657    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.351700    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.351725    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.351768    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.354119    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:07:38.374994 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.365585    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.451831    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"]
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.451935    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.453746    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.453775    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.453794    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.455128    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.455233    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.455266    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.455961    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.455980    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.455991    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.456239    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.456251    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.456260    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.457637    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.457665    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.462904    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.462924    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.462934    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:38.473926 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.466303    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 23 13:07:38.580102 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.484820    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-48.ec2.internal\" not found" node="ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.580102 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.491489    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-48.ec2.internal\" not found" node="ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.580102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.547624    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00fb35e30223243945f067fa48061f7a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"00fb35e30223243945f067fa48061f7a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.580102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.547655    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00fb35e30223243945f067fa48061f7a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"00fb35e30223243945f067fa48061f7a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.580102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.547676    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/099b81222a3a57c11d9d757e4965a26f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-48.ec2.internal\" (UID: \"099b81222a3a57c11d9d757e4965a26f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.580102 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.567028    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 23 13:07:38.662900 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.648536    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00fb35e30223243945f067fa48061f7a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"00fb35e30223243945f067fa48061f7a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.662900 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.648577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00fb35e30223243945f067fa48061f7a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"00fb35e30223243945f067fa48061f7a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.662900 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.648597    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/099b81222a3a57c11d9d757e4965a26f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-48.ec2.internal\" (UID: \"099b81222a3a57c11d9d757e4965a26f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.662900 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.648672    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00fb35e30223243945f067fa48061f7a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"00fb35e30223243945f067fa48061f7a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.662900 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.648678    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/099b81222a3a57c11d9d757e4965a26f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-48.ec2.internal\" (UID: \"099b81222a3a57c11d9d757e4965a26f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.662900 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.648738    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00fb35e30223243945f067fa48061f7a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"00fb35e30223243945f067fa48061f7a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.668018 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.667647    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 23 13:07:38.803585 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.768289    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 23 13:07:38.803585 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.788979    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.803585 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:38.795353    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:38.936364 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.868981    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 23 13:07:39.081527 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:38.970068    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 23 13:07:39.081527 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:39.070754    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 23 13:07:39.086107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:39.085131    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 13:07:39.086107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:39.085311    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 13:07:39.086107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:39.085341    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 13:07:39.228295 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:39.147726    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 13:02:38 +0000 UTC" deadline="2028-05-02 13:14:49.05934754 +0000 UTC"
Jul 23 13:07:39.228295 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:39.147752    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15576h7m9.911598142s"
Jul 23 13:07:39.228295 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:39.171668    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 23 13:07:39.228295 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:39.179667    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:07:39.358972 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:39.246023    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:39.358972 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:39.259236    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 13:07:39.358972 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:39.261434    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"
Jul 23 13:07:39.358972 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:39.271589    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 13:07:39.467594 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:39.419345    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00fb35e30223243945f067fa48061f7a.slice/crio-3e2c83879936860cef8fbee405f858f80bdc34d406887145e7aeab533c83789d WatchSource:0}: Error finding container 3e2c83879936860cef8fbee405f858f80bdc34d406887145e7aeab533c83789d: Status 404 returned error can't find the container with id 3e2c83879936860cef8fbee405f858f80bdc34d406887145e7aeab533c83789d
Jul 23 13:07:39.467594 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:39.424450    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099b81222a3a57c11d9d757e4965a26f.slice/crio-b0d87a6266b63eaf7c0b668110f430f2120b4da4c1048b29a980ab366cce8921 WatchSource:0}: Error finding container b0d87a6266b63eaf7c0b668110f430f2120b4da4c1048b29a980ab366cce8921: Status 404 returned error can't find the container with id b0d87a6266b63eaf7c0b668110f430f2120b4da4c1048b29a980ab366cce8921
Jul 23 13:07:39.467594 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:39.424833    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:07:39.467594 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:39.443206    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:07:40.048725 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.048638    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:07:40.126932 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.126897    2570 apiserver.go:52] "Watching apiserver"
Jul 23 13:07:40.138530 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.138496    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 13:07:40.140068 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.139999    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fjq2l","kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal","openshift-cluster-node-tuning-operator/tuned-6gl9h","openshift-dns/node-resolver-bkn4j","openshift-multus/multus-additional-cni-plugins-hltqz","openshift-ovn-kubernetes/ovnkube-node-b5frq","kube-system/konnectivity-agent-fm44c","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk","openshift-image-registry/node-ca-c9cjt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal","openshift-multus/multus-ct624","openshift-multus/network-metrics-daemon-khpmp","openshift-network-diagnostics/network-check-target-8fhm9","openshift-network-operator/iptables-alerter-98f2p"]
Jul 23 13:07:40.142789 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.142758    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:40.142898 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.142848    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:07:40.147667 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.145635    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 13:07:40.147667 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.146631    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.149877 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.149145    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bkn4j"
Jul 23 13:07:40.149877 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.149418    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 13:07:40.149877 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.149760    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:07:40.149877 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.149767    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-22tcb\""
Jul 23 13:07:40.153390 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.153369    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 13:07:40.153753 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.153736    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tq4mm\""
Jul 23 13:07:40.154103 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.154085    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 13:07:40.158079 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.155021    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.158079 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.156378    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.158242 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.158143    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fm44c"
Jul 23 13:07:40.162476 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.161153    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l9ft2\""
Jul 23 13:07:40.162476 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.161397    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 13:07:40.162476 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.161863    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 13:07:40.162476 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.162337    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 13:07:40.163178 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.162872    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 13:07:40.163501 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.163276    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 13:07:40.163586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.163528    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c9cjt"
Jul 23 13:07:40.164032 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.163994    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 13:07:40.166243 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.165556    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 13:07:40.166243 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.165770    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 13:07:40.166243 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.166142    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2lrkt\""
Jul 23 13:07:40.166447 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.166380    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 13:07:40.167459 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.166612    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 13:07:40.167459 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.166674    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.167459 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.166856    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 13:07:40.167459 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.166986    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 13:07:40.167459 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.167217    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.167459 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.167294    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pqzwf\""
Jul 23 13:07:40.167459 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.167300    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 13:07:40.167459 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.167221    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 13:07:40.167459 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.167402    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 13:07:40.167459 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.167452    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 13:07:40.168017 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.167569    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dzzrm\""
Jul 23 13:07:40.168288 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.168266    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 13:07:40.168577 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.168555    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:40.168678 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.168635    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:07:40.170522 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.170272    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 13:07:40.170522 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.170313    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 13:07:40.170702 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.170572    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pxtx2\""
Jul 23 13:07:40.170955 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.170770    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 13:07:40.170955 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.170885    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jw9mv\""
Jul 23 13:07:40.171127 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.171089    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:40.171185 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.171156    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:07:40.171634 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.171609    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 13:07:40.173308 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.173290    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-98f2p"
Jul 23 13:07:40.174207 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174055    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-host\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.174207 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174096    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-tuned\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.174207 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174124    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf8nk\" (UniqueName: \"kubernetes.io/projected/0d191fbe-d17f-44e6-8817-73de47d5d49b-kube-api-access-cf8nk\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.174207 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174140    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-run\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.174207 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174170    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-modprobe-d\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.174586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174218    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-sysconfig\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.174586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174250    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-kubernetes\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.174586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174275    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-sysctl-d\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.174586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174396    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-var-lib-kubelet\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.174586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174427    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d191fbe-d17f-44e6-8817-73de47d5d49b-tmp\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.174586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174456    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:40.174586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174492    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-sysctl-conf\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.174586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174519    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-sys\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.174586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174542    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/032fa58a-197e-4083-85ba-30d5df17374b-kubelet-config\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:40.174586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174566    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/032fa58a-197e-4083-85ba-30d5df17374b-dbus\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:40.174896 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174589    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-systemd\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.174896 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.174616    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-lib-modules\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.176122 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.176100    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 13:07:40.176234 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.176152    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:07:40.176576 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.176460    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 13:07:40.176576 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.176478    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xpt7v\""
Jul 23 13:07:40.182112 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.182089    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pdms4"
Jul 23 13:07:40.190811 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.190784    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pdms4"
Jul 23 13:07:40.246833 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.246763    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 13:07:40.275734 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.275700    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d191fbe-d17f-44e6-8817-73de47d5d49b-tmp\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.275915 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.275746    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-etc-selinux\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.275915 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.275775    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-hostroot\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.275915 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.275803    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kjnt\" (UniqueName: \"kubernetes.io/projected/89cec7d4-3633-4cf4-bba6-b680f7f86825-kube-api-access-4kjnt\") pod \"node-ca-c9cjt\" (UID: \"89cec7d4-3633-4cf4-bba6-b680f7f86825\") " pod="openshift-image-registry/node-ca-c9cjt"
Jul 23 13:07:40.275915 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.275833    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-sysctl-conf\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.275915 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.275861    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a06b9d1-9a08-413b-b3f5-72975c91491b-tmp-dir\") pod \"node-resolver-bkn4j\" (UID: \"2a06b9d1-9a08-413b-b3f5-72975c91491b\") " pod="openshift-dns/node-resolver-bkn4j"
Jul 23 13:07:40.275915 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.275888    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-registration-dir\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.275915 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.275914    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf348358-707c-4e2f-8f9d-4406bc5f3db0-cni-binary-copy\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.275939    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/032fa58a-197e-4083-85ba-30d5df17374b-dbus\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.275985    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-systemd\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276011    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-run-netns\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276071    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djzvh\" (UniqueName: \"kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh\") pod \"network-check-target-8fhm9\" (UID: \"d6b2cd0e-6146-4b02-bc7c-dcaa305e5702\") " pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276093    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-cni-netd\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276115    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6feed743-b8ba-4323-8c1b-724e607a5e2a-env-overrides\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276158    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6feed743-b8ba-4323-8c1b-724e607a5e2a-ovnkube-script-lib\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276184    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba4270bd-f86f-4627-a6f7-2826e3e68ee4-konnectivity-ca\") pod \"konnectivity-agent-fm44c\" (UID: \"ba4270bd-f86f-4627-a6f7-2826e3e68ee4\") " pod="kube-system/konnectivity-agent-fm44c"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-host\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276211    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jdm2\" (UniqueName: \"kubernetes.io/projected/2a06b9d1-9a08-413b-b3f5-72975c91491b-kube-api-access-2jdm2\") pod \"node-resolver-bkn4j\" (UID: \"2a06b9d1-9a08-413b-b3f5-72975c91491b\") " pod="openshift-dns/node-resolver-bkn4j"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276259    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-systemd-units\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.276271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276265    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/032fa58a-197e-4083-85ba-30d5df17374b-dbus\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276288    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-etc-openvswitch\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276315    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276346    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-modprobe-d\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-sysconfig\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276392    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-systemd\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-sysctl-d\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276047    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-sysctl-conf\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276442    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-var-lib-kubelet\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276467    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-run-k8s-cni-cncf-io\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276492    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-var-lib-cni-multus\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276521    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276532    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-host\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276544    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6feed743-b8ba-4323-8c1b-724e607a5e2a-ovnkube-config\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.276939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276575    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba4270bd-f86f-4627-a6f7-2826e3e68ee4-agent-certs\") pod \"konnectivity-agent-fm44c\" (UID: \"ba4270bd-f86f-4627-a6f7-2826e3e68ee4\") " pod="kube-system/konnectivity-agent-fm44c"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276605    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnsqg\" (UniqueName: \"kubernetes.io/projected/c8eca1b7-a872-43f9-ad6f-29a54a8995be-kube-api-access-nnsqg\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276614    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-var-lib-kubelet\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276629    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs\") pod \"network-metrics-daemon-khpmp\" (UID: \"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b\") " pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276654    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-kubelet\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276667    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-sysconfig\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276678    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-cnibin\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276676    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-modprobe-d\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276727    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf8nk\" (UniqueName: \"kubernetes.io/projected/0d191fbe-d17f-44e6-8817-73de47d5d49b-kube-api-access-cf8nk\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276763    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-system-cni-dir\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276791    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276810    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-sysctl-d\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276818    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-log-socket\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276853    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-run-ovn-kubernetes\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.277659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276878    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-cni-bin\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.278439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276904    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-run-netns\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.278439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276927    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db64z\" (UniqueName: \"kubernetes.io/projected/bf348358-707c-4e2f-8f9d-4406bc5f3db0-kube-api-access-db64z\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.278439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.276978    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/445b9a2d-a940-4a87-a43d-c77f6b5ae445-iptables-alerter-script\") pod \"iptables-alerter-98f2p\" (UID: \"445b9a2d-a940-4a87-a43d-c77f6b5ae445\") " pod="openshift-network-operator/iptables-alerter-98f2p"
Jul 23 13:07:40.278439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277032    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-kubernetes\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.278439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277060    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.278439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277085    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-slash\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.278439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277112    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6feed743-b8ba-4323-8c1b-724e607a5e2a-ovn-node-metrics-cert\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.278439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277141    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffh55\" (UniqueName: \"kubernetes.io/projected/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-kube-api-access-ffh55\") pod \"network-metrics-daemon-khpmp\" (UID: \"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b\") " pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:40.278439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277166    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgnpf\" (UniqueName: \"kubernetes.io/projected/445b9a2d-a940-4a87-a43d-c77f6b5ae445-kube-api-access-fgnpf\") pod \"iptables-alerter-98f2p\" (UID: \"445b9a2d-a940-4a87-a43d-c77f6b5ae445\") " pod="openshift-network-operator/iptables-alerter-98f2p"
Jul 23 13:07:40.278439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277190    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-var-lib-openvswitch\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.278439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277215    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkll4\" (UniqueName: \"kubernetes.io/projected/6feed743-b8ba-4323-8c1b-724e607a5e2a-kube-api-access-kkll4\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.278439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277244    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-socket-dir\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.278439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277287    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89cec7d4-3633-4cf4-bba6-b680f7f86825-host\") pod \"node-ca-c9cjt\" (UID: \"89cec7d4-3633-4cf4-bba6-b680f7f86825\") " pod="openshift-image-registry/node-ca-c9cjt"
Jul 23 13:07:40.279074 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277166    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-kubernetes\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.279074 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277333    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-sys\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.279074 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277383    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-sys\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.279074 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.277373    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-run-systemd\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.281685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-multus-socket-dir-parent\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.281738    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-var-lib-cni-bin\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.281772    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-multus-conf-dir\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.281832    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89cec7d4-3633-4cf4-bba6-b680f7f86825-serviceca\") pod \"node-ca-c9cjt\" (UID: \"89cec7d4-3633-4cf4-bba6-b680f7f86825\") " pod="openshift-image-registry/node-ca-c9cjt"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.281866    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-lib-modules\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.281901    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-tuned\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.281934    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/445b9a2d-a940-4a87-a43d-c77f6b5ae445-host-slash\") pod \"iptables-alerter-98f2p\" (UID: \"445b9a2d-a940-4a87-a43d-c77f6b5ae445\") " pod="openshift-network-operator/iptables-alerter-98f2p"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282054    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-os-release\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282089    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-run-openvswitch\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282137    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-device-dir\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282169    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-system-cni-dir\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282200    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-multus-cni-dir\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282318    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-lib-modules\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.282386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282329    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a06b9d1-9a08-413b-b3f5-72975c91491b-hosts-file\") pod \"node-resolver-bkn4j\" (UID: \"2a06b9d1-9a08-413b-b3f5-72975c91491b\") " pod="openshift-dns/node-resolver-bkn4j"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282393    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-run-ovn\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-var-lib-kubelet\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282481    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-etc-kubernetes\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282523    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282588    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-node-log\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282634    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/032fa58a-197e-4083-85ba-30d5df17374b-kubelet-config\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282667    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-os-release\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282702    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf348358-707c-4e2f-8f9d-4406bc5f3db0-multus-daemon-config\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282737    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-run-multus-certs\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282772    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-cnibin\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282859    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srqmw\" (UniqueName: \"kubernetes.io/projected/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-kube-api-access-srqmw\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282937    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-sys-fs\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.283246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.282972    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-run\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.284000 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.283121    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d191fbe-d17f-44e6-8817-73de47d5d49b-run\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.284000 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.283221    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:40.284000 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.283336    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret podName:032fa58a-197e-4083-85ba-30d5df17374b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:40.783286941 +0000 UTC m=+3.036812814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret") pod "global-pull-secret-syncer-fjq2l" (UID: "032fa58a-197e-4083-85ba-30d5df17374b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:40.284000 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.283627    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/032fa58a-197e-4083-85ba-30d5df17374b-kubelet-config\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:40.284921 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.284791    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d191fbe-d17f-44e6-8817-73de47d5d49b-etc-tuned\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.284921 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.284869    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d191fbe-d17f-44e6-8817-73de47d5d49b-tmp\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.286945 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.286913    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf8nk\" (UniqueName: \"kubernetes.io/projected/0d191fbe-d17f-44e6-8817-73de47d5d49b-kube-api-access-cf8nk\") pod \"tuned-6gl9h\" (UID: \"0d191fbe-d17f-44e6-8817-73de47d5d49b\") " pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.369150 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.369034    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" event={"ID":"099b81222a3a57c11d9d757e4965a26f","Type":"ContainerStarted","Data":"b0d87a6266b63eaf7c0b668110f430f2120b4da4c1048b29a980ab366cce8921"}
Jul 23 13:07:40.370813 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.370783    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" event={"ID":"00fb35e30223243945f067fa48061f7a","Type":"ContainerStarted","Data":"3e2c83879936860cef8fbee405f858f80bdc34d406887145e7aeab533c83789d"}
Jul 23 13:07:40.383404 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srqmw\" (UniqueName: \"kubernetes.io/projected/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-kube-api-access-srqmw\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.383575 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383414    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.383575 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383439    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-sys-fs\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.383575 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383464    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-etc-selinux\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.383575 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383487    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-hostroot\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.383575 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383511    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kjnt\" (UniqueName: \"kubernetes.io/projected/89cec7d4-3633-4cf4-bba6-b680f7f86825-kube-api-access-4kjnt\") pod \"node-ca-c9cjt\" (UID: \"89cec7d4-3633-4cf4-bba6-b680f7f86825\") " pod="openshift-image-registry/node-ca-c9cjt"
Jul 23 13:07:40.383575 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383535    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a06b9d1-9a08-413b-b3f5-72975c91491b-tmp-dir\") pod \"node-resolver-bkn4j\" (UID: \"2a06b9d1-9a08-413b-b3f5-72975c91491b\") " pod="openshift-dns/node-resolver-bkn4j"
Jul 23 13:07:40.383575 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383562    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-registration-dir\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383586    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf348358-707c-4e2f-8f9d-4406bc5f3db0-cni-binary-copy\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383613    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383637    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-run-netns\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383664    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djzvh\" (UniqueName: \"kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh\") pod \"network-check-target-8fhm9\" (UID: \"d6b2cd0e-6146-4b02-bc7c-dcaa305e5702\") " pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383687    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-cni-netd\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383720    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383726    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6feed743-b8ba-4323-8c1b-724e607a5e2a-env-overrides\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383772    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6feed743-b8ba-4323-8c1b-724e607a5e2a-ovnkube-script-lib\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383799    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba4270bd-f86f-4627-a6f7-2826e3e68ee4-konnectivity-ca\") pod \"konnectivity-agent-fm44c\" (UID: \"ba4270bd-f86f-4627-a6f7-2826e3e68ee4\") " pod="kube-system/konnectivity-agent-fm44c"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383825    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jdm2\" (UniqueName: \"kubernetes.io/projected/2a06b9d1-9a08-413b-b3f5-72975c91491b-kube-api-access-2jdm2\") pod \"node-resolver-bkn4j\" (UID: \"2a06b9d1-9a08-413b-b3f5-72975c91491b\") " pod="openshift-dns/node-resolver-bkn4j"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-systemd-units\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-etc-openvswitch\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383909    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.383949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-run-k8s-cni-cncf-io\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383971    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-var-lib-cni-multus\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.383998    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384025    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6feed743-b8ba-4323-8c1b-724e607a5e2a-ovnkube-config\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384068    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba4270bd-f86f-4627-a6f7-2826e3e68ee4-agent-certs\") pod \"konnectivity-agent-fm44c\" (UID: \"ba4270bd-f86f-4627-a6f7-2826e3e68ee4\") " pod="kube-system/konnectivity-agent-fm44c"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384096    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnsqg\" (UniqueName: \"kubernetes.io/projected/c8eca1b7-a872-43f9-ad6f-29a54a8995be-kube-api-access-nnsqg\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs\") pod \"network-metrics-daemon-khpmp\" (UID: \"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b\") " pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384146    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-kubelet\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384172    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-cnibin\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384200    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-system-cni-dir\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384255    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-log-socket\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384257    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384277    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6feed743-b8ba-4323-8c1b-724e607a5e2a-env-overrides\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.384573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384281    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-run-ovn-kubernetes\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384317    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-cni-bin\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384328    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-run-ovn-kubernetes\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384338    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-sys-fs\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384345    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-run-netns\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384806    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384833    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-cni-netd\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384885    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-cni-bin\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384908    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384946    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-registration-dir\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.384886    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6feed743-b8ba-4323-8c1b-724e607a5e2a-ovnkube-config\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385035    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-etc-selinux\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385106    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db64z\" (UniqueName: \"kubernetes.io/projected/bf348358-707c-4e2f-8f9d-4406bc5f3db0-kube-api-access-db64z\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385136    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/445b9a2d-a940-4a87-a43d-c77f6b5ae445-iptables-alerter-script\") pod \"iptables-alerter-98f2p\" (UID: \"445b9a2d-a940-4a87-a43d-c77f6b5ae445\") " pod="openshift-network-operator/iptables-alerter-98f2p"
Jul 23 13:07:40.385349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385146    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-log-socket\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385164    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a06b9d1-9a08-413b-b3f5-72975c91491b-tmp-dir\") pod \"node-resolver-bkn4j\" (UID: \"2a06b9d1-9a08-413b-b3f5-72975c91491b\") " pod="openshift-dns/node-resolver-bkn4j"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385167    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385191    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-kubelet\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385195    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-slash\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385221    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6feed743-b8ba-4323-8c1b-724e607a5e2a-ovn-node-metrics-cert\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385227    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-run-k8s-cni-cncf-io\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385249    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffh55\" (UniqueName: \"kubernetes.io/projected/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-kube-api-access-ffh55\") pod \"network-metrics-daemon-khpmp\" (UID: \"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b\") " pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385260    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-var-lib-cni-multus\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385281    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgnpf\" (UniqueName: \"kubernetes.io/projected/445b9a2d-a940-4a87-a43d-c77f6b5ae445-kube-api-access-fgnpf\") pod \"iptables-alerter-98f2p\" (UID: \"445b9a2d-a940-4a87-a43d-c77f6b5ae445\") " pod="openshift-network-operator/iptables-alerter-98f2p"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385381    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-var-lib-openvswitch\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385420    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkll4\" (UniqueName: \"kubernetes.io/projected/6feed743-b8ba-4323-8c1b-724e607a5e2a-kube-api-access-kkll4\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-socket-dir\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385464    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-system-cni-dir\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.386049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385477    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89cec7d4-3633-4cf4-bba6-b680f7f86825-host\") pod \"node-ca-c9cjt\" (UID: \"89cec7d4-3633-4cf4-bba6-b680f7f86825\") " pod="openshift-image-registry/node-ca-c9cjt"
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385505    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-run-netns\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-run-systemd\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385546    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-run-systemd\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385547    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-multus-socket-dir-parent\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.385558    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385583    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-var-lib-cni-bin\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385588    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba4270bd-f86f-4627-a6f7-2826e3e68ee4-konnectivity-ca\") pod \"konnectivity-agent-fm44c\" (UID: \"ba4270bd-f86f-4627-a6f7-2826e3e68ee4\") " pod="kube-system/konnectivity-agent-fm44c"
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385598    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-multus-socket-dir-parent\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385610    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-multus-conf-dir\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385642    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89cec7d4-3633-4cf4-bba6-b680f7f86825-serviceca\") pod \"node-ca-c9cjt\" (UID: \"89cec7d4-3633-4cf4-bba6-b680f7f86825\") " pod="openshift-image-registry/node-ca-c9cjt"
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385654    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-multus-conf-dir\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.385671    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs podName:1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:40.885653241 +0000 UTC m=+3.139179110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs") pod "network-metrics-daemon-khpmp" (UID: "1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385691    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/445b9a2d-a940-4a87-a43d-c77f6b5ae445-host-slash\") pod \"iptables-alerter-98f2p\" (UID: \"445b9a2d-a940-4a87-a43d-c77f6b5ae445\") " pod="openshift-network-operator/iptables-alerter-98f2p"
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385722    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-hostroot\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.386763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385722    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-os-release\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385774    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-run-openvswitch\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385792    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-os-release\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385803    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-device-dir\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385422    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385900    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-run-netns\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386014    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89cec7d4-3633-4cf4-bba6-b680f7f86825-serviceca\") pod \"node-ca-c9cjt\" (UID: \"89cec7d4-3633-4cf4-bba6-b680f7f86825\") " pod="openshift-image-registry/node-ca-c9cjt"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386033    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/445b9a2d-a940-4a87-a43d-c77f6b5ae445-host-slash\") pod \"iptables-alerter-98f2p\" (UID: \"445b9a2d-a940-4a87-a43d-c77f6b5ae445\") " pod="openshift-network-operator/iptables-alerter-98f2p"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.385692    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-etc-openvswitch\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386091    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-host-slash\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386489    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf348358-707c-4e2f-8f9d-4406bc5f3db0-cni-binary-copy\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386538    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-var-lib-openvswitch\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386548    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/445b9a2d-a940-4a87-a43d-c77f6b5ae445-iptables-alerter-script\") pod \"iptables-alerter-98f2p\" (UID: \"445b9a2d-a940-4a87-a43d-c77f6b5ae445\") " pod="openshift-network-operator/iptables-alerter-98f2p"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386611    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89cec7d4-3633-4cf4-bba6-b680f7f86825-host\") pod \"node-ca-c9cjt\" (UID: \"89cec7d4-3633-4cf4-bba6-b680f7f86825\") " pod="openshift-image-registry/node-ca-c9cjt"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386640    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6feed743-b8ba-4323-8c1b-724e607a5e2a-ovnkube-script-lib\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.387518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386652    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-systemd-units\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386723    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-cnibin\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386740    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-socket-dir\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386750    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-var-lib-cni-bin\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386762    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-run-openvswitch\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386764    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-system-cni-dir\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386788    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8eca1b7-a872-43f9-ad6f-29a54a8995be-device-dir\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386911    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-system-cni-dir\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.386949    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-multus-cni-dir\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387002    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a06b9d1-9a08-413b-b3f5-72975c91491b-hosts-file\") pod \"node-resolver-bkn4j\" (UID: \"2a06b9d1-9a08-413b-b3f5-72975c91491b\") " pod="openshift-dns/node-resolver-bkn4j"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387044    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-run-ovn\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387064    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-multus-cni-dir\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-var-lib-kubelet\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387134    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a06b9d1-9a08-413b-b3f5-72975c91491b-hosts-file\") pod \"node-resolver-bkn4j\" (UID: \"2a06b9d1-9a08-413b-b3f5-72975c91491b\") " pod="openshift-dns/node-resolver-bkn4j"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387142    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-etc-kubernetes\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387184    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-var-lib-kubelet\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387208    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-run-ovn\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.388954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387288    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-etc-kubernetes\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387324    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-node-log\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.388954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387362    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.388954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387380    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6feed743-b8ba-4323-8c1b-724e607a5e2a-node-log\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.388954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-os-release\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387447    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf348358-707c-4e2f-8f9d-4406bc5f3db0-multus-daemon-config\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-run-multus-certs\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387514    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-cnibin\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.388954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387533    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-os-release\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387585    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-cnibin\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.388954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387589    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf348358-707c-4e2f-8f9d-4406bc5f3db0-host-run-multus-certs\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.388954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.387994    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf348358-707c-4e2f-8f9d-4406bc5f3db0-multus-daemon-config\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.389649 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.389047    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6feed743-b8ba-4323-8c1b-724e607a5e2a-ovn-node-metrics-cert\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.389649 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.389449    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba4270bd-f86f-4627-a6f7-2826e3e68ee4-agent-certs\") pod \"konnectivity-agent-fm44c\" (UID: \"ba4270bd-f86f-4627-a6f7-2826e3e68ee4\") " pod="kube-system/konnectivity-agent-fm44c"
Jul 23 13:07:40.390790 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.390493    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:07:40.390790 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.390520    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:07:40.390790 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.390537    2570 projected.go:196] Error preparing data for projected volume kube-api-access-djzvh for pod openshift-network-diagnostics/network-check-target-8fhm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:40.390790 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.390607    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh podName:d6b2cd0e-6146-4b02-bc7c-dcaa305e5702 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:40.89058807 +0000 UTC m=+3.144113949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-djzvh" (UniqueName: "kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh") pod "network-check-target-8fhm9" (UID: "d6b2cd0e-6146-4b02-bc7c-dcaa305e5702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:40.393018 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.392973    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srqmw\" (UniqueName: \"kubernetes.io/projected/2c0e869b-7b51-49f4-83cf-a9843d65a9f3-kube-api-access-srqmw\") pod \"multus-additional-cni-plugins-hltqz\" (UID: \"2c0e869b-7b51-49f4-83cf-a9843d65a9f3\") " pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.393601 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.393577    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnsqg\" (UniqueName: \"kubernetes.io/projected/c8eca1b7-a872-43f9-ad6f-29a54a8995be-kube-api-access-nnsqg\") pod \"aws-ebs-csi-driver-node-thnnk\" (UID: \"c8eca1b7-a872-43f9-ad6f-29a54a8995be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.393947 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.393928    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kjnt\" (UniqueName: \"kubernetes.io/projected/89cec7d4-3633-4cf4-bba6-b680f7f86825-kube-api-access-4kjnt\") pod \"node-ca-c9cjt\" (UID: \"89cec7d4-3633-4cf4-bba6-b680f7f86825\") " pod="openshift-image-registry/node-ca-c9cjt"
Jul 23 13:07:40.395576 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.395553    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffh55\" (UniqueName: \"kubernetes.io/projected/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-kube-api-access-ffh55\") pod \"network-metrics-daemon-khpmp\" (UID: \"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b\") " pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:40.398249 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.398226    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgnpf\" (UniqueName: \"kubernetes.io/projected/445b9a2d-a940-4a87-a43d-c77f6b5ae445-kube-api-access-fgnpf\") pod \"iptables-alerter-98f2p\" (UID: \"445b9a2d-a940-4a87-a43d-c77f6b5ae445\") " pod="openshift-network-operator/iptables-alerter-98f2p"
Jul 23 13:07:40.399293 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.399269    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jdm2\" (UniqueName: \"kubernetes.io/projected/2a06b9d1-9a08-413b-b3f5-72975c91491b-kube-api-access-2jdm2\") pod \"node-resolver-bkn4j\" (UID: \"2a06b9d1-9a08-413b-b3f5-72975c91491b\") " pod="openshift-dns/node-resolver-bkn4j"
Jul 23 13:07:40.401782 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.401758    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db64z\" (UniqueName: \"kubernetes.io/projected/bf348358-707c-4e2f-8f9d-4406bc5f3db0-kube-api-access-db64z\") pod \"multus-ct624\" (UID: \"bf348358-707c-4e2f-8f9d-4406bc5f3db0\") " pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.402151 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.402116    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkll4\" (UniqueName: \"kubernetes.io/projected/6feed743-b8ba-4323-8c1b-724e607a5e2a-kube-api-access-kkll4\") pod \"ovnkube-node-b5frq\" (UID: \"6feed743-b8ba-4323-8c1b-724e607a5e2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.472326 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.472289    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6gl9h"
Jul 23 13:07:40.478655 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.478633    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bkn4j"
Jul 23 13:07:40.488623 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.488600    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hltqz"
Jul 23 13:07:40.495640 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.495621    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:07:40.506431 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.506410    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fm44c"
Jul 23 13:07:40.513245 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.513220    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c9cjt"
Jul 23 13:07:40.530214 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.530181    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk"
Jul 23 13:07:40.537302 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.537276    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ct624"
Jul 23 13:07:40.546261 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.546229    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-98f2p"
Jul 23 13:07:40.673966 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.673880    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:07:40.791308 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.791272    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:40.791525 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.791384    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:40.791525 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.791443    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret podName:032fa58a-197e-4083-85ba-30d5df17374b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:41.791426994 +0000 UTC m=+4.044952849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret") pod "global-pull-secret-syncer-fjq2l" (UID: "032fa58a-197e-4083-85ba-30d5df17374b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:40.892394 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.892354    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djzvh\" (UniqueName: \"kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh\") pod \"network-check-target-8fhm9\" (UID: \"d6b2cd0e-6146-4b02-bc7c-dcaa305e5702\") " pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:40.892573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:40.892421    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs\") pod \"network-metrics-daemon-khpmp\" (UID: \"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b\") " pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:40.892573 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.892536    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:40.892573 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.892546    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:07:40.892573 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.892574    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:07:40.892815 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.892585    2570 projected.go:196] Error preparing data for projected volume kube-api-access-djzvh for pod openshift-network-diagnostics/network-check-target-8fhm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:40.892815 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.892601    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs podName:1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:41.892583206 +0000 UTC m=+4.146109075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs") pod "network-metrics-daemon-khpmp" (UID: "1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:40.892815 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:40.892653    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh podName:d6b2cd0e-6146-4b02-bc7c-dcaa305e5702 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:41.89261687 +0000 UTC m=+4.146142741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-djzvh" (UniqueName: "kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh") pod "network-check-target-8fhm9" (UID: "d6b2cd0e-6146-4b02-bc7c-dcaa305e5702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:41.194289 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:41.194245    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 13:02:40 +0000 UTC" deadline="2028-05-02 11:22:35.404919872 +0000 UTC"
Jul 23 13:07:41.194289 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:41.194287    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15574h14m54.210639517s"
Jul 23 13:07:41.352901 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:41.352860    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:41.353475 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:41.352969    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:07:41.521123 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:41.521021    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf348358_707c_4e2f_8f9d_4406bc5f3db0.slice/crio-5f5867e88b3d99f04d84177c153cf79ec504ee5492d566613c71bb6c5beab52d WatchSource:0}: Error finding container 5f5867e88b3d99f04d84177c153cf79ec504ee5492d566613c71bb6c5beab52d: Status 404 returned error can't find the container with id 5f5867e88b3d99f04d84177c153cf79ec504ee5492d566613c71bb6c5beab52d
Jul 23 13:07:41.524259 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:41.524226    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8eca1b7_a872_43f9_ad6f_29a54a8995be.slice/crio-3b12caecf602eaf661e82f7fe13dfc512dd9defb1dbd96679689b0b06df9ba2e WatchSource:0}: Error finding container 3b12caecf602eaf661e82f7fe13dfc512dd9defb1dbd96679689b0b06df9ba2e: Status 404 returned error can't find the container with id 3b12caecf602eaf661e82f7fe13dfc512dd9defb1dbd96679689b0b06df9ba2e
Jul 23 13:07:41.527562 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:41.527533    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89cec7d4_3633_4cf4_bba6_b680f7f86825.slice/crio-de7ae1b590cc14b6fd3fc1fa841f030ede39d07ee2622e9b70aa96506275085b WatchSource:0}: Error finding container de7ae1b590cc14b6fd3fc1fa841f030ede39d07ee2622e9b70aa96506275085b: Status 404 returned error can't find the container with id de7ae1b590cc14b6fd3fc1fa841f030ede39d07ee2622e9b70aa96506275085b
Jul 23 13:07:41.528418 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:41.528396    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a06b9d1_9a08_413b_b3f5_72975c91491b.slice/crio-48db672dfa970c4b92685299a13ba158eb47e85c89663d3a21f8a0f58057bf40 WatchSource:0}: Error finding container 48db672dfa970c4b92685299a13ba158eb47e85c89663d3a21f8a0f58057bf40: Status 404 returned error can't find the container with id 48db672dfa970c4b92685299a13ba158eb47e85c89663d3a21f8a0f58057bf40
Jul 23 13:07:41.541890 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:07:41.540285    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0e869b_7b51_49f4_83cf_a9843d65a9f3.slice/crio-6e47ead891f8311199d822ced3562d66e5a57024fab7caadce57bf13b0114d3d WatchSource:0}: Error finding container 6e47ead891f8311199d822ced3562d66e5a57024fab7caadce57bf13b0114d3d: Status 404 returned error can't find the container with id 6e47ead891f8311199d822ced3562d66e5a57024fab7caadce57bf13b0114d3d
Jul 23 13:07:41.799880 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:41.799677    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:41.800055 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:41.799787    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:41.800055 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:41.800009    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret podName:032fa58a-197e-4083-85ba-30d5df17374b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:43.799981171 +0000 UTC m=+6.053507027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret") pod "global-pull-secret-syncer-fjq2l" (UID: "032fa58a-197e-4083-85ba-30d5df17374b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:41.901230 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:41.901178    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djzvh\" (UniqueName: \"kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh\") pod \"network-check-target-8fhm9\" (UID: \"d6b2cd0e-6146-4b02-bc7c-dcaa305e5702\") " pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:41.901230 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:41.901235    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs\") pod \"network-metrics-daemon-khpmp\" (UID: \"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b\") " pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:41.901423 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:41.901352    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:41.901423 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:41.901359    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:07:41.901423 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:41.901383    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:07:41.901423 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:41.901394    2570 projected.go:196] Error preparing data for projected volume kube-api-access-djzvh for pod openshift-network-diagnostics/network-check-target-8fhm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:41.901423 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:41.901407    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs podName:1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:43.901390833 +0000 UTC m=+6.154916689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs") pod "network-metrics-daemon-khpmp" (UID: "1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:41.901606 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:41.901438    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh podName:d6b2cd0e-6146-4b02-bc7c-dcaa305e5702 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:43.901423081 +0000 UTC m=+6.154948953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-djzvh" (UniqueName: "kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh") pod "network-check-target-8fhm9" (UID: "d6b2cd0e-6146-4b02-bc7c-dcaa305e5702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:42.196250 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.196067    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 13:02:40 +0000 UTC" deadline="2028-04-08 07:40:06.979852816 +0000 UTC"
Jul 23 13:07:42.196250 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.196133    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14994h32m24.783723866s"
Jul 23 13:07:42.354757 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.354722    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:42.355542 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:42.354890    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:07:42.355542 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.355320    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:42.355542 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:42.355412    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:07:42.399092 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.398683    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" event={"ID":"099b81222a3a57c11d9d757e4965a26f","Type":"ContainerStarted","Data":"5667da14ca1b2038fb56d0259e151406a4c656525877af4c52fb7d3453111e5a"}
Jul 23 13:07:42.405484 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.405436    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6gl9h" event={"ID":"0d191fbe-d17f-44e6-8817-73de47d5d49b","Type":"ContainerStarted","Data":"07409a386f7c6e6c07adb2035515ef910d28968d5612b2f3748ac78d36d2cbd0"}
Jul 23 13:07:42.410876 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.410802    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fm44c" event={"ID":"ba4270bd-f86f-4627-a6f7-2826e3e68ee4","Type":"ContainerStarted","Data":"365d44c53dc88a3f5265690be4e6c6e454d4affae073f5211d95ba224fe75861"}
Jul 23 13:07:42.422053 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.422017    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq" event={"ID":"6feed743-b8ba-4323-8c1b-724e607a5e2a","Type":"ContainerStarted","Data":"7116188f7e8efd4510d4a70101cbb79e51cfed7d1bab240250e2f3573b365b22"}
Jul 23 13:07:42.424368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.424286    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-98f2p" event={"ID":"445b9a2d-a940-4a87-a43d-c77f6b5ae445","Type":"ContainerStarted","Data":"18887f75c23bbe2f6cb2128e3ad639263f9755fb9960e37454247ef0423654bf"}
Jul 23 13:07:42.433026 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.432992    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk" event={"ID":"c8eca1b7-a872-43f9-ad6f-29a54a8995be","Type":"ContainerStarted","Data":"3b12caecf602eaf661e82f7fe13dfc512dd9defb1dbd96679689b0b06df9ba2e"}
Jul 23 13:07:42.440141 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.440110    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ct624" event={"ID":"bf348358-707c-4e2f-8f9d-4406bc5f3db0","Type":"ContainerStarted","Data":"5f5867e88b3d99f04d84177c153cf79ec504ee5492d566613c71bb6c5beab52d"}
Jul 23 13:07:42.449014 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.448938    2570 generic.go:356] "Generic (PLEG): container finished" podID="00fb35e30223243945f067fa48061f7a" containerID="6ac500ae3862a8c6d7ce1cb48497797364760180c2a87af1e9ac013eeac33ce6" exitCode=0
Jul 23 13:07:42.449171 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.449026    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" event={"ID":"00fb35e30223243945f067fa48061f7a","Type":"ContainerDied","Data":"6ac500ae3862a8c6d7ce1cb48497797364760180c2a87af1e9ac013eeac33ce6"}
Jul 23 13:07:42.453175 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.453147    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bkn4j" event={"ID":"2a06b9d1-9a08-413b-b3f5-72975c91491b","Type":"ContainerStarted","Data":"48db672dfa970c4b92685299a13ba158eb47e85c89663d3a21f8a0f58057bf40"}
Jul 23 13:07:42.459001 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.458971    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hltqz" event={"ID":"2c0e869b-7b51-49f4-83cf-a9843d65a9f3","Type":"ContainerStarted","Data":"6e47ead891f8311199d822ced3562d66e5a57024fab7caadce57bf13b0114d3d"}
Jul 23 13:07:42.468806 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.468752    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" podStartSLOduration=3.468733746 podStartE2EDuration="3.468733746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:42.418648378 +0000 UTC m=+4.672174263" watchObservedRunningTime="2026-07-23 13:07:42.468733746 +0000 UTC m=+4.722259629"
Jul 23 13:07:42.473382 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:42.473352    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c9cjt" event={"ID":"89cec7d4-3633-4cf4-bba6-b680f7f86825","Type":"ContainerStarted","Data":"de7ae1b590cc14b6fd3fc1fa841f030ede39d07ee2622e9b70aa96506275085b"}
Jul 23 13:07:43.352031 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:43.351976    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:43.352236 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:43.352144    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:07:43.504998 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:43.504678    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" event={"ID":"00fb35e30223243945f067fa48061f7a","Type":"ContainerStarted","Data":"cc3c37eac1d55ddf14c40709a54394b518b5c244519391ccb3e429d17c682fa8"}
Jul 23 13:07:43.523622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:43.523563    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" podStartSLOduration=4.523541171 podStartE2EDuration="4.523541171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:43.523047207 +0000 UTC m=+5.776573089" watchObservedRunningTime="2026-07-23 13:07:43.523541171 +0000 UTC m=+5.777067051"
Jul 23 13:07:43.820254 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:43.820002    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:43.820254 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:43.820167    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:43.820254 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:43.820233    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret podName:032fa58a-197e-4083-85ba-30d5df17374b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:47.820212435 +0000 UTC m=+10.073738311 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret") pod "global-pull-secret-syncer-fjq2l" (UID: "032fa58a-197e-4083-85ba-30d5df17374b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:43.921228 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:43.921184    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djzvh\" (UniqueName: \"kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh\") pod \"network-check-target-8fhm9\" (UID: \"d6b2cd0e-6146-4b02-bc7c-dcaa305e5702\") " pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:43.921426 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:43.921254    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs\") pod \"network-metrics-daemon-khpmp\" (UID: \"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b\") " pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:43.921426 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:43.921388    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:43.921553 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:43.921456    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs podName:1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:47.921434622 +0000 UTC m=+10.174960500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs") pod "network-metrics-daemon-khpmp" (UID: "1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:43.921895 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:43.921874    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:07:43.921996 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:43.921901    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:07:43.921996 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:43.921916    2570 projected.go:196] Error preparing data for projected volume kube-api-access-djzvh for pod openshift-network-diagnostics/network-check-target-8fhm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:43.921996 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:43.921964    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh podName:d6b2cd0e-6146-4b02-bc7c-dcaa305e5702 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:47.921948134 +0000 UTC m=+10.175474015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-djzvh" (UniqueName: "kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh") pod "network-check-target-8fhm9" (UID: "d6b2cd0e-6146-4b02-bc7c-dcaa305e5702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:44.355124 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:44.355089    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:44.355321 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:44.355256    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:07:44.355688 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:44.355664    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:44.355797 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:44.355774    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:07:45.352975 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:45.352940    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:45.353497 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:45.353131    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:07:46.352122 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:46.352020    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:46.352282 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:46.352188    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:07:46.352344 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:46.352020    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:46.352511 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:46.352483    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:07:47.352406 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:47.352365    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:47.352900 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:47.352510    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:07:47.857410 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:47.857371    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:47.857607 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:47.857569    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:47.857693 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:47.857630    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret podName:032fa58a-197e-4083-85ba-30d5df17374b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:55.857613869 +0000 UTC m=+18.111139729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret") pod "global-pull-secret-syncer-fjq2l" (UID: "032fa58a-197e-4083-85ba-30d5df17374b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:47.957984 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:47.957941    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djzvh\" (UniqueName: \"kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh\") pod \"network-check-target-8fhm9\" (UID: \"d6b2cd0e-6146-4b02-bc7c-dcaa305e5702\") " pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:47.958177 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:47.958027    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs\") pod \"network-metrics-daemon-khpmp\" (UID: \"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b\") " pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:47.958283 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:47.958257    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:47.958409 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:47.958330    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs podName:1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:55.958309105 +0000 UTC m=+18.211834967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs") pod "network-metrics-daemon-khpmp" (UID: "1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:47.958480 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:47.958451    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:07:47.958536 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:47.958481    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:07:47.958536 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:47.958498    2570 projected.go:196] Error preparing data for projected volume kube-api-access-djzvh for pod openshift-network-diagnostics/network-check-target-8fhm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:47.958642 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:47.958572    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh podName:d6b2cd0e-6146-4b02-bc7c-dcaa305e5702 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:55.95855331 +0000 UTC m=+18.212079172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-djzvh" (UniqueName: "kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh") pod "network-check-target-8fhm9" (UID: "d6b2cd0e-6146-4b02-bc7c-dcaa305e5702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:48.354928 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:48.354895    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:48.355395 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:48.355032    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:07:48.355395 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:48.355049    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:48.355395 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:48.355114    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:07:49.352745 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:49.352262    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:49.352745 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:49.352398    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:07:50.352480 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:50.352380    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:50.352951 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:50.352534    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:07:50.352951 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:50.352587    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:50.352951 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:50.352692    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:07:51.352260 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:51.352200    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:51.352444 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:51.352352    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:07:52.352361 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:52.352323    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:52.352831 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:52.352362    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:52.352831 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:52.352476    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:07:52.352831 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:52.352613    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:07:53.352658 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:53.352623    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:53.353074 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:53.352759    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:07:54.352084 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:54.352042    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:54.352280 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:54.352042    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:54.352280 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:54.352174    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:07:54.352280 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:54.352205    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:07:55.352809 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:55.352765    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:55.353383 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:55.352932    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:07:55.915202 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:55.915168    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:55.915374 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:55.915284    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:55.915374 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:55.915346    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret podName:032fa58a-197e-4083-85ba-30d5df17374b nodeName:}" failed. No retries permitted until 2026-07-23 13:08:11.915329077 +0000 UTC m=+34.168854934 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret") pod "global-pull-secret-syncer-fjq2l" (UID: "032fa58a-197e-4083-85ba-30d5df17374b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:56.016243 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:56.016203    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djzvh\" (UniqueName: \"kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh\") pod \"network-check-target-8fhm9\" (UID: \"d6b2cd0e-6146-4b02-bc7c-dcaa305e5702\") " pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:56.016243 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:56.016249    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs\") pod \"network-metrics-daemon-khpmp\" (UID: \"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b\") " pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:56.016470 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:56.016355    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:56.016470 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:56.016379    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:07:56.016470 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:56.016403    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:07:56.016470 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:56.016411    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs podName:1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b nodeName:}" failed. No retries permitted until 2026-07-23 13:08:12.016393744 +0000 UTC m=+34.269919598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs") pod "network-metrics-daemon-khpmp" (UID: "1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:56.016470 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:56.016415    2570 projected.go:196] Error preparing data for projected volume kube-api-access-djzvh for pod openshift-network-diagnostics/network-check-target-8fhm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:56.016470 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:56.016459    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh podName:d6b2cd0e-6146-4b02-bc7c-dcaa305e5702 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:12.016444635 +0000 UTC m=+34.269970506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-djzvh" (UniqueName: "kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh") pod "network-check-target-8fhm9" (UID: "d6b2cd0e-6146-4b02-bc7c-dcaa305e5702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:56.352678 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:56.352632    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:56.352853 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:56.352632    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:56.352853 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:56.352799    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:07:56.353302 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:56.352909    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:07:57.352868 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:57.352829    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:57.353376 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:57.352961    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:07:58.353582 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:58.353534    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:07:58.354039 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:58.353653    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:07:58.354039 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:58.353701    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:07:58.354039 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:58.353788    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:07:59.352903 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:07:59.352866    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:07:59.353101 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:07:59.353002    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:00.352316 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:00.352285    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:00.352868 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:00.352297    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:00.352868 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:00.352419    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:00.352868 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:00.352496    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:01.352273 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.351965    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:01.352429 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:01.352390    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:01.547712 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.547675    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk" event={"ID":"c8eca1b7-a872-43f9-ad6f-29a54a8995be","Type":"ContainerStarted","Data":"466df28b94484d39f7d16b2189866553a6420d89b6bbbc60a6dfe821c766953e"}
Jul 23 13:08:01.549273 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.549248    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ct624" event={"ID":"bf348358-707c-4e2f-8f9d-4406bc5f3db0","Type":"ContainerStarted","Data":"3fc9ae5a01edcf01eca36d1df7a2faa6bb4fec7f4bb3a972932fa28a795f5a82"}
Jul 23 13:08:01.550854 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.550825    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bkn4j" event={"ID":"2a06b9d1-9a08-413b-b3f5-72975c91491b","Type":"ContainerStarted","Data":"9f0ce5a2e65402e2ff0ebc1a7ae34c854a12cec0d151b3581bc2c006f1b0e05d"}
Jul 23 13:08:01.552246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.552222    2570 generic.go:356] "Generic (PLEG): container finished" podID="2c0e869b-7b51-49f4-83cf-a9843d65a9f3" containerID="77e5b85e20d49c25802773a58966cdc5212fdc9ad9d42f2c86b1a8f9dffd0444" exitCode=0
Jul 23 13:08:01.552350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.552282    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hltqz" event={"ID":"2c0e869b-7b51-49f4-83cf-a9843d65a9f3","Type":"ContainerDied","Data":"77e5b85e20d49c25802773a58966cdc5212fdc9ad9d42f2c86b1a8f9dffd0444"}
Jul 23 13:08:01.553928 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.553893    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c9cjt" event={"ID":"89cec7d4-3633-4cf4-bba6-b680f7f86825","Type":"ContainerStarted","Data":"5bd96835e33ce0ca455f71b03f749327c57d674d2112b9636940176c9c3a0cfb"}
Jul 23 13:08:01.555539 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.555511    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6gl9h" event={"ID":"0d191fbe-d17f-44e6-8817-73de47d5d49b","Type":"ContainerStarted","Data":"6075f9583ce88610165fbfae264af16d6ecfa42eb7e292e98af5be9406292093"}
Jul 23 13:08:01.556910 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.556887    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fm44c" event={"ID":"ba4270bd-f86f-4627-a6f7-2826e3e68ee4","Type":"ContainerStarted","Data":"937f333aec63e0ff340f27cb4a0dc32ba645b7711db99bf7f807cdf447c5f005"}
Jul 23 13:08:01.560007 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.559768    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq" event={"ID":"6feed743-b8ba-4323-8c1b-724e607a5e2a","Type":"ContainerStarted","Data":"cabff9ac1220e9be863f6a591f46ba15a0dbffccc04e8b26ef522ffdaaa09411"}
Jul 23 13:08:01.560007 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.559842    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq" event={"ID":"6feed743-b8ba-4323-8c1b-724e607a5e2a","Type":"ContainerStarted","Data":"29c544f6e4991e85cffae5dcbb1bdd36eb380066ce15a75f1d788a487d1f71cd"}
Jul 23 13:08:01.560007 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.559885    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq" event={"ID":"6feed743-b8ba-4323-8c1b-724e607a5e2a","Type":"ContainerStarted","Data":"a6cecee47ed2437a5330a0268ed260d2a642a440bd4b2a1535d1458214d86011"}
Jul 23 13:08:01.560007 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.559927    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq" event={"ID":"6feed743-b8ba-4323-8c1b-724e607a5e2a","Type":"ContainerStarted","Data":"ee6c6fa3833f3d6996245d5383ba191a8b929be9d7a1a8a3955ac08caa06a337"}
Jul 23 13:08:01.571483 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.571431    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ct624" podStartSLOduration=2.966033599 podStartE2EDuration="22.571402416s" totalImagesPullingTime="19.605368817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:01.571378075 +0000 UTC m=+23.824903951" watchObservedRunningTime="2026-07-23 13:08:01.571402416 +0000 UTC m=+23.824928275"
Jul 23 13:08:01.592353 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.592311    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fm44c" podStartSLOduration=3.061351844 podStartE2EDuration="22.592294017s" totalImagesPullingTime="19.530942173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:01.59181876 +0000 UTC m=+23.845344637" watchObservedRunningTime="2026-07-23 13:08:01.592294017 +0000 UTC m=+23.845819892"
Jul 23 13:08:01.660651 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.660594    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c9cjt" podStartSLOduration=3.114810273 podStartE2EDuration="22.660573676s" totalImagesPullingTime="19.545763403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:01.660569417 +0000 UTC m=+23.914095296" watchObservedRunningTime="2026-07-23 13:08:01.660573676 +0000 UTC m=+23.914099554"
Jul 23 13:08:01.661310 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.661275    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:01.719469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:01.719419    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6gl9h" podStartSLOduration=3.162539881 podStartE2EDuration="22.719404884s" totalImagesPullingTime="19.556865003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:01.698475005 +0000 UTC m=+23.952000881" watchObservedRunningTime="2026-07-23 13:08:01.719404884 +0000 UTC m=+23.972930759"
Jul 23 13:08:02.107592 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:02.107563    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:02.352578 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:02.352549    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:02.352578 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:02.352569    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:02.352943 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:02.352663    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:02.352943 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:02.352750    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:02.495373 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:02.495340    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:02.567696 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:02.567543    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq" event={"ID":"6feed743-b8ba-4323-8c1b-724e607a5e2a","Type":"ContainerStarted","Data":"3b3f9475c22b4770f723de3d4bc60613df5ec4d2d2c111336764cd7875758b5e"}
Jul 23 13:08:02.567696 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:02.567640    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq" event={"ID":"6feed743-b8ba-4323-8c1b-724e607a5e2a","Type":"ContainerStarted","Data":"7950f34ca84e9204a863689d42ec6e360bc500cfb3a273ea049684a48b1520de"}
Jul 23 13:08:02.569404 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:02.569375    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-98f2p" event={"ID":"445b9a2d-a940-4a87-a43d-c77f6b5ae445","Type":"ContainerStarted","Data":"f3f6839600dff7caf809fa1da6ccc5beccaec1a5cf532545ef9995e657941a27"}
Jul 23 13:08:02.586358 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:02.586304    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-98f2p" podStartSLOduration=4.048405047 podStartE2EDuration="23.5862827s" totalImagesPullingTime="19.537877653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:02.585974461 +0000 UTC m=+24.839500338" watchObservedRunningTime="2026-07-23 13:08:02.5862827 +0000 UTC m=+24.839808578"
Jul 23 13:08:02.586554 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:02.586533    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bkn4j" podStartSLOduration=4.041679042 podStartE2EDuration="23.586525078s" totalImagesPullingTime="19.544846036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:01.718935017 +0000 UTC m=+23.972460896" watchObservedRunningTime="2026-07-23 13:08:02.586525078 +0000 UTC m=+24.840050996"
Jul 23 13:08:02.637509 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:02.637472    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 13:08:02.895726 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:02.895638    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:03.098200 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:03.098160    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:03.120105 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:03.120073    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fm44c"
Jul 23 13:08:03.251030 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:03.250909    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T13:08:02.63750368Z","UUID":"cdad2366-3c83-4d2b-86f1-89627f7fac60","Handler":null,"Name":"","Endpoint":""}
Jul 23 13:08:03.252636 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:03.252610    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 13:08:03.252774 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:03.252654    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 13:08:03.352543 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:03.352500    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:03.352757 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:03.352638    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:03.574618 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:03.574491    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk" event={"ID":"c8eca1b7-a872-43f9-ad6f-29a54a8995be","Type":"ContainerStarted","Data":"849c846a0d7a4a0ed030df23aa694e41b240df3073c418366bbba2f7bd905a8c"}
Jul 23 13:08:03.706851 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:03.706817    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:04.099660 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.099634    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:04.289076 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.289045    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:04.352967 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.352908    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:04.352967 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.352910    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:04.353419 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:04.353067    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:04.353419 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:04.353183    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:04.484057 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.484031    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fm44c"
Jul 23 13:08:04.484483 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.484466    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fm44c"
Jul 23 13:08:04.492173 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.492158    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:04.581271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.581238    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq" event={"ID":"6feed743-b8ba-4323-8c1b-724e607a5e2a","Type":"ContainerStarted","Data":"73059fc0a9f37162eea92fbff6d1958fc6a45d3589f4c242202790ef1c961167"}
Jul 23 13:08:04.583577 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.583548    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk" event={"ID":"c8eca1b7-a872-43f9-ad6f-29a54a8995be","Type":"ContainerStarted","Data":"43849dc63b6be50bcb7dcb715aa529071e29dc0c55e589179b401dfeff68c742"}
Jul 23 13:08:04.584197 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.584180    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fm44c"
Jul 23 13:08:04.602635 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.602583    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thnnk" podStartSLOduration=3.363418655 podStartE2EDuration="25.602568568s" totalImagesPullingTime="22.239149913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:04.602472089 +0000 UTC m=+26.855997965" watchObservedRunningTime="2026-07-23 13:08:04.602568568 +0000 UTC m=+26.856094447"
Jul 23 13:08:04.701625 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.701561    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:04.802926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.802892    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:04.998831 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:04.998660    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:05.298757 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:05.298690    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:05.352749 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:05.352718    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:05.352896 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:05.352815    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:05.496245 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:05.496212    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:05.597152 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:05.597080    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:05.909311 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:05.909277    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:06.352472 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:06.352331    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:06.352569 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:06.352405    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:06.352608 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:06.352565    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:06.352659 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:06.352637    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:06.590766 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:06.590736    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq" event={"ID":"6feed743-b8ba-4323-8c1b-724e607a5e2a","Type":"ContainerStarted","Data":"8667f32097c0a456154ef7670299ac0f730ac2a2a8c86e5bca95fb009b26568c"}
Jul 23 13:08:06.591543 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:06.590936    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:08:06.592657 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:06.592634    2570 generic.go:356] "Generic (PLEG): container finished" podID="2c0e869b-7b51-49f4-83cf-a9843d65a9f3" containerID="c45e6e46a94c3c9a5ebfd63935ea3694af5629a39683c2b69cbec40e78dc078b" exitCode=0
Jul 23 13:08:06.592767 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:06.592664    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hltqz" event={"ID":"2c0e869b-7b51-49f4-83cf-a9843d65a9f3","Type":"ContainerDied","Data":"c45e6e46a94c3c9a5ebfd63935ea3694af5629a39683c2b69cbec40e78dc078b"}
Jul 23 13:08:06.605841 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:06.605823    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:08:06.619518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:06.619480    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq" podStartSLOduration=8.012641745 podStartE2EDuration="27.619467989s" totalImagesPullingTime="19.606826244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:06.618927719 +0000 UTC m=+28.872453595" watchObservedRunningTime="2026-07-23 13:08:06.619467989 +0000 UTC m=+28.872993864"
Jul 23 13:08:06.687383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:06.687331    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:06.889371 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:06.889346    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:06.991207 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:06.991173    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:07.049997 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:07.049960    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:07.223669 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:07.223631    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:07.324023 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:07.323931    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:07.352736 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:07.352711    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:07.352861 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:07.352801    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:07.494685 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:07.494661    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:07.595553 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:07.595490    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:08:07.595553 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:07.595548    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:08:07.609862 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:07.609839    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:08:07.891356 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:07.891332    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:08.353151 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:08.353126    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:08.353275 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:08.353205    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:08.353327 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:08.353312    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:08.353440 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:08.353418    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:08.599131 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:08.599109    2570 generic.go:356] "Generic (PLEG): container finished" podID="2c0e869b-7b51-49f4-83cf-a9843d65a9f3" containerID="8c14af077bfa2a635eca79de5c350320ae0ef56a544cd32a32616fb512fea936" exitCode=0
Jul 23 13:08:08.599496 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:08.599200    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hltqz" event={"ID":"2c0e869b-7b51-49f4-83cf-a9843d65a9f3","Type":"ContainerDied","Data":"8c14af077bfa2a635eca79de5c350320ae0ef56a544cd32a32616fb512fea936"}
Jul 23 13:08:08.702249 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:08.702184    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:09.106617 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:09.106587    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:09.303589 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:09.303539    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:09.352749 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:09.352713    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:09.352920 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:09.352835    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:09.534698 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:09.534664    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:09.702052 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:09.702017    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:10.352710 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:10.352675    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:10.352899 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:10.352675    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:10.352899 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:10.352785    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:10.352899 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:10.352871    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:10.500185 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:10.500145    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:10.605089 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:10.605012    2570 generic.go:356] "Generic (PLEG): container finished" podID="2c0e869b-7b51-49f4-83cf-a9843d65a9f3" containerID="01f802dd5651c8b536bcbeb95059c778a006123a0ee4d2e07c8974cfde2cec93" exitCode=0
Jul 23 13:08:10.605089 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:10.605071    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hltqz" event={"ID":"2c0e869b-7b51-49f4-83cf-a9843d65a9f3","Type":"ContainerDied","Data":"01f802dd5651c8b536bcbeb95059c778a006123a0ee4d2e07c8974cfde2cec93"}
Jul 23 13:08:10.896535 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:10.896435    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:11.300865 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:11.300822    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:11.352138 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:11.352109    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:11.352299 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:11.352243    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:11.533229 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:11.533195    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:11.696922 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:11.696830    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:11.931275 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:11.931246    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:11.931717 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:11.931359    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:08:11.931717 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:11.931464    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret podName:032fa58a-197e-4083-85ba-30d5df17374b nodeName:}" failed. No retries permitted until 2026-07-23 13:08:43.931400666 +0000 UTC m=+66.184926520 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret") pod "global-pull-secret-syncer-fjq2l" (UID: "032fa58a-197e-4083-85ba-30d5df17374b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:08:12.031791 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:12.031759    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djzvh\" (UniqueName: \"kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh\") pod \"network-check-target-8fhm9\" (UID: \"d6b2cd0e-6146-4b02-bc7c-dcaa305e5702\") " pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:12.031979 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:12.031805    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs\") pod \"network-metrics-daemon-khpmp\" (UID: \"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b\") " pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:12.031979 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:12.031940    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:08:12.032111 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:12.032022    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs podName:1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b nodeName:}" failed. No retries permitted until 2026-07-23 13:08:44.032006698 +0000 UTC m=+66.285532553 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs") pod "network-metrics-daemon-khpmp" (UID: "1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:08:12.032111 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:12.031941    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:08:12.032111 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:12.032069    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:08:12.032111 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:12.032081    2570 projected.go:196] Error preparing data for projected volume kube-api-access-djzvh for pod openshift-network-diagnostics/network-check-target-8fhm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:08:12.032270 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:12.032126    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh podName:d6b2cd0e-6146-4b02-bc7c-dcaa305e5702 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:44.032107825 +0000 UTC m=+66.285633679 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-djzvh" (UniqueName: "kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh") pod "network-check-target-8fhm9" (UID: "d6b2cd0e-6146-4b02-bc7c-dcaa305e5702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:08:12.241746 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:12.241713    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:12.352347 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:12.352248    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:12.352347 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:12.352301    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:12.352591 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:12.352434    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:12.352591 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:12.352566    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:13.352946 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:13.352910    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:13.353414 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:13.353045    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:13.867382 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:13.867343    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:13.939214 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:13.939162    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:14.352466 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:14.352430    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:14.352654 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:14.352472    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:14.352654 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:14.352587    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:14.352750 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:14.352666    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:14.615882 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:14.615859    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hltqz" event={"ID":"2c0e869b-7b51-49f4-83cf-a9843d65a9f3","Type":"ContainerStarted","Data":"d97000852e4e217b0a772c50bb4d98cb57f4058061aad3aa06e2d1c1b21b16fc"}
Jul 23 13:08:15.351895 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:15.351851    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:15.352091 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:15.351967    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:15.620549 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:15.620463    2570 generic.go:356] "Generic (PLEG): container finished" podID="2c0e869b-7b51-49f4-83cf-a9843d65a9f3" containerID="d97000852e4e217b0a772c50bb4d98cb57f4058061aad3aa06e2d1c1b21b16fc" exitCode=0
Jul 23 13:08:15.620549 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:15.620508    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hltqz" event={"ID":"2c0e869b-7b51-49f4-83cf-a9843d65a9f3","Type":"ContainerDied","Data":"d97000852e4e217b0a772c50bb4d98cb57f4058061aad3aa06e2d1c1b21b16fc"}
Jul 23 13:08:16.352940 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:16.352905    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:16.353149 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:16.352915    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:16.353149 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:16.353046    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:16.353149 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:16.353085    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:16.625740 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:16.625656    2570 generic.go:356] "Generic (PLEG): container finished" podID="2c0e869b-7b51-49f4-83cf-a9843d65a9f3" containerID="82ae577589cdbef507522bbcede36b979f89a664d6548454fd39f2bb3ffd7d03" exitCode=0
Jul 23 13:08:16.625740 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:16.625694    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hltqz" event={"ID":"2c0e869b-7b51-49f4-83cf-a9843d65a9f3","Type":"ContainerDied","Data":"82ae577589cdbef507522bbcede36b979f89a664d6548454fd39f2bb3ffd7d03"}
Jul 23 13:08:17.352948 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:17.352913    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:17.353103 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:17.353022    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:17.631361 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:17.631282    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hltqz" event={"ID":"2c0e869b-7b51-49f4-83cf-a9843d65a9f3","Type":"ContainerStarted","Data":"7ab6779548b3d9571581dcc5ab28be5964ced6b96012c1cff244f4d395588bad"}
Jul 23 13:08:17.655804 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:17.655760    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hltqz" podStartSLOduration=8.299812115 podStartE2EDuration="38.65574313s" totalImagesPullingTime="30.355931015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:17.654598466 +0000 UTC m=+39.908124341" watchObservedRunningTime="2026-07-23 13:08:17.65574313 +0000 UTC m=+39.909268989"
Jul 23 13:08:18.353373 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:18.353333    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:18.353577 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:18.353454    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:18.353577 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:18.353497    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:18.353699 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:18.353582    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:19.352535 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:19.352497    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:19.352875 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:19.352593    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:19.505589 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:19.505555    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:19.558226 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:19.558194    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:20.352445 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:20.352410    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:20.352631 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:20.352453    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:20.352631 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:20.352518    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:20.352631 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:20.352590    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:20.881864 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:20.881831    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:21.004065 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:21.004033    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:21.103595 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:21.103564    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:21.352510 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:21.352476    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:21.352668 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:21.352585    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:21.361139 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:21.361102    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:21.513302 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:21.513269    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:22.352851 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:22.352816    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:22.353549 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:22.352928    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:22.353549 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:22.353005    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:22.353549 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:22.353098    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:22.391899 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:22.391792    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjq2l"]
Jul 23 13:08:22.392168 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:22.391926    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:22.392168 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:22.392059    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:22.392545 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:22.392526    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-khpmp"]
Jul 23 13:08:22.397430 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:22.397408    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8fhm9"]
Jul 23 13:08:22.645025 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:22.645000    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:22.645207 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:22.644999    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:22.645207 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:22.645111    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:22.645207 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:22.645193    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:24.352582 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:24.352552    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:24.352582 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:24.352585    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:24.353255 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:24.352554    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:24.353255 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:24.352661    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:24.353255 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:24.352722    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:24.353255 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:24.352793    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:24.876044 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:24.876011    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:24.928123 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:24.928101    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:26.352236 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:26.352206    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:26.352236 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:26.352219    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:26.352236 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:26.352214    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:26.352754 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:26.352318    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fhm9" podUID="d6b2cd0e-6146-4b02-bc7c-dcaa305e5702"
Jul 23 13:08:26.352754 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:26.352356    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khpmp" podUID="1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b"
Jul 23 13:08:26.352754 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:26.352427    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjq2l" podUID="032fa58a-197e-4083-85ba-30d5df17374b"
Jul 23 13:08:27.035501 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.035480    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeReady"
Jul 23 13:08:27.035640 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.035594    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 13:08:27.079803 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.079775    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g4tt8"]
Jul 23 13:08:27.089628 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.089609    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-smphx"]
Jul 23 13:08:27.089740 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.089725    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g4tt8"
Jul 23 13:08:27.093971 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.093641    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mbwhb\""
Jul 23 13:08:27.093971 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.093938    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 13:08:27.094154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.094051    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 13:08:27.094712 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.094641    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 13:08:27.105713 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.105693    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g4tt8"]
Jul 23 13:08:27.105797 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.105722    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-smphx"]
Jul 23 13:08:27.105797 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.105739    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6wr5w"]
Jul 23 13:08:27.105864 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.105795    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.108337 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.108319    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 13:08:27.108434 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.108385    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b6wbz\""
Jul 23 13:08:27.108434 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.108390    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 13:08:27.114681 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.114666    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.116939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.116902    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 13:08:27.116939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.116948    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-njgx6\""
Jul 23 13:08:27.117231 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.117192    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 13:08:27.117714 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.117697    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6wr5w"]
Jul 23 13:08:27.117904 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.117873    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 13:08:27.117904 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.117900    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 13:08:27.148442 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.148420    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/625c8f25-814a-438f-bce0-31b507fccd87-crio-socket\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.148625 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.148446    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blpgm\" (UniqueName: \"kubernetes.io/projected/625c8f25-814a-438f-bce0-31b507fccd87-kube-api-access-blpgm\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.148625 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.148462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4158b30-dd08-44a6-95e7-eafb86ff3904-cert\") pod \"ingress-canary-g4tt8\" (UID: \"e4158b30-dd08-44a6-95e7-eafb86ff3904\") " pod="openshift-ingress-canary/ingress-canary-g4tt8"
Jul 23 13:08:27.148625 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.148480    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/625c8f25-814a-438f-bce0-31b507fccd87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.148625 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.148527    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/625c8f25-814a-438f-bce0-31b507fccd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.148625 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.148563    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c0217f6-c0e4-4c77-955e-5999053d1993-config-volume\") pod \"dns-default-smphx\" (UID: \"4c0217f6-c0e4-4c77-955e-5999053d1993\") " pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.148625 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.148580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c0217f6-c0e4-4c77-955e-5999053d1993-metrics-tls\") pod \"dns-default-smphx\" (UID: \"4c0217f6-c0e4-4c77-955e-5999053d1993\") " pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.148625 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.148594    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0217f6-c0e4-4c77-955e-5999053d1993-tmp-dir\") pod \"dns-default-smphx\" (UID: \"4c0217f6-c0e4-4c77-955e-5999053d1993\") " pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.148625 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.148618    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/625c8f25-814a-438f-bce0-31b507fccd87-data-volume\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.148883 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.148642    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q4zr\" (UniqueName: \"kubernetes.io/projected/e4158b30-dd08-44a6-95e7-eafb86ff3904-kube-api-access-7q4zr\") pod \"ingress-canary-g4tt8\" (UID: \"e4158b30-dd08-44a6-95e7-eafb86ff3904\") " pod="openshift-ingress-canary/ingress-canary-g4tt8"
Jul 23 13:08:27.148883 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.148680    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnzkw\" (UniqueName: \"kubernetes.io/projected/4c0217f6-c0e4-4c77-955e-5999053d1993-kube-api-access-bnzkw\") pod \"dns-default-smphx\" (UID: \"4c0217f6-c0e4-4c77-955e-5999053d1993\") " pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.249866 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.249837    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/625c8f25-814a-438f-bce0-31b507fccd87-crio-socket\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.249866 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.249864    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blpgm\" (UniqueName: \"kubernetes.io/projected/625c8f25-814a-438f-bce0-31b507fccd87-kube-api-access-blpgm\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.250071 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.249881    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4158b30-dd08-44a6-95e7-eafb86ff3904-cert\") pod \"ingress-canary-g4tt8\" (UID: \"e4158b30-dd08-44a6-95e7-eafb86ff3904\") " pod="openshift-ingress-canary/ingress-canary-g4tt8"
Jul 23 13:08:27.250071 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.249898    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/625c8f25-814a-438f-bce0-31b507fccd87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.250071 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.249914    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/625c8f25-814a-438f-bce0-31b507fccd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.250071 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.249932    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c0217f6-c0e4-4c77-955e-5999053d1993-config-volume\") pod \"dns-default-smphx\" (UID: \"4c0217f6-c0e4-4c77-955e-5999053d1993\") " pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.250071 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.249953    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c0217f6-c0e4-4c77-955e-5999053d1993-metrics-tls\") pod \"dns-default-smphx\" (UID: \"4c0217f6-c0e4-4c77-955e-5999053d1993\") " pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.250308 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.250089    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/625c8f25-814a-438f-bce0-31b507fccd87-crio-socket\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.250308 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.250135    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0217f6-c0e4-4c77-955e-5999053d1993-tmp-dir\") pod \"dns-default-smphx\" (UID: \"4c0217f6-c0e4-4c77-955e-5999053d1993\") " pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.250308 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.250177    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/625c8f25-814a-438f-bce0-31b507fccd87-data-volume\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.250308 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.250209    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q4zr\" (UniqueName: \"kubernetes.io/projected/e4158b30-dd08-44a6-95e7-eafb86ff3904-kube-api-access-7q4zr\") pod \"ingress-canary-g4tt8\" (UID: \"e4158b30-dd08-44a6-95e7-eafb86ff3904\") " pod="openshift-ingress-canary/ingress-canary-g4tt8"
Jul 23 13:08:27.250308 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.250234    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnzkw\" (UniqueName: \"kubernetes.io/projected/4c0217f6-c0e4-4c77-955e-5999053d1993-kube-api-access-bnzkw\") pod \"dns-default-smphx\" (UID: \"4c0217f6-c0e4-4c77-955e-5999053d1993\") " pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.250540 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.250512    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0217f6-c0e4-4c77-955e-5999053d1993-tmp-dir\") pod \"dns-default-smphx\" (UID: \"4c0217f6-c0e4-4c77-955e-5999053d1993\") " pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.250656 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.250620    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c0217f6-c0e4-4c77-955e-5999053d1993-config-volume\") pod \"dns-default-smphx\" (UID: \"4c0217f6-c0e4-4c77-955e-5999053d1993\") " pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.250656 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.250630    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/625c8f25-814a-438f-bce0-31b507fccd87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.250818 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.250805    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/625c8f25-814a-438f-bce0-31b507fccd87-data-volume\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.254043 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.254018    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c0217f6-c0e4-4c77-955e-5999053d1993-metrics-tls\") pod \"dns-default-smphx\" (UID: \"4c0217f6-c0e4-4c77-955e-5999053d1993\") " pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.254043 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.254034    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/625c8f25-814a-438f-bce0-31b507fccd87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.254154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.254061    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4158b30-dd08-44a6-95e7-eafb86ff3904-cert\") pod \"ingress-canary-g4tt8\" (UID: \"e4158b30-dd08-44a6-95e7-eafb86ff3904\") " pod="openshift-ingress-canary/ingress-canary-g4tt8"
Jul 23 13:08:27.260037 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.260017    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blpgm\" (UniqueName: \"kubernetes.io/projected/625c8f25-814a-438f-bce0-31b507fccd87-kube-api-access-blpgm\") pod \"insights-runtime-extractor-6wr5w\" (UID: \"625c8f25-814a-438f-bce0-31b507fccd87\") " pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.260501 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.260480    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnzkw\" (UniqueName: \"kubernetes.io/projected/4c0217f6-c0e4-4c77-955e-5999053d1993-kube-api-access-bnzkw\") pod \"dns-default-smphx\" (UID: \"4c0217f6-c0e4-4c77-955e-5999053d1993\") " pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.260636 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.260622    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q4zr\" (UniqueName: \"kubernetes.io/projected/e4158b30-dd08-44a6-95e7-eafb86ff3904-kube-api-access-7q4zr\") pod \"ingress-canary-g4tt8\" (UID: \"e4158b30-dd08-44a6-95e7-eafb86ff3904\") " pod="openshift-ingress-canary/ingress-canary-g4tt8"
Jul 23 13:08:27.401967 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.401895    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g4tt8"
Jul 23 13:08:27.413032 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.413008    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:27.423147 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.423128    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6wr5w"
Jul 23 13:08:27.585563 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.585355    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g4tt8"]
Jul 23 13:08:27.588108 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.588085    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-smphx"]
Jul 23 13:08:27.592203 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:08:27.592179    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0217f6_c0e4_4c77_955e_5999053d1993.slice/crio-4865a7534b09d265ff82fde32a64a33dba6a0283b004f4f995827393215ff944 WatchSource:0}: Error finding container 4865a7534b09d265ff82fde32a64a33dba6a0283b004f4f995827393215ff944: Status 404 returned error can't find the container with id 4865a7534b09d265ff82fde32a64a33dba6a0283b004f4f995827393215ff944
Jul 23 13:08:27.594342 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:08:27.594323    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4158b30_dd08_44a6_95e7_eafb86ff3904.slice/crio-e23c31a28c59db6f98404cbbec13053d07c05849b0168a1af5f14ffc48915e0c WatchSource:0}: Error finding container e23c31a28c59db6f98404cbbec13053d07c05849b0168a1af5f14ffc48915e0c: Status 404 returned error can't find the container with id e23c31a28c59db6f98404cbbec13053d07c05849b0168a1af5f14ffc48915e0c
Jul 23 13:08:27.596302 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.596276    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6wr5w"]
Jul 23 13:08:27.599021 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:08:27.598996    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625c8f25_814a_438f_bce0_31b507fccd87.slice/crio-030a379fc4074baf0613772ede73e1671508f4d4fc0f27287fbbdd5c0792e743 WatchSource:0}: Error finding container 030a379fc4074baf0613772ede73e1671508f4d4fc0f27287fbbdd5c0792e743: Status 404 returned error can't find the container with id 030a379fc4074baf0613772ede73e1671508f4d4fc0f27287fbbdd5c0792e743
Jul 23 13:08:27.656376 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.656297    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6wr5w" event={"ID":"625c8f25-814a-438f-bce0-31b507fccd87","Type":"ContainerStarted","Data":"030a379fc4074baf0613772ede73e1671508f4d4fc0f27287fbbdd5c0792e743"}
Jul 23 13:08:27.657375 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.657356    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smphx" event={"ID":"4c0217f6-c0e4-4c77-955e-5999053d1993","Type":"ContainerStarted","Data":"4865a7534b09d265ff82fde32a64a33dba6a0283b004f4f995827393215ff944"}
Jul 23 13:08:27.658347 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:27.658329    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g4tt8" event={"ID":"e4158b30-dd08-44a6-95e7-eafb86ff3904","Type":"ContainerStarted","Data":"e23c31a28c59db6f98404cbbec13053d07c05849b0168a1af5f14ffc48915e0c"}
Jul 23 13:08:28.118608 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.118580    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp"]
Jul 23 13:08:28.132342 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.132313    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp"
Jul 23 13:08:28.133512 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.133484    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp"]
Jul 23 13:08:28.135027 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.134970    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wfm55\""
Jul 23 13:08:28.135239 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.135210    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 23 13:08:28.157216 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.157189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e8b40e4b-147e-4adb-becb-a35657280c5a-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-tw5pp\" (UID: \"e8b40e4b-147e-4adb-becb-a35657280c5a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp"
Jul 23 13:08:28.201213 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.201187    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-7plkb"]
Jul 23 13:08:28.214796 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.214772    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-7plkb"]
Jul 23 13:08:28.214923 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.214907    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-7plkb"
Jul 23 13:08:28.217690 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.217658    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 13:08:28.218032 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.218015    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-s4dt2\""
Jul 23 13:08:28.218447 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.218428    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 13:08:28.258639 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.258607    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e8b40e4b-147e-4adb-becb-a35657280c5a-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-tw5pp\" (UID: \"e8b40e4b-147e-4adb-becb-a35657280c5a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp"
Jul 23 13:08:28.258758 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.258673    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st9jh\" (UniqueName: \"kubernetes.io/projected/931cd0d5-9891-4d1b-ab11-2379dbaa26f6-kube-api-access-st9jh\") pod \"downloads-5bc67dcd46-7plkb\" (UID: \"931cd0d5-9891-4d1b-ab11-2379dbaa26f6\") " pod="openshift-console/downloads-5bc67dcd46-7plkb"
Jul 23 13:08:28.258828 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:28.258807    2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 23 13:08:28.258885 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:08:28.258873    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8b40e4b-147e-4adb-becb-a35657280c5a-tls-certificates podName:e8b40e4b-147e-4adb-becb-a35657280c5a nodeName:}" failed. No retries permitted until 2026-07-23 13:08:28.758852552 +0000 UTC m=+51.012378407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e8b40e4b-147e-4adb-becb-a35657280c5a-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-tw5pp" (UID: "e8b40e4b-147e-4adb-becb-a35657280c5a") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 23 13:08:28.354290 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.354138    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:28.354551 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.354526    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:28.354726 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.354695    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:28.357381 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.357359    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 13:08:28.357676 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.357655    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 13:08:28.358228 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.357892    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xq2s8\""
Jul 23 13:08:28.358228 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.358086    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z5gct\""
Jul 23 13:08:28.358393 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.358278    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 13:08:28.358581 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.358560    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 13:08:28.359215 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.359191    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st9jh\" (UniqueName: \"kubernetes.io/projected/931cd0d5-9891-4d1b-ab11-2379dbaa26f6-kube-api-access-st9jh\") pod \"downloads-5bc67dcd46-7plkb\" (UID: \"931cd0d5-9891-4d1b-ab11-2379dbaa26f6\") " pod="openshift-console/downloads-5bc67dcd46-7plkb"
Jul 23 13:08:28.369186 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.369128    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st9jh\" (UniqueName: \"kubernetes.io/projected/931cd0d5-9891-4d1b-ab11-2379dbaa26f6-kube-api-access-st9jh\") pod \"downloads-5bc67dcd46-7plkb\" (UID: \"931cd0d5-9891-4d1b-ab11-2379dbaa26f6\") " pod="openshift-console/downloads-5bc67dcd46-7plkb"
Jul 23 13:08:28.452282 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.452245    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:28.527232 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.527000    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-7plkb"
Jul 23 13:08:28.553176 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.553102    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:28.656471 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.656362    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:28.701021 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.700224    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-7plkb"]
Jul 23 13:08:28.706095 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:08:28.706062    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931cd0d5_9891_4d1b_ab11_2379dbaa26f6.slice/crio-8158a1f1e8f30ac66953fbaa333ead86a66f0713805b3d0e8895ac803f6418d9 WatchSource:0}: Error finding container 8158a1f1e8f30ac66953fbaa333ead86a66f0713805b3d0e8895ac803f6418d9: Status 404 returned error can't find the container with id 8158a1f1e8f30ac66953fbaa333ead86a66f0713805b3d0e8895ac803f6418d9
Jul 23 13:08:28.752440 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.752407    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:28.763962 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.763936    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e8b40e4b-147e-4adb-becb-a35657280c5a-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-tw5pp\" (UID: \"e8b40e4b-147e-4adb-becb-a35657280c5a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp"
Jul 23 13:08:28.767266 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.767218    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e8b40e4b-147e-4adb-becb-a35657280c5a-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-tw5pp\" (UID: \"e8b40e4b-147e-4adb-becb-a35657280c5a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp"
Jul 23 13:08:28.853871 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.853835    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:28.912441 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:28.912358    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:29.043072 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:29.043018    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp"
Jul 23 13:08:29.188724 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:29.188614    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp"]
Jul 23 13:08:29.201765 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:08:29.201739    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b40e4b_147e_4adb_becb_a35657280c5a.slice/crio-df6cee18e9b5c67e99f89d55508700fbbca86ac3f126e0a32b1897fc356fdf0c WatchSource:0}: Error finding container df6cee18e9b5c67e99f89d55508700fbbca86ac3f126e0a32b1897fc356fdf0c: Status 404 returned error can't find the container with id df6cee18e9b5c67e99f89d55508700fbbca86ac3f126e0a32b1897fc356fdf0c
Jul 23 13:08:29.236967 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:29.236942    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:29.674921 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:29.674884    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp" event={"ID":"e8b40e4b-147e-4adb-becb-a35657280c5a","Type":"ContainerStarted","Data":"df6cee18e9b5c67e99f89d55508700fbbca86ac3f126e0a32b1897fc356fdf0c"}
Jul 23 13:08:29.676394 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:29.676366    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-7plkb" event={"ID":"931cd0d5-9891-4d1b-ab11-2379dbaa26f6","Type":"ContainerStarted","Data":"8158a1f1e8f30ac66953fbaa333ead86a66f0713805b3d0e8895ac803f6418d9"}
Jul 23 13:08:29.852003 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:29.851964    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:29.912203 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:29.912160    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:30.047580 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:30.047494    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:30.262956 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:30.262894    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:35.241086 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:35.240769    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:35.362879 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:35.362842    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:35.426572 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:35.426543    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:36.698711 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:36.698670    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g4tt8" event={"ID":"e4158b30-dd08-44a6-95e7-eafb86ff3904","Type":"ContainerStarted","Data":"5d5c9e1ff563500ab15f705070deae9ce1e1537e312200e0e330b0ff517aa33b"}
Jul 23 13:08:36.700342 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:36.700314    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp" event={"ID":"e8b40e4b-147e-4adb-becb-a35657280c5a","Type":"ContainerStarted","Data":"4234ff130b29b1e1f148cf09159c1bc7d55121b2003839428360d16dde597163"}
Jul 23 13:08:36.700485 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:36.700470    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp"
Jul 23 13:08:36.702380 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:36.702354    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smphx" event={"ID":"4c0217f6-c0e4-4c77-955e-5999053d1993","Type":"ContainerStarted","Data":"230daa4b7490f1e2b8856f6268364724c5456f781a739cde00fd31cda3e2517f"}
Jul 23 13:08:36.702486 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:36.702408    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:36.702486 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:36.702432    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smphx" event={"ID":"4c0217f6-c0e4-4c77-955e-5999053d1993","Type":"ContainerStarted","Data":"91bb7362f93ffa51c33bdd1d76970b90471f7d2f34c3bd6b9fda5494a2f2336f"}
Jul 23 13:08:36.704404 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:36.704380    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6wr5w" event={"ID":"625c8f25-814a-438f-bce0-31b507fccd87","Type":"ContainerStarted","Data":"818c56581e9112e2468ff323054bf9841955ca0cda03bd1a8405ae6fe15a4988"}
Jul 23 13:08:36.706300 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:36.706280    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp"
Jul 23 13:08:36.734639 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:36.734567    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-smphx" podStartSLOduration=1.6166941989999999 podStartE2EDuration="9.734545101s" totalImagesPullingTime="8.117850902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:36.73368929 +0000 UTC m=+58.987215169" watchObservedRunningTime="2026-07-23 13:08:36.734545101 +0000 UTC m=+58.988070978"
Jul 23 13:08:36.735103 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:36.735058    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g4tt8" podStartSLOduration=1.624278041 podStartE2EDuration="9.735047378s" totalImagesPullingTime="8.110769337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:36.716698846 +0000 UTC m=+58.970224745" watchObservedRunningTime="2026-07-23 13:08:36.735047378 +0000 UTC m=+58.988573255"
Jul 23 13:08:36.749464 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:36.749424    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-tw5pp" podStartSLOduration=2.246176918 podStartE2EDuration="8.749410894s" totalImagesPullingTime="6.503233976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:36.748963753 +0000 UTC m=+59.002489632" watchObservedRunningTime="2026-07-23 13:08:36.749410894 +0000 UTC m=+59.002936770"
Jul 23 13:08:37.124039 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.123998    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:37.157352 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.157323    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"]
Jul 23 13:08:37.159154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.159139    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.161718 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.161688    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 23 13:08:37.161828 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.161785    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 13:08:37.163291 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.163269    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 13:08:37.163420 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.163344    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9vjkh\""
Jul 23 13:08:37.163420 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.163353    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 13:08:37.163587 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.163566    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 23 13:08:37.173377 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.173316    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"]
Jul 23 13:08:37.203563 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.203494    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:37.234743 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.234703    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbe07adf-0bec-4300-83d6-f8967e0523cb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-xckj6\" (UID: \"fbe07adf-0bec-4300-83d6-f8967e0523cb\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.235156 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.234779    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbe07adf-0bec-4300-83d6-f8967e0523cb-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-xckj6\" (UID: \"fbe07adf-0bec-4300-83d6-f8967e0523cb\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.235156 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.234844    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fbe07adf-0bec-4300-83d6-f8967e0523cb-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-xckj6\" (UID: \"fbe07adf-0bec-4300-83d6-f8967e0523cb\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.235156 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.234893    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnbtt\" (UniqueName: \"kubernetes.io/projected/fbe07adf-0bec-4300-83d6-f8967e0523cb-kube-api-access-cnbtt\") pod \"prometheus-operator-5945b5cfd-xckj6\" (UID: \"fbe07adf-0bec-4300-83d6-f8967e0523cb\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.295629 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.295595    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:37.336227 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.336201    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbe07adf-0bec-4300-83d6-f8967e0523cb-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-xckj6\" (UID: \"fbe07adf-0bec-4300-83d6-f8967e0523cb\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.336343 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.336262    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fbe07adf-0bec-4300-83d6-f8967e0523cb-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-xckj6\" (UID: \"fbe07adf-0bec-4300-83d6-f8967e0523cb\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.336343 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.336285    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnbtt\" (UniqueName: \"kubernetes.io/projected/fbe07adf-0bec-4300-83d6-f8967e0523cb-kube-api-access-cnbtt\") pod \"prometheus-operator-5945b5cfd-xckj6\" (UID: \"fbe07adf-0bec-4300-83d6-f8967e0523cb\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.336343 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.336319    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbe07adf-0bec-4300-83d6-f8967e0523cb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-xckj6\" (UID: \"fbe07adf-0bec-4300-83d6-f8967e0523cb\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.336888 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.336865    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbe07adf-0bec-4300-83d6-f8967e0523cb-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-xckj6\" (UID: \"fbe07adf-0bec-4300-83d6-f8967e0523cb\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.339482 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.339453    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fbe07adf-0bec-4300-83d6-f8967e0523cb-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-xckj6\" (UID: \"fbe07adf-0bec-4300-83d6-f8967e0523cb\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.339482 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.339462    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbe07adf-0bec-4300-83d6-f8967e0523cb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-xckj6\" (UID: \"fbe07adf-0bec-4300-83d6-f8967e0523cb\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.344359 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.344341    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnbtt\" (UniqueName: \"kubernetes.io/projected/fbe07adf-0bec-4300-83d6-f8967e0523cb-kube-api-access-cnbtt\") pod \"prometheus-operator-5945b5cfd-xckj6\" (UID: \"fbe07adf-0bec-4300-83d6-f8967e0523cb\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.468224 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.468193    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"
Jul 23 13:08:37.597755 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.597722    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-xckj6"]
Jul 23 13:08:37.601227 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:08:37.601184    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe07adf_0bec_4300_83d6_f8967e0523cb.slice/crio-46a6cb62d6274055d29e4940f21fd5eb04389327d233f53b678f7bac5c500893 WatchSource:0}: Error finding container 46a6cb62d6274055d29e4940f21fd5eb04389327d233f53b678f7bac5c500893: Status 404 returned error can't find the container with id 46a6cb62d6274055d29e4940f21fd5eb04389327d233f53b678f7bac5c500893
Jul 23 13:08:37.710048 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:37.710009    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6" event={"ID":"fbe07adf-0bec-4300-83d6-f8967e0523cb","Type":"ContainerStarted","Data":"46a6cb62d6274055d29e4940f21fd5eb04389327d233f53b678f7bac5c500893"}
Jul 23 13:08:38.475411 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.474964    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8645bbdf84-8zc7n"]
Jul 23 13:08:38.477035 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.477015    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.480624 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.480390    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 13:08:38.480624 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.480406    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 13:08:38.481464 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.481438    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 13:08:38.481579 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.481475    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mqvzm\""
Jul 23 13:08:38.481652 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.481612    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 13:08:38.481745 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.481727    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 13:08:38.486927 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.486855    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8645bbdf84-8zc7n"]
Jul 23 13:08:38.552320 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.552287    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rztw\" (UniqueName: \"kubernetes.io/projected/2ee7a564-a638-488d-9382-44825d328e1b-kube-api-access-2rztw\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.552500 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.552367    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ee7a564-a638-488d-9382-44825d328e1b-console-serving-cert\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.552500 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.552396    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-service-ca\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.552500 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.552445    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-oauth-serving-cert\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.552500 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.552475    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ee7a564-a638-488d-9382-44825d328e1b-console-oauth-config\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.552723 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.552513    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-console-config\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.653896 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.653860    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rztw\" (UniqueName: \"kubernetes.io/projected/2ee7a564-a638-488d-9382-44825d328e1b-kube-api-access-2rztw\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.654080 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.653943    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ee7a564-a638-488d-9382-44825d328e1b-console-serving-cert\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.654080 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.653970    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-service-ca\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.654080 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.654010    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-oauth-serving-cert\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.654080 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.654037    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ee7a564-a638-488d-9382-44825d328e1b-console-oauth-config\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.655083 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.654435    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-console-config\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.655083 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.654715    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-service-ca\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.655083 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.654808    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-oauth-serving-cert\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.655083 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.655031    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-console-config\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.658530 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.658505    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ee7a564-a638-488d-9382-44825d328e1b-console-oauth-config\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.659111 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.659088    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ee7a564-a638-488d-9382-44825d328e1b-console-serving-cert\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.664024 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.663964    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rztw\" (UniqueName: \"kubernetes.io/projected/2ee7a564-a638-488d-9382-44825d328e1b-kube-api-access-2rztw\") pod \"console-8645bbdf84-8zc7n\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") " pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:38.792805 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:38.792713    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:08:39.287098 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:39.287054    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:39.613863 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:39.613797    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b5frq"
Jul 23 13:08:39.773612 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:39.773573    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:39.834472 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:39.834437    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:40.667773 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.667740    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c8dfdbfc5-4zttj"]
Jul 23 13:08:40.674119 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.674096    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:40.687965 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.687914    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8dfdbfc5-4zttj"]
Jul 23 13:08:40.688072 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.688023    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.696483 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.696465    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 13:08:40.729739 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.729718    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:40.772800 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.772775    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-oauth-config\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.772944 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.772805    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6vbx\" (UniqueName: \"kubernetes.io/projected/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-kube-api-access-n6vbx\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.772944 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.772830    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-oauth-serving-cert\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.772944 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.772848    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-serving-cert\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.772944 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.772863    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-trusted-ca-bundle\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.773102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.773051    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-service-ca\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.773102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.773074    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-config\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.874345 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.874305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-service-ca\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.874834 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.874372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-config\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.874834 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.874426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-oauth-config\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.874834 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.874451    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6vbx\" (UniqueName: \"kubernetes.io/projected/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-kube-api-access-n6vbx\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.874834 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.874495    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-oauth-serving-cert\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.874834 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.874527    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-serving-cert\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.874834 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.874553    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-trusted-ca-bundle\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.875161 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.875109    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-service-ca\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.875269 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.875248    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-oauth-serving-cert\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.875348 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.875329    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-config\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.875428 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.875408    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-trusted-ca-bundle\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.877093 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.877076    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-oauth-config\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.877262 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.877241    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-serving-cert\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.883081 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.883061    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6vbx\" (UniqueName: \"kubernetes.io/projected/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-kube-api-access-n6vbx\") pod \"console-5c8dfdbfc5-4zttj\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") " pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:40.997374 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:40.997338    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:08:41.407284 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:41.407206    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:41.460219 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:41.460187    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:43.862767 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:43.862724    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:43.915595 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:43.915561    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:44.005035 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.004977    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:44.007943 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.007884    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 13:08:44.018405 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.018381    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/032fa58a-197e-4083-85ba-30d5df17374b-original-pull-secret\") pod \"global-pull-secret-syncer-fjq2l\" (UID: \"032fa58a-197e-4083-85ba-30d5df17374b\") " pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:44.105907 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.105872    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djzvh\" (UniqueName: \"kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh\") pod \"network-check-target-8fhm9\" (UID: \"d6b2cd0e-6146-4b02-bc7c-dcaa305e5702\") " pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:44.106075 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.105911    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs\") pod \"network-metrics-daemon-khpmp\" (UID: \"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b\") " pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:44.108793 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.108773    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 13:08:44.108902 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.108802    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 13:08:44.119296 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.119242    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b-metrics-certs\") pod \"network-metrics-daemon-khpmp\" (UID: \"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b\") " pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:44.119703 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.119679    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 13:08:44.130100 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.130076    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djzvh\" (UniqueName: \"kubernetes.io/projected/d6b2cd0e-6146-4b02-bc7c-dcaa305e5702-kube-api-access-djzvh\") pod \"network-check-target-8fhm9\" (UID: \"d6b2cd0e-6146-4b02-bc7c-dcaa305e5702\") " pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:44.270945 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.270911    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z5gct\""
Jul 23 13:08:44.279000 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.278966    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khpmp"
Jul 23 13:08:44.282524 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.282500    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjq2l"
Jul 23 13:08:44.292875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.292861    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xq2s8\""
Jul 23 13:08:44.301017 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.301000    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:08:44.818922 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.818889    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:44.884961 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.884924    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:44.945797 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:44.945762    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:46.712733 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:46.712704    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-smphx"
Jul 23 13:08:47.448920 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:47.448883    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:47.554584 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:47.554548    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:47.656221 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:47.656193    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:48.801867 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:48.801841    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8645bbdf84-8zc7n"]
Jul 23 13:08:48.859374 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:08:48.859342    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee7a564_a638_488d_9382_44825d328e1b.slice/crio-bd67a36a43cf6b74486dad762726f9974179c994f77ae57439090e8a275a3d56 WatchSource:0}: Error finding container bd67a36a43cf6b74486dad762726f9974179c994f77ae57439090e8a275a3d56: Status 404 returned error can't find the container with id bd67a36a43cf6b74486dad762726f9974179c994f77ae57439090e8a275a3d56
Jul 23 13:08:48.890683 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:48.890654    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:48.999918 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:48.999726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:49.035790 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.035761    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-khpmp"]
Jul 23 13:08:49.039469 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:08:49.039429    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d54b8c8_3505_47fb_8dc9_8fbe86fe5a0b.slice/crio-df3306f679693ce5a3086d5174dc6c745669955006abb271dfc8fbc0a78d12fb WatchSource:0}: Error finding container df3306f679693ce5a3086d5174dc6c745669955006abb271dfc8fbc0a78d12fb: Status 404 returned error can't find the container with id df3306f679693ce5a3086d5174dc6c745669955006abb271dfc8fbc0a78d12fb
Jul 23 13:08:49.098900 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.098855    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:49.220374 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.220343    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:49.263649 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.263578    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjq2l"]
Jul 23 13:08:49.268178 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.267973    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8fhm9"]
Jul 23 13:08:49.268178 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:08:49.268042    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032fa58a_197e_4083_85ba_30d5df17374b.slice/crio-8d84d5063319a759450af4b2e81bdcf59303e183371b047d0e323dc343e4c599 WatchSource:0}: Error finding container 8d84d5063319a759450af4b2e81bdcf59303e183371b047d0e323dc343e4c599: Status 404 returned error can't find the container with id 8d84d5063319a759450af4b2e81bdcf59303e183371b047d0e323dc343e4c599
Jul 23 13:08:49.269307 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.269126    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8dfdbfc5-4zttj"]
Jul 23 13:08:49.270540 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:08:49.270519    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf90c6ae_6182_4c49_8f7f_721ec5e2bc0a.slice/crio-0cc46d77a77c162d09b4a741a5b2289711fd0b364c3bfa19e6d95478f795d07d WatchSource:0}: Error finding container 0cc46d77a77c162d09b4a741a5b2289711fd0b364c3bfa19e6d95478f795d07d: Status 404 returned error can't find the container with id 0cc46d77a77c162d09b4a741a5b2289711fd0b364c3bfa19e6d95478f795d07d
Jul 23 13:08:49.271460 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:08:49.271432    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b2cd0e_6146_4b02_bc7c_dcaa305e5702.slice/crio-e7d507d3c195448e989f03d43fbd0bf3be01b362c5c949568181d4c7e71d2263 WatchSource:0}: Error finding container e7d507d3c195448e989f03d43fbd0bf3be01b362c5c949568181d4c7e71d2263: Status 404 returned error can't find the container with id e7d507d3c195448e989f03d43fbd0bf3be01b362c5c949568181d4c7e71d2263
Jul 23 13:08:49.750363 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.750286    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8645bbdf84-8zc7n" event={"ID":"2ee7a564-a638-488d-9382-44825d328e1b","Type":"ContainerStarted","Data":"bd67a36a43cf6b74486dad762726f9974179c994f77ae57439090e8a275a3d56"}
Jul 23 13:08:49.753865 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.753829    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6wr5w" event={"ID":"625c8f25-814a-438f-bce0-31b507fccd87","Type":"ContainerStarted","Data":"00bc55c97814d4cdad9ad365cc34e11b5906bf145132c1fba7f2c5047cbb68eb"}
Jul 23 13:08:49.757487 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.757462    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8fhm9" event={"ID":"d6b2cd0e-6146-4b02-bc7c-dcaa305e5702","Type":"ContainerStarted","Data":"e7d507d3c195448e989f03d43fbd0bf3be01b362c5c949568181d4c7e71d2263"}
Jul 23 13:08:49.759548 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.759525    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjq2l" event={"ID":"032fa58a-197e-4083-85ba-30d5df17374b","Type":"ContainerStarted","Data":"8d84d5063319a759450af4b2e81bdcf59303e183371b047d0e323dc343e4c599"}
Jul 23 13:08:49.762049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.762026    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dfdbfc5-4zttj" event={"ID":"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a","Type":"ContainerStarted","Data":"0cc46d77a77c162d09b4a741a5b2289711fd0b364c3bfa19e6d95478f795d07d"}
Jul 23 13:08:49.775765 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.775739    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-7plkb" event={"ID":"931cd0d5-9891-4d1b-ab11-2379dbaa26f6","Type":"ContainerStarted","Data":"45e6188c3d57da48b1b6feb1255274e6c3b43401e13a906e74c4791b1131a55d"}
Jul 23 13:08:49.778440 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.778258    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-7plkb"
Jul 23 13:08:49.787608 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.787582    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6" event={"ID":"fbe07adf-0bec-4300-83d6-f8967e0523cb","Type":"ContainerStarted","Data":"469b8460db5be94b0f0d0caea4a66f653675cf1c4e9d4fee27d74de8be8ffee5"}
Jul 23 13:08:49.787764 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.787634    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6" event={"ID":"fbe07adf-0bec-4300-83d6-f8967e0523cb","Type":"ContainerStarted","Data":"eb06bb4113d48d83f604559072e8965dda83222858a294c3a4d9d395f8a592c9"}
Jul 23 13:08:49.788245 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.788201    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-7plkb"
Jul 23 13:08:49.793957 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.793891    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-khpmp" event={"ID":"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b","Type":"ContainerStarted","Data":"df3306f679693ce5a3086d5174dc6c745669955006abb271dfc8fbc0a78d12fb"}
Jul 23 13:08:49.794814 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.794769    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-7plkb" podStartSLOduration=1.627815226 podStartE2EDuration="21.794752075s" totalImagesPullingTime="20.166936849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:49.794207285 +0000 UTC m=+72.047733162" watchObservedRunningTime="2026-07-23 13:08:49.794752075 +0000 UTC m=+72.048277951"
Jul 23 13:08:49.811713 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.811655    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-xckj6" podStartSLOduration=1.621033428 podStartE2EDuration="12.811634945s" totalImagesPullingTime="11.190601517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:49.810425945 +0000 UTC m=+72.063951822" watchObservedRunningTime="2026-07-23 13:08:49.811634945 +0000 UTC m=+72.065160823"
Jul 23 13:08:49.944313 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:49.944222    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:50.045887 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:50.045652    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:50.145347 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:50.144914    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:50.205430 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:50.205395    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:51.079906 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.079866    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:51.133529 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.133455    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:51.257354 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.257239    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:51.489352 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.489314    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:51.506019 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.505363    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"]
Jul 23 13:08:51.554951 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.554916    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"]
Jul 23 13:08:51.555146 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.554996    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s7n47"]
Jul 23 13:08:51.555146 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.555053    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.559484 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.559461    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 23 13:08:51.559716 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.559701    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rx5bz\""
Jul 23 13:08:51.559941 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.559912    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 23 13:08:51.581020 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.580395    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.583702 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.583680    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 13:08:51.583921 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.583904    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 13:08:51.584229 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.584212    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 13:08:51.584694 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.584676    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wkhqp\""
Jul 23 13:08:51.599601 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.599537    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:51.669817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.669240    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1884e00-d728-431e-8a30-6c5881fdc038-metrics-client-ca\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.669817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.669300    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-tls\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.669817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.669336    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5096af1-c393-43a6-adf3-a92f937d6f53-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-hk9bv\" (UID: \"e5096af1-c393-43a6-adf3-a92f937d6f53\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.669817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.669365    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpxbn\" (UniqueName: \"kubernetes.io/projected/e5096af1-c393-43a6-adf3-a92f937d6f53-kube-api-access-kpxbn\") pod \"openshift-state-metrics-79f6958cdf-hk9bv\" (UID: \"e5096af1-c393-43a6-adf3-a92f937d6f53\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.669817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.669393    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxx98\" (UniqueName: \"kubernetes.io/projected/d1884e00-d728-431e-8a30-6c5881fdc038-kube-api-access-bxx98\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.669817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.669431    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d1884e00-d728-431e-8a30-6c5881fdc038-root\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.669817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.669454    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.669817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.669478    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-textfile\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.669817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.669518    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5096af1-c393-43a6-adf3-a92f937d6f53-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-hk9bv\" (UID: \"e5096af1-c393-43a6-adf3-a92f937d6f53\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.669817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.669544    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-wtmp\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.669817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.669573    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-accelerators-collector-config\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.669817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.669626    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1884e00-d728-431e-8a30-6c5881fdc038-sys\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.669817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.669652    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5096af1-c393-43a6-adf3-a92f937d6f53-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-hk9bv\" (UID: \"e5096af1-c393-43a6-adf3-a92f937d6f53\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.691852 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.691790    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:51.780052 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.779934    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1884e00-d728-431e-8a30-6c5881fdc038-sys\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.781708 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.776616    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1884e00-d728-431e-8a30-6c5881fdc038-sys\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.782092 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.782062    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5096af1-c393-43a6-adf3-a92f937d6f53-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-hk9bv\" (UID: \"e5096af1-c393-43a6-adf3-a92f937d6f53\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.782170 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.782116    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1884e00-d728-431e-8a30-6c5881fdc038-metrics-client-ca\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.782170 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.782152    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-tls\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.782273 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.782184    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5096af1-c393-43a6-adf3-a92f937d6f53-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-hk9bv\" (UID: \"e5096af1-c393-43a6-adf3-a92f937d6f53\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.782273 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.782211    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxbn\" (UniqueName: \"kubernetes.io/projected/e5096af1-c393-43a6-adf3-a92f937d6f53-kube-api-access-kpxbn\") pod \"openshift-state-metrics-79f6958cdf-hk9bv\" (UID: \"e5096af1-c393-43a6-adf3-a92f937d6f53\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.782273 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.782241    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxx98\" (UniqueName: \"kubernetes.io/projected/d1884e00-d728-431e-8a30-6c5881fdc038-kube-api-access-bxx98\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.782416 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.782277    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d1884e00-d728-431e-8a30-6c5881fdc038-root\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.782416 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.782303    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.782416 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.782326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-textfile\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.782416 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.782363    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5096af1-c393-43a6-adf3-a92f937d6f53-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-hk9bv\" (UID: \"e5096af1-c393-43a6-adf3-a92f937d6f53\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.782416 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.782387    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-wtmp\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.782650 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.782418    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-accelerators-collector-config\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.785802 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.783040    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-accelerators-collector-config\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.785802 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.784144    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1884e00-d728-431e-8a30-6c5881fdc038-metrics-client-ca\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.785802 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.785106    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5096af1-c393-43a6-adf3-a92f937d6f53-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-hk9bv\" (UID: \"e5096af1-c393-43a6-adf3-a92f937d6f53\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.785802 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.785173    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d1884e00-d728-431e-8a30-6c5881fdc038-root\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.785802 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.785284    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-textfile\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.785802 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.785710    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-wtmp\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.791306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.791260    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.791306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.791268    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5096af1-c393-43a6-adf3-a92f937d6f53-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-hk9bv\" (UID: \"e5096af1-c393-43a6-adf3-a92f937d6f53\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.799661 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.799583    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:51.800464 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.800300    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpxbn\" (UniqueName: \"kubernetes.io/projected/e5096af1-c393-43a6-adf3-a92f937d6f53-kube-api-access-kpxbn\") pod \"openshift-state-metrics-79f6958cdf-hk9bv\" (UID: \"e5096af1-c393-43a6-adf3-a92f937d6f53\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.800464 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.800317    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5096af1-c393-43a6-adf3-a92f937d6f53-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-hk9bv\" (UID: \"e5096af1-c393-43a6-adf3-a92f937d6f53\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.801956 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.801913    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxx98\" (UniqueName: \"kubernetes.io/projected/d1884e00-d728-431e-8a30-6c5881fdc038-kube-api-access-bxx98\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.804216 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.804175    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d1884e00-d728-431e-8a30-6c5881fdc038-node-exporter-tls\") pod \"node-exporter-s7n47\" (UID: \"d1884e00-d728-431e-8a30-6c5881fdc038\") " pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:51.872474 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.872241    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"
Jul 23 13:08:51.891457 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.891350    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:51.898364 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:51.898174    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s7n47"
Jul 23 13:08:52.001502 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.001455    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:52.103208 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:08:52.102739    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1884e00_d728_431e_8a30_6c5881fdc038.slice/crio-a404fa3211c01a5257b7a89e15fdbfd7b666d503eae1a420e1a7c6f1f836dc21 WatchSource:0}: Error finding container a404fa3211c01a5257b7a89e15fdbfd7b666d503eae1a420e1a7c6f1f836dc21: Status 404 returned error can't find the container with id a404fa3211c01a5257b7a89e15fdbfd7b666d503eae1a420e1a7c6f1f836dc21
Jul 23 13:08:52.103208 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.103141    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:52.303435 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.303352    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv"]
Jul 23 13:08:52.310860 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:08:52.310105    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5096af1_c393_43a6_adf3_a92f937d6f53.slice/crio-be30e45dfa226c963d280aa97e738727c112b105b27904c948dfa06801e6d2c0 WatchSource:0}: Error finding container be30e45dfa226c963d280aa97e738727c112b105b27904c948dfa06801e6d2c0: Status 404 returned error can't find the container with id be30e45dfa226c963d280aa97e738727c112b105b27904c948dfa06801e6d2c0
Jul 23 13:08:52.492096 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.488198    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:52.587462 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.587115    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:52.805722 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.805658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:52.823869 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.823795    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7n47" event={"ID":"d1884e00-d728-431e-8a30-6c5881fdc038","Type":"ContainerStarted","Data":"a404fa3211c01a5257b7a89e15fdbfd7b666d503eae1a420e1a7c6f1f836dc21"}
Jul 23 13:08:52.826963 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.826822    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv" event={"ID":"e5096af1-c393-43a6-adf3-a92f937d6f53","Type":"ContainerStarted","Data":"8cf0196756a35251d356249b234bc48b578a7d3a021c901c3808b4990b3fbfed"}
Jul 23 13:08:52.826963 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.826880    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv" event={"ID":"e5096af1-c393-43a6-adf3-a92f937d6f53","Type":"ContainerStarted","Data":"f72e5eff2e3a84d6a1a97ae1427ee44b8b3dcf4b8ba1f808bf8b88098cf82e02"}
Jul 23 13:08:52.826963 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.826910    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv" event={"ID":"e5096af1-c393-43a6-adf3-a92f937d6f53","Type":"ContainerStarted","Data":"be30e45dfa226c963d280aa97e738727c112b105b27904c948dfa06801e6d2c0"}
Jul 23 13:08:52.830843 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.830816    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-khpmp" event={"ID":"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b","Type":"ContainerStarted","Data":"68901b5c23c7a0ec914b0af59f07c3faf9fb7533b56890f61d7ce3a6d1a803fd"}
Jul 23 13:08:52.830971 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.830867    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-khpmp" event={"ID":"1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b","Type":"ContainerStarted","Data":"e4eef2aee5bfab08a54e4151421bdc3c24e1d5236cea0273073a6da5bcb3e5e6"}
Jul 23 13:08:52.852144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.851696    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-khpmp" podStartSLOduration=70.801305434 podStartE2EDuration="1m13.851676167s" totalImagesPullingTime="3.050370733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:52.850416666 +0000 UTC m=+75.103942543" watchObservedRunningTime="2026-07-23 13:08:52.851676167 +0000 UTC m=+75.105202044"
Jul 23 13:08:52.903766 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:52.903634    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:53.003881 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:53.003818    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:53.069676 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:53.069340    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:54.497834 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:54.497780    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:54.600241 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:54.600196    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:54.696530 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:54.696495    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:54.802442 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:54.802363    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:56.050057 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.050020    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85f599cb85-6vgrh"]
Jul 23 13:08:56.069412 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.069378    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85f599cb85-6vgrh"]
Jul 23 13:08:56.069589 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.069423    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.073539 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.073173    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 23 13:08:56.073539 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.073177    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vv2h5\""
Jul 23 13:08:56.073539 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.073315    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 23 13:08:56.073539 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.073397    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9mbcltrs5k1th\""
Jul 23 13:08:56.073539 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.073438    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 23 13:08:56.073539 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.073522    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 23 13:08:56.131912 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.131884    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3b056adf-1054-49ec-9e35-d9c23f57b09a-secret-metrics-server-tls\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.132084 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.131917    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3b056adf-1054-49ec-9e35-d9c23f57b09a-secret-metrics-server-client-certs\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.132084 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.131936    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b056adf-1054-49ec-9e35-d9c23f57b09a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.132084 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.131959    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b056adf-1054-49ec-9e35-d9c23f57b09a-client-ca-bundle\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.132084 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.132066    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dff76\" (UniqueName: \"kubernetes.io/projected/3b056adf-1054-49ec-9e35-d9c23f57b09a-kube-api-access-dff76\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.132231 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.132100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3b056adf-1054-49ec-9e35-d9c23f57b09a-metrics-server-audit-profiles\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.132231 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.132126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3b056adf-1054-49ec-9e35-d9c23f57b09a-audit-log\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.233363 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.233309    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3b056adf-1054-49ec-9e35-d9c23f57b09a-metrics-server-audit-profiles\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.233525 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.233371    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3b056adf-1054-49ec-9e35-d9c23f57b09a-audit-log\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.233525 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.233441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3b056adf-1054-49ec-9e35-d9c23f57b09a-secret-metrics-server-tls\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.233525 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.233461    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3b056adf-1054-49ec-9e35-d9c23f57b09a-secret-metrics-server-client-certs\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.233525 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.233485    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b056adf-1054-49ec-9e35-d9c23f57b09a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.233525 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.233504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b056adf-1054-49ec-9e35-d9c23f57b09a-client-ca-bundle\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.233778 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.233548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dff76\" (UniqueName: \"kubernetes.io/projected/3b056adf-1054-49ec-9e35-d9c23f57b09a-kube-api-access-dff76\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.233844 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.233787    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3b056adf-1054-49ec-9e35-d9c23f57b09a-audit-log\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.234232 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.234209    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b056adf-1054-49ec-9e35-d9c23f57b09a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.234584 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.234559    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3b056adf-1054-49ec-9e35-d9c23f57b09a-metrics-server-audit-profiles\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.235945 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.235921    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b056adf-1054-49ec-9e35-d9c23f57b09a-client-ca-bundle\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.236064 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.235976    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3b056adf-1054-49ec-9e35-d9c23f57b09a-secret-metrics-server-tls\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.236064 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.235975    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3b056adf-1054-49ec-9e35-d9c23f57b09a-secret-metrics-server-client-certs\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.250259 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.250236    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dff76\" (UniqueName: \"kubernetes.io/projected/3b056adf-1054-49ec-9e35-d9c23f57b09a-kube-api-access-dff76\") pod \"metrics-server-85f599cb85-6vgrh\" (UID: \"3b056adf-1054-49ec-9e35-d9c23f57b09a\") " pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.357489 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.357411    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:56.380796 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.380766    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:08:56.435477 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.435431    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:56.530766 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.530732    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:56.635520 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.635444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:56.687091 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:56.687058    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8645bbdf84-8zc7n"]
Jul 23 13:08:57.081296 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.081244    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:57.179474 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.179445    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:57.762026 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.761975    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:08:57.774515 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.774460    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:57.793671 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.793643    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:08:57.793845 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.793827    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.797864 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.796832    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 13:08:57.797864 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.797164    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 13:08:57.797864 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.797475    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 13:08:57.797864 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.797732    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 13:08:57.798169 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.797876    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 13:08:57.798169 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.797908    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 13:08:57.798478 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.798453    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-clgb7\""
Jul 23 13:08:57.798615 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.798594    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 13:08:57.798723 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.798662    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 13:08:57.798723 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.798601    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 13:08:57.798825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.798601    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8ad68lnhegn68\""
Jul 23 13:08:57.799284 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.799185    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 13:08:57.799454 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.799439    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 13:08:57.800321 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.800306    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 13:08:57.800823 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.800804    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 13:08:57.804275 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.804255    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 13:08:57.846037 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.845971    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846037 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846033    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846251 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846080    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42pnh\" (UniqueName: \"kubernetes.io/projected/0e4b79cb-f340-445b-8470-88de37b68188-kube-api-access-42pnh\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846251 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846144    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-config\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846251 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846187    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e4b79cb-f340-445b-8470-88de37b68188-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846251 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846224    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846251 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846249    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846502 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846272    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846502 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846294    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846502 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846323    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846502 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846351    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846502 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846401    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846502 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846426    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846502 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846475    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846802 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846507    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846802 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846802 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846590    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846802 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846617    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e4b79cb-f340-445b-8470-88de37b68188-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846802 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846644    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.846802 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.846672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947122 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947089    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e4b79cb-f340-445b-8470-88de37b68188-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947294 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947135    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947294 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947162    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947294 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947187    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947294 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947294 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947243    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947294 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947272    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947312    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947338    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947365    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947388    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947461    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947489    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e4b79cb-f340-445b-8470-88de37b68188-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947531    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947566    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.947622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947615    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.948134 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947647    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.948134 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947671    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42pnh\" (UniqueName: \"kubernetes.io/projected/0e4b79cb-f340-445b-8470-88de37b68188-kube-api-access-42pnh\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.948134 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947703    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-config\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.948134 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.947867    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.950570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.948569    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.950570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.949323    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.950570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.950127    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.951111 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.951087    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.951718 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.951693    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.951896 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.951874    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-config\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.952089 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.952067    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.952364 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.952341    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e4b79cb-f340-445b-8470-88de37b68188-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.952978 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.952951    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.953537 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.953515    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.954890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.953938    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.954890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.954366    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.954890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.954845    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.955167 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.955063    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.955468 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.955445    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.955675 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.955649    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.957300 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.957276    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e4b79cb-f340-445b-8470-88de37b68188-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.957965 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.957934    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:57.959298 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:57.959278    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42pnh\" (UniqueName: \"kubernetes.io/projected/0e4b79cb-f340-445b-8470-88de37b68188-kube-api-access-42pnh\") pod \"prometheus-k8s-0\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:58.106066 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:58.105972    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:08:58.890633 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:58.890593    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:58.991492 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:08:58.991461    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:00.093079 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:00.092948    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:00.150905 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:00.150866    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:03.350641 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.350426    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85f599cb85-6vgrh"]
Jul 23 13:09:03.354447 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:09:03.353647    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b056adf_1054_49ec_9e35_d9c23f57b09a.slice/crio-6a41cb7f5ce063ff2762f0f87bfc5e6446d1dc8ca4078f119a602e090250fbcd WatchSource:0}: Error finding container 6a41cb7f5ce063ff2762f0f87bfc5e6446d1dc8ca4078f119a602e090250fbcd: Status 404 returned error can't find the container with id 6a41cb7f5ce063ff2762f0f87bfc5e6446d1dc8ca4078f119a602e090250fbcd
Jul 23 13:09:03.385957 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.385935    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:09:03.389880 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:09:03.389822    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4b79cb_f340_445b_8470_88de37b68188.slice/crio-0ef4d5a21c2a3f235aa88311f201cab5e70069d16cf7aa6af5271ae440c994d7 WatchSource:0}: Error finding container 0ef4d5a21c2a3f235aa88311f201cab5e70069d16cf7aa6af5271ae440c994d7: Status 404 returned error can't find the container with id 0ef4d5a21c2a3f235aa88311f201cab5e70069d16cf7aa6af5271ae440c994d7
Jul 23 13:09:03.881836 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.881793    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8645bbdf84-8zc7n" event={"ID":"2ee7a564-a638-488d-9382-44825d328e1b","Type":"ContainerStarted","Data":"4dfc5e0eb1b4eb78fd5362e42610c543ac0c536541a1a67eae7a2a3ac36cb474"}
Jul 23 13:09:03.883048 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.883014    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerStarted","Data":"0ef4d5a21c2a3f235aa88311f201cab5e70069d16cf7aa6af5271ae440c994d7"}
Jul 23 13:09:03.884924 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.884902    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6wr5w" event={"ID":"625c8f25-814a-438f-bce0-31b507fccd87","Type":"ContainerStarted","Data":"5de8a70c317d2c6c4267649977eefb7f64f98037450ad168d31bfe5759640e40"}
Jul 23 13:09:03.886456 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.886436    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8fhm9" event={"ID":"d6b2cd0e-6146-4b02-bc7c-dcaa305e5702","Type":"ContainerStarted","Data":"8b9962da5e27918505596a2e007202ad45ae30fcce35d3eda65ab6a804e84a3a"}
Jul 23 13:09:03.886573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.886559    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:09:03.887673 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.887650    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh" event={"ID":"3b056adf-1054-49ec-9e35-d9c23f57b09a","Type":"ContainerStarted","Data":"6a41cb7f5ce063ff2762f0f87bfc5e6446d1dc8ca4078f119a602e090250fbcd"}
Jul 23 13:09:03.888863 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.888846    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjq2l" event={"ID":"032fa58a-197e-4083-85ba-30d5df17374b","Type":"ContainerStarted","Data":"bd3de30088c59a9c1ea5ce2da9c5bba7bb709a478857addaaa197a194444b13d"}
Jul 23 13:09:03.890395 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.890374    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dfdbfc5-4zttj" event={"ID":"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a","Type":"ContainerStarted","Data":"fa2d67394c202680660f0c1a05a36438f2a1f2a07e3d2781493267aa81c1a5d4"}
Jul 23 13:09:03.892348 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.892327    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv" event={"ID":"e5096af1-c393-43a6-adf3-a92f937d6f53","Type":"ContainerStarted","Data":"78b192c661bc09f4e89908b68b7e5360572b633ae2898cd05af2149f32b878a5"}
Jul 23 13:09:03.893862 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.893843    2570 generic.go:356] "Generic (PLEG): container finished" podID="d1884e00-d728-431e-8a30-6c5881fdc038" containerID="5698ced6a99ccfb925fd88962f31169d094391a7e735e7c9589cad40e250d195" exitCode=0
Jul 23 13:09:03.893958 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.893875    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7n47" event={"ID":"d1884e00-d728-431e-8a30-6c5881fdc038","Type":"ContainerDied","Data":"5698ced6a99ccfb925fd88962f31169d094391a7e735e7c9589cad40e250d195"}
Jul 23 13:09:03.901421 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.901378    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8645bbdf84-8zc7n" podStartSLOduration=11.575237886 podStartE2EDuration="25.901365344s" totalImagesPullingTime="14.326127458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:09:03.900560773 +0000 UTC m=+86.154086644" watchObservedRunningTime="2026-07-23 13:09:03.901365344 +0000 UTC m=+86.154891219"
Jul 23 13:09:03.919206 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.919172    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6wr5w" podStartSLOduration=1.551070781 podStartE2EDuration="36.919162782s" totalImagesPullingTime="35.368092001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:08:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:09:03.918834672 +0000 UTC m=+86.172360548" watchObservedRunningTime="2026-07-23 13:09:03.919162782 +0000 UTC m=+86.172688658"
Jul 23 13:09:03.935623 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.935581    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8fhm9" podStartSLOduration=71.022197409 podStartE2EDuration="1m24.93556662s" totalImagesPullingTime="13.913369211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:09:03.935222872 +0000 UTC m=+86.188748748" watchObservedRunningTime="2026-07-23 13:09:03.93556662 +0000 UTC m=+86.189092497"
Jul 23 13:09:03.952809 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.952770    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c8dfdbfc5-4zttj" podStartSLOduration=10.029206519 podStartE2EDuration="23.952756573s" totalImagesPullingTime="13.923550054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:09:03.952194952 +0000 UTC m=+86.205720830" watchObservedRunningTime="2026-07-23 13:09:03.952756573 +0000 UTC m=+86.206282429"
Jul 23 13:09:03.969867 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:03.969834    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hk9bv" podStartSLOduration=2.507227026 podStartE2EDuration="12.96982123s" totalImagesPullingTime="10.462594204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:09:03.969061293 +0000 UTC m=+86.222587169" watchObservedRunningTime="2026-07-23 13:09:03.96982123 +0000 UTC m=+86.223347106"
Jul 23 13:09:04.009477 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:04.009434    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fjq2l" podStartSLOduration=71.088228672 podStartE2EDuration="1m25.009418416s" totalImagesPullingTime="13.921189744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:09:04.007972733 +0000 UTC m=+86.261498603" watchObservedRunningTime="2026-07-23 13:09:04.009418416 +0000 UTC m=+86.262944293"
Jul 23 13:09:04.899695 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:04.899652    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7n47" event={"ID":"d1884e00-d728-431e-8a30-6c5881fdc038","Type":"ContainerStarted","Data":"40c04cd79ed399341ff205d6414f184ae3ae1ee2a3bb992c98c2d81e054760aa"}
Jul 23 13:09:04.900152 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:04.899719    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7n47" event={"ID":"d1884e00-d728-431e-8a30-6c5881fdc038","Type":"ContainerStarted","Data":"133acc58c93bbe4f4ad11b92ce9de234aece2a66958fb6073388cc33258cee1f"}
Jul 23 13:09:04.921995 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:04.921934    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s7n47" podStartSLOduration=2.751357423 podStartE2EDuration="13.921913562s" totalImagesPullingTime="11.079631254s" totalInitContainerRuntime="90.924885ms" isStatefulPod=true podCreationTimestamp="2026-07-23 13:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:09:04.920755027 +0000 UTC m=+87.174280903" watchObservedRunningTime="2026-07-23 13:09:04.921913562 +0000 UTC m=+87.175439443"
Jul 23 13:09:05.909026 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:05.908975    2570 generic.go:356] "Generic (PLEG): container finished" podID="0e4b79cb-f340-445b-8470-88de37b68188" containerID="49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4" exitCode=0
Jul 23 13:09:05.909026 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:05.909014    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerDied","Data":"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"}
Jul 23 13:09:07.918944 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:07.918864    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh" event={"ID":"3b056adf-1054-49ec-9e35-d9c23f57b09a","Type":"ContainerStarted","Data":"dbf45821870aebfab2824c1ff30e57b5a5e38de1f99008f8c9fef2a3437fc05c"}
Jul 23 13:09:07.938234 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:07.938190    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh" podStartSLOduration=7.693985162 podStartE2EDuration="11.938174672s" totalImagesPullingTime="4.24418951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:09:07.937609249 +0000 UTC m=+90.191135127" watchObservedRunningTime="2026-07-23 13:09:07.938174672 +0000 UTC m=+90.191700584"
Jul 23 13:09:08.005290 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:08.005262    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8dfdbfc5-4zttj"]
Jul 23 13:09:08.156167 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:08.156129    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:08.261297 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:08.261246    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:08.356960 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:08.356912    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:08.794139 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:08.794099    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:09:09.930873 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:09.930790    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerStarted","Data":"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"}
Jul 23 13:09:09.930873 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:09.930856    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerStarted","Data":"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"}
Jul 23 13:09:10.997467 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:10.997436    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:09:11.168513 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:11.168479    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:11.496414 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:11.496379    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85f599cb85-6vgrh_3b056adf-1054-49ec-9e35-d9c23f57b09a/metrics-server/0.log"
Jul 23 13:09:12.495592 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:12.495571    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7n47_d1884e00-d728-431e-8a30-6c5881fdc038/init-textfile/0.log"
Jul 23 13:09:12.696390 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:12.696316    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7n47_d1884e00-d728-431e-8a30-6c5881fdc038/node-exporter/0.log"
Jul 23 13:09:12.897002 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:12.896962    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7n47_d1884e00-d728-431e-8a30-6c5881fdc038/kube-rbac-proxy/0.log"
Jul 23 13:09:12.944623 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:12.944594    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerStarted","Data":"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"}
Jul 23 13:09:12.944800 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:12.944715    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerStarted","Data":"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"}
Jul 23 13:09:12.944800 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:12.944757    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerStarted","Data":"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"}
Jul 23 13:09:12.944800 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:12.944794    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerStarted","Data":"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"}
Jul 23 13:09:12.974440 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:12.974391    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.445630211 podStartE2EDuration="15.974376364s" totalImagesPullingTime="7.509287335s" totalInitContainerRuntime="19.458818ms" isStatefulPod=false podCreationTimestamp="2026-07-23 13:08:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:09:12.972033454 +0000 UTC m=+95.225559332" watchObservedRunningTime="2026-07-23 13:09:12.974376364 +0000 UTC m=+95.227902239"
Jul 23 13:09:13.107166 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:13.107136    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:09:13.696259 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:13.696230    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-hk9bv_e5096af1-c393-43a6-adf3-a92f937d6f53/kube-rbac-proxy-main/0.log"
Jul 23 13:09:13.783772 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:13.783747    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:13.884000 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:13.883953    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:13.894691 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:13.894670    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-hk9bv_e5096af1-c393-43a6-adf3-a92f937d6f53/kube-rbac-proxy-self/0.log"
Jul 23 13:09:13.942062 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:13.942038    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:14.096422 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:14.096394    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-hk9bv_e5096af1-c393-43a6-adf3-a92f937d6f53/openshift-state-metrics/0.log"
Jul 23 13:09:14.298963 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:14.298939    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e4b79cb-f340-445b-8470-88de37b68188/init-config-reloader/0.log"
Jul 23 13:09:14.497282 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:14.497262    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e4b79cb-f340-445b-8470-88de37b68188/prometheus/0.log"
Jul 23 13:09:14.700430 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:14.700405    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e4b79cb-f340-445b-8470-88de37b68188/config-reloader/0.log"
Jul 23 13:09:14.895766 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:14.895702    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e4b79cb-f340-445b-8470-88de37b68188/thanos-sidecar/0.log"
Jul 23 13:09:15.097420 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:15.097395    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e4b79cb-f340-445b-8470-88de37b68188/kube-rbac-proxy-web/0.log"
Jul 23 13:09:15.295694 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:15.295666    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e4b79cb-f340-445b-8470-88de37b68188/kube-rbac-proxy/0.log"
Jul 23 13:09:15.495530 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:15.495507    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e4b79cb-f340-445b-8470-88de37b68188/kube-rbac-proxy-thanos/0.log"
Jul 23 13:09:15.696429 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:15.696366    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-xckj6_fbe07adf-0bec-4300-83d6-f8967e0523cb/prometheus-operator/0.log"
Jul 23 13:09:15.896588 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:15.896558    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-xckj6_fbe07adf-0bec-4300-83d6-f8967e0523cb/kube-rbac-proxy/0.log"
Jul 23 13:09:16.096270 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:16.096244    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-tw5pp_e8b40e4b-147e-4adb-becb-a35657280c5a/prometheus-operator-admission-webhook/0.log"
Jul 23 13:09:16.381376 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:16.381306    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:09:16.381376 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:16.381352    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:09:18.295800 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:18.295768    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c8dfdbfc5-4zttj_cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a/console/0.log"
Jul 23 13:09:18.496419 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:18.496396    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8645bbdf84-8zc7n_2ee7a564-a638-488d-9382-44825d328e1b/console/0.log"
Jul 23 13:09:18.697351 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:18.697286    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-7plkb_931cd0d5-9891-4d1b-ab11-2379dbaa26f6/download-server/0.log"
Jul 23 13:09:19.496729 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:19.496699    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4tt8_e4158b30-dd08-44a6-95e7-eafb86ff3904/serve-healthcheck-canary/0.log"
Jul 23 13:09:21.512611 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:21.512580    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:21.616694 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:21.616660    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:21.713179 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:21.713136    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:28.867137 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:28.867104    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:28.903241 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:28.903186    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8645bbdf84-8zc7n" podUID="2ee7a564-a638-488d-9382-44825d328e1b" containerName="console" containerID="cri-o://4dfc5e0eb1b4eb78fd5362e42610c543ac0c536541a1a67eae7a2a3ac36cb474" gracePeriod=15
Jul 23 13:09:28.927352 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:28.927328    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:09:29.181350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.181326    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:09:29.315106 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.315057    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-service-ca\") pod \"2ee7a564-a638-488d-9382-44825d328e1b\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") "
Jul 23 13:09:29.315306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.315129    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ee7a564-a638-488d-9382-44825d328e1b-console-oauth-config\") pod \"2ee7a564-a638-488d-9382-44825d328e1b\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") "
Jul 23 13:09:29.315306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.315165    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ee7a564-a638-488d-9382-44825d328e1b-console-serving-cert\") pod \"2ee7a564-a638-488d-9382-44825d328e1b\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") "
Jul 23 13:09:29.315306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.315180    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-oauth-serving-cert\") pod \"2ee7a564-a638-488d-9382-44825d328e1b\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") "
Jul 23 13:09:29.315306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.315217    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rztw\" (UniqueName: \"kubernetes.io/projected/2ee7a564-a638-488d-9382-44825d328e1b-kube-api-access-2rztw\") pod \"2ee7a564-a638-488d-9382-44825d328e1b\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") "
Jul 23 13:09:29.315306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.315251    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-console-config\") pod \"2ee7a564-a638-488d-9382-44825d328e1b\" (UID: \"2ee7a564-a638-488d-9382-44825d328e1b\") "
Jul 23 13:09:29.315621 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.315599    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-service-ca" (OuterVolumeSpecName: "service-ca") pod "2ee7a564-a638-488d-9382-44825d328e1b" (UID: "2ee7a564-a638-488d-9382-44825d328e1b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:09:29.315678 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.315615    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2ee7a564-a638-488d-9382-44825d328e1b" (UID: "2ee7a564-a638-488d-9382-44825d328e1b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:09:29.315716 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.315666    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-console-config" (OuterVolumeSpecName: "console-config") pod "2ee7a564-a638-488d-9382-44825d328e1b" (UID: "2ee7a564-a638-488d-9382-44825d328e1b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:09:29.317436 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.317404    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ee7a564-a638-488d-9382-44825d328e1b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2ee7a564-a638-488d-9382-44825d328e1b" (UID: "2ee7a564-a638-488d-9382-44825d328e1b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:09:29.317542 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.317504    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ee7a564-a638-488d-9382-44825d328e1b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2ee7a564-a638-488d-9382-44825d328e1b" (UID: "2ee7a564-a638-488d-9382-44825d328e1b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:09:29.317542 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.317527    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ee7a564-a638-488d-9382-44825d328e1b-kube-api-access-2rztw" (OuterVolumeSpecName: "kube-api-access-2rztw") pod "2ee7a564-a638-488d-9382-44825d328e1b" (UID: "2ee7a564-a638-488d-9382-44825d328e1b"). InnerVolumeSpecName "kube-api-access-2rztw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:09:29.416618 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.416551    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-service-ca\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:09:29.416618 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.416584    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ee7a564-a638-488d-9382-44825d328e1b-console-oauth-config\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:09:29.416618 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.416594    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ee7a564-a638-488d-9382-44825d328e1b-console-serving-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:09:29.416618 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.416603    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-oauth-serving-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:09:29.416618 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.416611    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rztw\" (UniqueName: \"kubernetes.io/projected/2ee7a564-a638-488d-9382-44825d328e1b-kube-api-access-2rztw\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:09:29.416618 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:29.416619    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ee7a564-a638-488d-9382-44825d328e1b-console-config\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:09:30.011815 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:30.011783    2570 generic.go:356] "Generic (PLEG): container finished" podID="2ee7a564-a638-488d-9382-44825d328e1b" containerID="4dfc5e0eb1b4eb78fd5362e42610c543ac0c536541a1a67eae7a2a3ac36cb474" exitCode=0
Jul 23 13:09:30.012231 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:30.011826    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8645bbdf84-8zc7n"
Jul 23 13:09:30.012231 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:30.011837    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8645bbdf84-8zc7n" event={"ID":"2ee7a564-a638-488d-9382-44825d328e1b","Type":"ContainerDied","Data":"4dfc5e0eb1b4eb78fd5362e42610c543ac0c536541a1a67eae7a2a3ac36cb474"}
Jul 23 13:09:30.012231 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:30.011875    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8645bbdf84-8zc7n" event={"ID":"2ee7a564-a638-488d-9382-44825d328e1b","Type":"ContainerDied","Data":"bd67a36a43cf6b74486dad762726f9974179c994f77ae57439090e8a275a3d56"}
Jul 23 13:09:30.012231 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:30.011894    2570 scope.go:117] "RemoveContainer" containerID="4dfc5e0eb1b4eb78fd5362e42610c543ac0c536541a1a67eae7a2a3ac36cb474"
Jul 23 13:09:30.020557 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:30.020538    2570 scope.go:117] "RemoveContainer" containerID="4dfc5e0eb1b4eb78fd5362e42610c543ac0c536541a1a67eae7a2a3ac36cb474"
Jul 23 13:09:30.020829 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:09:30.020811    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dfc5e0eb1b4eb78fd5362e42610c543ac0c536541a1a67eae7a2a3ac36cb474\": container with ID starting with 4dfc5e0eb1b4eb78fd5362e42610c543ac0c536541a1a67eae7a2a3ac36cb474 not found: ID does not exist" containerID="4dfc5e0eb1b4eb78fd5362e42610c543ac0c536541a1a67eae7a2a3ac36cb474"
Jul 23 13:09:30.020890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:30.020836    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dfc5e0eb1b4eb78fd5362e42610c543ac0c536541a1a67eae7a2a3ac36cb474"} err="failed to get container status \"4dfc5e0eb1b4eb78fd5362e42610c543ac0c536541a1a67eae7a2a3ac36cb474\": rpc error: code = NotFound desc = could not find container \"4dfc5e0eb1b4eb78fd5362e42610c543ac0c536541a1a67eae7a2a3ac36cb474\": container with ID starting with 4dfc5e0eb1b4eb78fd5362e42610c543ac0c536541a1a67eae7a2a3ac36cb474 not found: ID does not exist"
Jul 23 13:09:30.032250 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:30.032229    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8645bbdf84-8zc7n"]
Jul 23 13:09:30.036197 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:30.036178    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8645bbdf84-8zc7n"]
Jul 23 13:09:30.357241 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:30.357166    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ee7a564-a638-488d-9382-44825d328e1b" path="/var/lib/kubelet/pods/2ee7a564-a638-488d-9382-44825d328e1b/volumes"
Jul 23 13:09:33.024544 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.024504    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c8dfdbfc5-4zttj" podUID="cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a" containerName="console" containerID="cri-o://fa2d67394c202680660f0c1a05a36438f2a1f2a07e3d2781493267aa81c1a5d4" gracePeriod=15
Jul 23 13:09:33.280296 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.280239    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:09:33.444784 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.444750    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-oauth-serving-cert\") pod \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") "
Jul 23 13:09:33.444784 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.444791    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6vbx\" (UniqueName: \"kubernetes.io/projected/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-kube-api-access-n6vbx\") pod \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") "
Jul 23 13:09:33.445019 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.444828    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-service-ca\") pod \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") "
Jul 23 13:09:33.445019 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.444853    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-serving-cert\") pod \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") "
Jul 23 13:09:33.445019 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.444870    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-config\") pod \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") "
Jul 23 13:09:33.445019 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.444900    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-oauth-config\") pod \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") "
Jul 23 13:09:33.445019 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.444939    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-trusted-ca-bundle\") pod \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\" (UID: \"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a\") "
Jul 23 13:09:33.445266 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.445229    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a" (UID: "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:09:33.445404 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.445378    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a" (UID: "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:09:33.445516 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.445420    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-config" (OuterVolumeSpecName: "console-config") pod "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a" (UID: "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:09:33.445516 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.445483    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a" (UID: "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:09:33.447097 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.447071    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-kube-api-access-n6vbx" (OuterVolumeSpecName: "kube-api-access-n6vbx") pod "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a" (UID: "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a"). InnerVolumeSpecName "kube-api-access-n6vbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:09:33.447463 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.447434    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a" (UID: "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:09:33.447546 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.447519    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a" (UID: "cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:09:33.545890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.545837    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-trusted-ca-bundle\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:09:33.545890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.545860    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-oauth-serving-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:09:33.545890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.545870    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6vbx\" (UniqueName: \"kubernetes.io/projected/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-kube-api-access-n6vbx\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:09:33.545890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.545880    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-service-ca\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:09:33.545890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.545889    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-serving-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:09:33.546121 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.545897    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-config\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:09:33.546121 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:33.545905    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a-console-oauth-config\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:09:34.031063 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:34.031033    2570 generic.go:356] "Generic (PLEG): container finished" podID="cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a" containerID="fa2d67394c202680660f0c1a05a36438f2a1f2a07e3d2781493267aa81c1a5d4" exitCode=0
Jul 23 13:09:34.031492 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:34.031079    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dfdbfc5-4zttj"
Jul 23 13:09:34.031492 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:34.031124    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dfdbfc5-4zttj" event={"ID":"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a","Type":"ContainerDied","Data":"fa2d67394c202680660f0c1a05a36438f2a1f2a07e3d2781493267aa81c1a5d4"}
Jul 23 13:09:34.031492 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:34.031176    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dfdbfc5-4zttj" event={"ID":"cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a","Type":"ContainerDied","Data":"0cc46d77a77c162d09b4a741a5b2289711fd0b364c3bfa19e6d95478f795d07d"}
Jul 23 13:09:34.031492 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:34.031196    2570 scope.go:117] "RemoveContainer" containerID="fa2d67394c202680660f0c1a05a36438f2a1f2a07e3d2781493267aa81c1a5d4"
Jul 23 13:09:34.039433 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:34.039416    2570 scope.go:117] "RemoveContainer" containerID="fa2d67394c202680660f0c1a05a36438f2a1f2a07e3d2781493267aa81c1a5d4"
Jul 23 13:09:34.039665 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:09:34.039646    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa2d67394c202680660f0c1a05a36438f2a1f2a07e3d2781493267aa81c1a5d4\": container with ID starting with fa2d67394c202680660f0c1a05a36438f2a1f2a07e3d2781493267aa81c1a5d4 not found: ID does not exist" containerID="fa2d67394c202680660f0c1a05a36438f2a1f2a07e3d2781493267aa81c1a5d4"
Jul 23 13:09:34.039709 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:34.039673    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa2d67394c202680660f0c1a05a36438f2a1f2a07e3d2781493267aa81c1a5d4"} err="failed to get container status \"fa2d67394c202680660f0c1a05a36438f2a1f2a07e3d2781493267aa81c1a5d4\": rpc error: code = NotFound desc = could not find container \"fa2d67394c202680660f0c1a05a36438f2a1f2a07e3d2781493267aa81c1a5d4\": container with ID starting with fa2d67394c202680660f0c1a05a36438f2a1f2a07e3d2781493267aa81c1a5d4 not found: ID does not exist"
Jul 23 13:09:34.052319 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:34.052298    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8dfdbfc5-4zttj"]
Jul 23 13:09:34.056636 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:34.056614    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c8dfdbfc5-4zttj"]
Jul 23 13:09:34.356364 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:34.356292    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a" path="/var/lib/kubelet/pods/cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a/volumes"
Jul 23 13:09:34.901841 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:34.901813    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8fhm9"
Jul 23 13:09:36.386648 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:36.386624    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:09:36.390428 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:36.390407    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85f599cb85-6vgrh"
Jul 23 13:09:58.106343 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:58.106306    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:09:58.125442 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:58.125419    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:09:58.139746 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:09:58.139723    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:10.873281 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:10.873245    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:10:10.986267 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:10.986233    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:10:16.100619 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.100575    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:10:16.101123 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.101008    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="prometheus" containerID="cri-o://c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f" gracePeriod=600
Jul 23 13:10:16.101123 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.101048    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="thanos-sidecar" containerID="cri-o://df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe" gracePeriod=600
Jul 23 13:10:16.101123 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.101048    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="kube-rbac-proxy" containerID="cri-o://c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814" gracePeriod=600
Jul 23 13:10:16.101123 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.101093    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="config-reloader" containerID="cri-o://dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150" gracePeriod=600
Jul 23 13:10:16.101341 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.101047    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="kube-rbac-proxy-web" containerID="cri-o://02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae" gracePeriod=600
Jul 23 13:10:16.101341 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.101173    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b" gracePeriod=600
Jul 23 13:10:16.344289 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.344264    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:16.461720 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.461699    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-metrics-client-ca\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.461887 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.461732    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-metrics-client-certs\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.461887 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.461755    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-web-config\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.461887 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.461776    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-tls\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.461887 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.461798    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-1\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.461887 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.461821    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-2\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.461887 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.461845    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-grpc-tls\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.461887 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.461871    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-config\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.462278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.461903    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-db\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.462278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.461931    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-trusted-ca-bundle\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.462278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.461961    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-serving-certs-ca-bundle\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.462278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462017    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42pnh\" (UniqueName: \"kubernetes.io/projected/0e4b79cb-f340-445b-8470-88de37b68188-kube-api-access-42pnh\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.462278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462042    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e4b79cb-f340-445b-8470-88de37b68188-config-out\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.462278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462067    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-kube-rbac-proxy\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.462278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462106    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.462278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462136    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.462278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462166    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-kubelet-serving-ca-bundle\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.462278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462205    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-0\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.462278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462201    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:10:16.462278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462242    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-thanos-prometheus-http-client-file\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.462278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462273    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e4b79cb-f340-445b-8470-88de37b68188-tls-assets\") pod \"0e4b79cb-f340-445b-8470-88de37b68188\" (UID: \"0e4b79cb-f340-445b-8470-88de37b68188\") "
Jul 23 13:10:16.462894 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462398    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:10:16.462894 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462430    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:10:16.462894 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462606    2570 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.462894 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462624    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.462894 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.462640    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.463174 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.463043    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:10:16.463174 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.463093    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:10:16.463404 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.463381    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:10:16.464218 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.464174    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:10:16.464746 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.464709    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:10:16.465060 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.465014    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:10:16.465161 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.465099    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:10:16.465278 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.465255    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e4b79cb-f340-445b-8470-88de37b68188-kube-api-access-42pnh" (OuterVolumeSpecName: "kube-api-access-42pnh") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "kube-api-access-42pnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:10:16.466104 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.466068    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:10:16.466532 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.466507    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-config" (OuterVolumeSpecName: "config") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:10:16.466671 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.466638    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:10:16.466869 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.466847    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e4b79cb-f340-445b-8470-88de37b68188-config-out" (OuterVolumeSpecName: "config-out") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:10:16.467047 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.467025    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e4b79cb-f340-445b-8470-88de37b68188-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:10:16.467236 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.467219    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:10:16.467469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.467450    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:10:16.467586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.467572    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:10:16.475314 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.475294    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-web-config" (OuterVolumeSpecName: "web-config") pod "0e4b79cb-f340-445b-8470-88de37b68188" (UID: "0e4b79cb-f340-445b-8470-88de37b68188"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:10:16.563385 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563359    2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-web-config\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563385 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563381    2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563385 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563391    2570 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-grpc-tls\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563399    2570 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-config\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563407    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-db\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563416    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563426    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42pnh\" (UniqueName: \"kubernetes.io/projected/0e4b79cb-f340-445b-8470-88de37b68188-kube-api-access-42pnh\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563434    2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e4b79cb-f340-445b-8470-88de37b68188-config-out\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563442    2570 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-kube-rbac-proxy\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563451    2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563460    2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563470    2570 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563478    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563486    2570 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563494    2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e4b79cb-f340-445b-8470-88de37b68188-tls-assets\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563503    2570 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e4b79cb-f340-445b-8470-88de37b68188-configmap-metrics-client-ca\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:16.563570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:16.563511    2570 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e4b79cb-f340-445b-8470-88de37b68188-secret-metrics-client-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:10:17.186654 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186625    2570 generic.go:356] "Generic (PLEG): container finished" podID="0e4b79cb-f340-445b-8470-88de37b68188" containerID="4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b" exitCode=0
Jul 23 13:10:17.186654 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186651    2570 generic.go:356] "Generic (PLEG): container finished" podID="0e4b79cb-f340-445b-8470-88de37b68188" containerID="c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814" exitCode=0
Jul 23 13:10:17.186654 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186658    2570 generic.go:356] "Generic (PLEG): container finished" podID="0e4b79cb-f340-445b-8470-88de37b68188" containerID="02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae" exitCode=0
Jul 23 13:10:17.187154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186664    2570 generic.go:356] "Generic (PLEG): container finished" podID="0e4b79cb-f340-445b-8470-88de37b68188" containerID="df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe" exitCode=0
Jul 23 13:10:17.187154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186669    2570 generic.go:356] "Generic (PLEG): container finished" podID="0e4b79cb-f340-445b-8470-88de37b68188" containerID="dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150" exitCode=0
Jul 23 13:10:17.187154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186676    2570 generic.go:356] "Generic (PLEG): container finished" podID="0e4b79cb-f340-445b-8470-88de37b68188" containerID="c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f" exitCode=0
Jul 23 13:10:17.187154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186692    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.187154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186710    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerDied","Data":"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"}
Jul 23 13:10:17.187154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186777    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerDied","Data":"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"}
Jul 23 13:10:17.187154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186806    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerDied","Data":"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"}
Jul 23 13:10:17.187154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186832    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerDied","Data":"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"}
Jul 23 13:10:17.187154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186855    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerDied","Data":"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"}
Jul 23 13:10:17.187154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186864    2570 scope.go:117] "RemoveContainer" containerID="4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"
Jul 23 13:10:17.187154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186879    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerDied","Data":"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"}
Jul 23 13:10:17.187154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.186903    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e4b79cb-f340-445b-8470-88de37b68188","Type":"ContainerDied","Data":"0ef4d5a21c2a3f235aa88311f201cab5e70069d16cf7aa6af5271ae440c994d7"}
Jul 23 13:10:17.194255 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.194123    2570 scope.go:117] "RemoveContainer" containerID="c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"
Jul 23 13:10:17.201198 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.201181    2570 scope.go:117] "RemoveContainer" containerID="02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"
Jul 23 13:10:17.207236 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.207223    2570 scope.go:117] "RemoveContainer" containerID="df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"
Jul 23 13:10:17.211421 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.211402    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:10:17.213677 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.213662    2570 scope.go:117] "RemoveContainer" containerID="dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"
Jul 23 13:10:17.218945 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.218921    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:10:17.220258 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.220244    2570 scope.go:117] "RemoveContainer" containerID="c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"
Jul 23 13:10:17.226768 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.226752    2570 scope.go:117] "RemoveContainer" containerID="49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"
Jul 23 13:10:17.232651 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.232630    2570 scope.go:117] "RemoveContainer" containerID="4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"
Jul 23 13:10:17.232903 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:10:17.232884    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b\": container with ID starting with 4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b not found: ID does not exist" containerID="4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"
Jul 23 13:10:17.232940 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.232911    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"} err="failed to get container status \"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b\": rpc error: code = NotFound desc = could not find container \"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b\": container with ID starting with 4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b not found: ID does not exist"
Jul 23 13:10:17.232940 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.232930    2570 scope.go:117] "RemoveContainer" containerID="c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"
Jul 23 13:10:17.233181 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:10:17.233164    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814\": container with ID starting with c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814 not found: ID does not exist" containerID="c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"
Jul 23 13:10:17.233227 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.233186    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"} err="failed to get container status \"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814\": rpc error: code = NotFound desc = could not find container \"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814\": container with ID starting with c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814 not found: ID does not exist"
Jul 23 13:10:17.233227 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.233201    2570 scope.go:117] "RemoveContainer" containerID="02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"
Jul 23 13:10:17.233387 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:10:17.233370    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae\": container with ID starting with 02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae not found: ID does not exist" containerID="02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"
Jul 23 13:10:17.233426 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.233393    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"} err="failed to get container status \"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae\": rpc error: code = NotFound desc = could not find container \"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae\": container with ID starting with 02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae not found: ID does not exist"
Jul 23 13:10:17.233426 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.233408    2570 scope.go:117] "RemoveContainer" containerID="df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"
Jul 23 13:10:17.233623 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:10:17.233604    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe\": container with ID starting with df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe not found: ID does not exist" containerID="df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"
Jul 23 13:10:17.233684 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.233630    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"} err="failed to get container status \"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe\": rpc error: code = NotFound desc = could not find container \"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe\": container with ID starting with df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe not found: ID does not exist"
Jul 23 13:10:17.233684 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.233650    2570 scope.go:117] "RemoveContainer" containerID="dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"
Jul 23 13:10:17.233882 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:10:17.233867    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150\": container with ID starting with dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150 not found: ID does not exist" containerID="dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"
Jul 23 13:10:17.233945 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.233887    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"} err="failed to get container status \"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150\": rpc error: code = NotFound desc = could not find container \"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150\": container with ID starting with dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150 not found: ID does not exist"
Jul 23 13:10:17.233945 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.233905    2570 scope.go:117] "RemoveContainer" containerID="c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"
Jul 23 13:10:17.234134 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:10:17.234119    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f\": container with ID starting with c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f not found: ID does not exist" containerID="c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"
Jul 23 13:10:17.234169 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.234139    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"} err="failed to get container status \"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f\": rpc error: code = NotFound desc = could not find container \"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f\": container with ID starting with c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f not found: ID does not exist"
Jul 23 13:10:17.234169 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.234154    2570 scope.go:117] "RemoveContainer" containerID="49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"
Jul 23 13:10:17.234357 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:10:17.234341    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4\": container with ID starting with 49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4 not found: ID does not exist" containerID="49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"
Jul 23 13:10:17.234397 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.234362    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"} err="failed to get container status \"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4\": rpc error: code = NotFound desc = could not find container \"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4\": container with ID starting with 49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4 not found: ID does not exist"
Jul 23 13:10:17.234397 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.234374    2570 scope.go:117] "RemoveContainer" containerID="4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"
Jul 23 13:10:17.234580 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.234563    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"} err="failed to get container status \"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b\": rpc error: code = NotFound desc = could not find container \"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b\": container with ID starting with 4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b not found: ID does not exist"
Jul 23 13:10:17.234644 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.234581    2570 scope.go:117] "RemoveContainer" containerID="c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"
Jul 23 13:10:17.234799 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.234761    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"} err="failed to get container status \"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814\": rpc error: code = NotFound desc = could not find container \"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814\": container with ID starting with c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814 not found: ID does not exist"
Jul 23 13:10:17.234847 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.234801    2570 scope.go:117] "RemoveContainer" containerID="02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"
Jul 23 13:10:17.235023 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.235003    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"} err="failed to get container status \"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae\": rpc error: code = NotFound desc = could not find container \"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae\": container with ID starting with 02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae not found: ID does not exist"
Jul 23 13:10:17.235063 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.235024    2570 scope.go:117] "RemoveContainer" containerID="df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"
Jul 23 13:10:17.235235 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.235218    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"} err="failed to get container status \"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe\": rpc error: code = NotFound desc = could not find container \"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe\": container with ID starting with df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe not found: ID does not exist"
Jul 23 13:10:17.235300 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.235237    2570 scope.go:117] "RemoveContainer" containerID="dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"
Jul 23 13:10:17.235486 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.235469    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"} err="failed to get container status \"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150\": rpc error: code = NotFound desc = could not find container \"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150\": container with ID starting with dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150 not found: ID does not exist"
Jul 23 13:10:17.235535 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.235487    2570 scope.go:117] "RemoveContainer" containerID="c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"
Jul 23 13:10:17.235664 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.235646    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"} err="failed to get container status \"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f\": rpc error: code = NotFound desc = could not find container \"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f\": container with ID starting with c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f not found: ID does not exist"
Jul 23 13:10:17.235729 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.235665    2570 scope.go:117] "RemoveContainer" containerID="49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"
Jul 23 13:10:17.235879 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.235861    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"} err="failed to get container status \"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4\": rpc error: code = NotFound desc = could not find container \"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4\": container with ID starting with 49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4 not found: ID does not exist"
Jul 23 13:10:17.235937 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.235880    2570 scope.go:117] "RemoveContainer" containerID="4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"
Jul 23 13:10:17.236090 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.236072    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"} err="failed to get container status \"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b\": rpc error: code = NotFound desc = could not find container \"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b\": container with ID starting with 4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b not found: ID does not exist"
Jul 23 13:10:17.236155 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.236091    2570 scope.go:117] "RemoveContainer" containerID="c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"
Jul 23 13:10:17.236279 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.236263    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"} err="failed to get container status \"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814\": rpc error: code = NotFound desc = could not find container \"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814\": container with ID starting with c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814 not found: ID does not exist"
Jul 23 13:10:17.236343 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.236280    2570 scope.go:117] "RemoveContainer" containerID="02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"
Jul 23 13:10:17.236480 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.236464    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"} err="failed to get container status \"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae\": rpc error: code = NotFound desc = could not find container \"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae\": container with ID starting with 02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae not found: ID does not exist"
Jul 23 13:10:17.236545 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.236481    2570 scope.go:117] "RemoveContainer" containerID="df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"
Jul 23 13:10:17.236702 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.236686    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"} err="failed to get container status \"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe\": rpc error: code = NotFound desc = could not find container \"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe\": container with ID starting with df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe not found: ID does not exist"
Jul 23 13:10:17.236767 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.236703    2570 scope.go:117] "RemoveContainer" containerID="dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"
Jul 23 13:10:17.236936 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.236919    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"} err="failed to get container status \"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150\": rpc error: code = NotFound desc = could not find container \"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150\": container with ID starting with dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150 not found: ID does not exist"
Jul 23 13:10:17.237016 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.236938    2570 scope.go:117] "RemoveContainer" containerID="c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"
Jul 23 13:10:17.237259 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.237243    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"} err="failed to get container status \"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f\": rpc error: code = NotFound desc = could not find container \"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f\": container with ID starting with c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f not found: ID does not exist"
Jul 23 13:10:17.237327 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.237261    2570 scope.go:117] "RemoveContainer" containerID="49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"
Jul 23 13:10:17.237460 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.237443    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"} err="failed to get container status \"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4\": rpc error: code = NotFound desc = could not find container \"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4\": container with ID starting with 49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4 not found: ID does not exist"
Jul 23 13:10:17.237505 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.237461    2570 scope.go:117] "RemoveContainer" containerID="4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"
Jul 23 13:10:17.237667 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.237650    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"} err="failed to get container status \"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b\": rpc error: code = NotFound desc = could not find container \"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b\": container with ID starting with 4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b not found: ID does not exist"
Jul 23 13:10:17.237705 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.237667    2570 scope.go:117] "RemoveContainer" containerID="c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"
Jul 23 13:10:17.237864 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.237847    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"} err="failed to get container status \"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814\": rpc error: code = NotFound desc = could not find container \"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814\": container with ID starting with c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814 not found: ID does not exist"
Jul 23 13:10:17.237932 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.237865    2570 scope.go:117] "RemoveContainer" containerID="02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"
Jul 23 13:10:17.238094 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.238078    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"} err="failed to get container status \"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae\": rpc error: code = NotFound desc = could not find container \"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae\": container with ID starting with 02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae not found: ID does not exist"
Jul 23 13:10:17.238143 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.238095    2570 scope.go:117] "RemoveContainer" containerID="df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"
Jul 23 13:10:17.238291 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.238274    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"} err="failed to get container status \"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe\": rpc error: code = NotFound desc = could not find container \"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe\": container with ID starting with df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe not found: ID does not exist"
Jul 23 13:10:17.238330 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.238290    2570 scope.go:117] "RemoveContainer" containerID="dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"
Jul 23 13:10:17.238511 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.238492    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"} err="failed to get container status \"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150\": rpc error: code = NotFound desc = could not find container \"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150\": container with ID starting with dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150 not found: ID does not exist"
Jul 23 13:10:17.238552 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.238512    2570 scope.go:117] "RemoveContainer" containerID="c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"
Jul 23 13:10:17.238701 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.238684    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"} err="failed to get container status \"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f\": rpc error: code = NotFound desc = could not find container \"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f\": container with ID starting with c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f not found: ID does not exist"
Jul 23 13:10:17.238747 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.238703    2570 scope.go:117] "RemoveContainer" containerID="49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"
Jul 23 13:10:17.238910 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.238892    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"} err="failed to get container status \"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4\": rpc error: code = NotFound desc = could not find container \"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4\": container with ID starting with 49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4 not found: ID does not exist"
Jul 23 13:10:17.238946 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.238912    2570 scope.go:117] "RemoveContainer" containerID="4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"
Jul 23 13:10:17.239112 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.239097    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"} err="failed to get container status \"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b\": rpc error: code = NotFound desc = could not find container \"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b\": container with ID starting with 4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b not found: ID does not exist"
Jul 23 13:10:17.239163 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.239112    2570 scope.go:117] "RemoveContainer" containerID="c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"
Jul 23 13:10:17.239326 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.239311    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"} err="failed to get container status \"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814\": rpc error: code = NotFound desc = could not find container \"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814\": container with ID starting with c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814 not found: ID does not exist"
Jul 23 13:10:17.239326 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.239325    2570 scope.go:117] "RemoveContainer" containerID="02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"
Jul 23 13:10:17.239515 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.239500    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"} err="failed to get container status \"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae\": rpc error: code = NotFound desc = could not find container \"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae\": container with ID starting with 02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae not found: ID does not exist"
Jul 23 13:10:17.239592 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.239515    2570 scope.go:117] "RemoveContainer" containerID="df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"
Jul 23 13:10:17.239709 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.239694    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"} err="failed to get container status \"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe\": rpc error: code = NotFound desc = could not find container \"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe\": container with ID starting with df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe not found: ID does not exist"
Jul 23 13:10:17.239750 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.239708    2570 scope.go:117] "RemoveContainer" containerID="dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"
Jul 23 13:10:17.239908 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.239891    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"} err="failed to get container status \"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150\": rpc error: code = NotFound desc = could not find container \"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150\": container with ID starting with dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150 not found: ID does not exist"
Jul 23 13:10:17.239908 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.239907    2570 scope.go:117] "RemoveContainer" containerID="c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"
Jul 23 13:10:17.240109 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.240089    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"} err="failed to get container status \"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f\": rpc error: code = NotFound desc = could not find container \"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f\": container with ID starting with c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f not found: ID does not exist"
Jul 23 13:10:17.240184 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.240111    2570 scope.go:117] "RemoveContainer" containerID="49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"
Jul 23 13:10:17.240367 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.240349    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"} err="failed to get container status \"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4\": rpc error: code = NotFound desc = could not find container \"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4\": container with ID starting with 49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4 not found: ID does not exist"
Jul 23 13:10:17.240410 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.240368    2570 scope.go:117] "RemoveContainer" containerID="4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"
Jul 23 13:10:17.240586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.240568    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b"} err="failed to get container status \"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b\": rpc error: code = NotFound desc = could not find container \"4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b\": container with ID starting with 4570c7e04e73e2d3fa87a9ef33b43d7f86b929bab66ed357bcba8b8027af424b not found: ID does not exist"
Jul 23 13:10:17.240633 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.240587    2570 scope.go:117] "RemoveContainer" containerID="c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"
Jul 23 13:10:17.240756 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.240739    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814"} err="failed to get container status \"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814\": rpc error: code = NotFound desc = could not find container \"c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814\": container with ID starting with c852c410954fba8c1b8b51d2976e12a24b1ff0edba9680e19dbe72e9b3c7c814 not found: ID does not exist"
Jul 23 13:10:17.240799 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.240756    2570 scope.go:117] "RemoveContainer" containerID="02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"
Jul 23 13:10:17.240912 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.240896    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae"} err="failed to get container status \"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae\": rpc error: code = NotFound desc = could not find container \"02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae\": container with ID starting with 02c5acea30b8a9c28551ef3dc72d411e9296fb6ddb9022d90b73e6f9f39152ae not found: ID does not exist"
Jul 23 13:10:17.240951 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.240911    2570 scope.go:117] "RemoveContainer" containerID="df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"
Jul 23 13:10:17.241109 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.241090    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe"} err="failed to get container status \"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe\": rpc error: code = NotFound desc = could not find container \"df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe\": container with ID starting with df4010c3dd1951ae5d91488e6392400d6c4703466827fb3fe899e16c598bc3fe not found: ID does not exist"
Jul 23 13:10:17.241149 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.241110    2570 scope.go:117] "RemoveContainer" containerID="dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"
Jul 23 13:10:17.241289 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.241273    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150"} err="failed to get container status \"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150\": rpc error: code = NotFound desc = could not find container \"dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150\": container with ID starting with dc74414a0149a8e62e29c88af4fad5d168afbca79679db25511e6981006d6150 not found: ID does not exist"
Jul 23 13:10:17.241326 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.241290    2570 scope.go:117] "RemoveContainer" containerID="c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"
Jul 23 13:10:17.241469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.241453    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f"} err="failed to get container status \"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f\": rpc error: code = NotFound desc = could not find container \"c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f\": container with ID starting with c130d094aa9962012f6b560775e05c1816aebe21b3195c882f8c8ba15ce2c85f not found: ID does not exist"
Jul 23 13:10:17.241515 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.241469    2570 scope.go:117] "RemoveContainer" containerID="49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"
Jul 23 13:10:17.241634 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.241616    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4"} err="failed to get container status \"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4\": rpc error: code = NotFound desc = could not find container \"49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4\": container with ID starting with 49dcc453639829925a2bb2ecd7738318c6f57b46fb5f9768fd91b9ec9f9504b4 not found: ID does not exist"
Jul 23 13:10:17.246062 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246043    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:10:17.246292 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246281    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="prometheus"
Jul 23 13:10:17.246329 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246295    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="prometheus"
Jul 23 13:10:17.246329 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246307    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="kube-rbac-proxy"
Jul 23 13:10:17.246329 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246313    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="kube-rbac-proxy"
Jul 23 13:10:17.246329 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246321    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ee7a564-a638-488d-9382-44825d328e1b" containerName="console"
Jul 23 13:10:17.246329 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246326    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ee7a564-a638-488d-9382-44825d328e1b" containerName="console"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246333    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="init-config-reloader"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246338    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="init-config-reloader"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246346    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="kube-rbac-proxy-web"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246353    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="kube-rbac-proxy-web"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246361    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a" containerName="console"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246366    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a" containerName="console"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246372    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="thanos-sidecar"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246379    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="thanos-sidecar"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246389    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="kube-rbac-proxy-thanos"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246394    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="kube-rbac-proxy-thanos"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246402    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="config-reloader"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246407    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="config-reloader"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246462    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="thanos-sidecar"
Jul 23 13:10:17.246469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246471    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="kube-rbac-proxy-web"
Jul 23 13:10:17.246843 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246477    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="kube-rbac-proxy-thanos"
Jul 23 13:10:17.246843 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246483    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="prometheus"
Jul 23 13:10:17.246843 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246487    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="kube-rbac-proxy"
Jul 23 13:10:17.246843 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246491    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ee7a564-a638-488d-9382-44825d328e1b" containerName="console"
Jul 23 13:10:17.246843 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246496    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4b79cb-f340-445b-8470-88de37b68188" containerName="config-reloader"
Jul 23 13:10:17.246843 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.246501    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf90c6ae-6182-4c49-8f7f-721ec5e2bc0a" containerName="console"
Jul 23 13:10:17.250018 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.250001    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.252973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.252953    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 13:10:17.253089 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.253021    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 13:10:17.253089 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.253046    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-clgb7\""
Jul 23 13:10:17.253394 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.253308    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 13:10:17.253577 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.253559    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 13:10:17.254770 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.254090    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 13:10:17.254770 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.254104    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8ad68lnhegn68\""
Jul 23 13:10:17.254770 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.254236    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 13:10:17.254770 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.254561    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 13:10:17.255405 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.255266    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 13:10:17.256012 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.255620    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 13:10:17.256012 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.255764    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 13:10:17.257158 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.257138    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 13:10:17.257257 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.257198    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 13:10:17.258024 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.257976    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 13:10:17.260616 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.260595    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 13:10:17.267516 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.267493    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:10:17.269222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269305 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269305 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269252    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-config\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269305 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269286    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269453 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269453 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269344    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269453 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269418    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c96ed730-7d3a-45e9-b09c-59a764487ad3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269608 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269451    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269608 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269486    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269608 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269516    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269608 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269553    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-web-config\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269608 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269587    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269847 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269618    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269847 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269644    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269847 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269670    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269847 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269750    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269847 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269794    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tpw4\" (UniqueName: \"kubernetes.io/projected/c96ed730-7d3a-45e9-b09c-59a764487ad3-kube-api-access-6tpw4\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269847 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269826    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c96ed730-7d3a-45e9-b09c-59a764487ad3-config-out\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.269847 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269845    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.270184 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.269865    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370519    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c96ed730-7d3a-45e9-b09c-59a764487ad3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370546    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370566    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370584    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370604    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-web-config\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370627    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370656    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370678    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370701    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370727    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370749    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tpw4\" (UniqueName: \"kubernetes.io/projected/c96ed730-7d3a-45e9-b09c-59a764487ad3-kube-api-access-6tpw4\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370783    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c96ed730-7d3a-45e9-b09c-59a764487ad3-config-out\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370803    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370824    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.370875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370865    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.372471 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370902    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.372471 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370928    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-config\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.372471 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.370951    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.372471 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.371012    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.372471 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.371045    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.372471 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.371392    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.372471 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.371679    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.372471 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.371903    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.372471 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.372160    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.372978 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.372741    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.373762 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.373225    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.373762 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.373518    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.373906 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.373845    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c96ed730-7d3a-45e9-b09c-59a764487ad3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.374249 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.374196    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-web-config\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.375339 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.374622    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.375339 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.374691    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.375482 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.375442    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.375482 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.375473    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.375748 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.375724    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.376040 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.376022    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-config\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.376261 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.376239    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.376338 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.376277    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c96ed730-7d3a-45e9-b09c-59a764487ad3-config-out\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.376543 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.376525    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c96ed730-7d3a-45e9-b09c-59a764487ad3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.377744 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.377721    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c96ed730-7d3a-45e9-b09c-59a764487ad3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.380845 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.380829    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tpw4\" (UniqueName: \"kubernetes.io/projected/c96ed730-7d3a-45e9-b09c-59a764487ad3-kube-api-access-6tpw4\") pod \"prometheus-k8s-0\" (UID: \"c96ed730-7d3a-45e9-b09c-59a764487ad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.561140 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.561109    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:17.696231 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:17.696199    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:10:17.698847 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:10:17.698812    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc96ed730_7d3a_45e9_b09c_59a764487ad3.slice/crio-19ed68e5d64fe0c7931f5bc7c8b42a27974789708d8b144f86788741f5fde158 WatchSource:0}: Error finding container 19ed68e5d64fe0c7931f5bc7c8b42a27974789708d8b144f86788741f5fde158: Status 404 returned error can't find the container with id 19ed68e5d64fe0c7931f5bc7c8b42a27974789708d8b144f86788741f5fde158
Jul 23 13:10:18.191901 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:18.191869    2570 generic.go:356] "Generic (PLEG): container finished" podID="c96ed730-7d3a-45e9-b09c-59a764487ad3" containerID="5054c027db521c86067eba1c3fa3f3430855fa8d758782a91aa01e10279ddbeb" exitCode=0
Jul 23 13:10:18.192318 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:18.191934    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c96ed730-7d3a-45e9-b09c-59a764487ad3","Type":"ContainerDied","Data":"5054c027db521c86067eba1c3fa3f3430855fa8d758782a91aa01e10279ddbeb"}
Jul 23 13:10:18.192318 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:18.192020    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c96ed730-7d3a-45e9-b09c-59a764487ad3","Type":"ContainerStarted","Data":"19ed68e5d64fe0c7931f5bc7c8b42a27974789708d8b144f86788741f5fde158"}
Jul 23 13:10:18.357058 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:18.357031    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e4b79cb-f340-445b-8470-88de37b68188" path="/var/lib/kubelet/pods/0e4b79cb-f340-445b-8470-88de37b68188/volumes"
Jul 23 13:10:19.198499 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:19.198467    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c96ed730-7d3a-45e9-b09c-59a764487ad3","Type":"ContainerStarted","Data":"648290da041301fec44e6ceee1682721d0dcee7842860e9275bff1b8402b2ec5"}
Jul 23 13:10:19.198888 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:19.198535    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c96ed730-7d3a-45e9-b09c-59a764487ad3","Type":"ContainerStarted","Data":"725d5cf3ef825567a0d34c1b2a67bf952b8422853e9051c4988ac640aae8d393"}
Jul 23 13:10:19.198888 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:19.198564    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c96ed730-7d3a-45e9-b09c-59a764487ad3","Type":"ContainerStarted","Data":"83337d16fd3f23d7a95e13cd155701a9b64c77a6eec8a7dbb0006c3b77d199e2"}
Jul 23 13:10:19.198888 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:19.198587    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c96ed730-7d3a-45e9-b09c-59a764487ad3","Type":"ContainerStarted","Data":"f8d0dc142012724e7e0d87bc23abe31f58083f3955215b4cee05eff595f63b1a"}
Jul 23 13:10:19.198888 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:19.198618    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c96ed730-7d3a-45e9-b09c-59a764487ad3","Type":"ContainerStarted","Data":"8c0288004088e8b207e3c0659ffdc0f36233d622a151843deccd6b9f8ec9732d"}
Jul 23 13:10:19.198888 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:19.198642    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c96ed730-7d3a-45e9-b09c-59a764487ad3","Type":"ContainerStarted","Data":"d184a84f3938dab7cc3c4b1785cf55f09d51e2d7abf2deeebdf9348e8b664dc2"}
Jul 23 13:10:19.229514 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:19.229474    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.209952841 podStartE2EDuration="2.229459874s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.507033ms" isStatefulPod=false podCreationTimestamp="2026-07-23 13:10:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:10:19.227874831 +0000 UTC m=+161.481400731" watchObservedRunningTime="2026-07-23 13:10:19.229459874 +0000 UTC m=+161.482985749"
Jul 23 13:10:20.077801 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:20.077765    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:10:20.177537 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:20.177504    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:10:22.561317 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:22.561265    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:10:31.450042 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:31.449948    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:10:31.549855 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:31.549817    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:10:31.651463 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:31.651428    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:10:32.324289 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:32.324250    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:10:38.453699 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:38.453629    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:10:38.519271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:10:38.519247    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:11:17.561674 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:17.561642    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:11:17.576294 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:17.576270    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:11:18.413094 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:18.413069    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:11:21.584357 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:21.584316    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:11:26.065175 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:26.065140    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:11:26.169260 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:26.169228    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:11:27.645392 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:27.645351    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:11:27.756777 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:27.756747    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:11:38.592547 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:38.592506    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:11:38.686456 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:38.686427    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:11:38.806362 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:38.806335    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:11:38.876066 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:38.875998    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:11:43.870396 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:43.870362    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:11:43.971273 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:11:43.971248    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:12:25.153819 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:12:25.153744    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:12:26.933286 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:12:26.933253    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:12:27.403540 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:12:27.403512    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:12:27.525643 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:12:27.525609    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:12:38.164706 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:12:38.164667    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 13:12:54.331739 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:12:54.331706    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:12:55.261166 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:12:55.261129    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:12:58.625978 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:12:58.625948    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:12:58.885441 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:12:58.885367    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:00.432169 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:00.432140    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:02.040626 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.040594    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6cwct"]
Jul 23 13:13:02.042920 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.042905    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6cwct"
Jul 23 13:13:02.046837 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.046819    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qx545\""
Jul 23 13:13:02.047427 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.047410    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 13:13:02.047859 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.047842    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 13:13:02.066164 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.066141    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6cwct"]
Jul 23 13:13:02.148322 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.148293    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2f828cb-111c-4009-9af0-4c189fbcbf00-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6cwct\" (UID: \"b2f828cb-111c-4009-9af0-4c189fbcbf00\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6cwct"
Jul 23 13:13:02.148322 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.148324    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld6mj\" (UniqueName: \"kubernetes.io/projected/b2f828cb-111c-4009-9af0-4c189fbcbf00-kube-api-access-ld6mj\") pod \"cert-manager-webhook-6486ffd997-6cwct\" (UID: \"b2f828cb-111c-4009-9af0-4c189fbcbf00\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6cwct"
Jul 23 13:13:02.249342 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.249311    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2f828cb-111c-4009-9af0-4c189fbcbf00-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6cwct\" (UID: \"b2f828cb-111c-4009-9af0-4c189fbcbf00\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6cwct"
Jul 23 13:13:02.249474 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.249344    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld6mj\" (UniqueName: \"kubernetes.io/projected/b2f828cb-111c-4009-9af0-4c189fbcbf00-kube-api-access-ld6mj\") pod \"cert-manager-webhook-6486ffd997-6cwct\" (UID: \"b2f828cb-111c-4009-9af0-4c189fbcbf00\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6cwct"
Jul 23 13:13:02.267279 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.267250    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld6mj\" (UniqueName: \"kubernetes.io/projected/b2f828cb-111c-4009-9af0-4c189fbcbf00-kube-api-access-ld6mj\") pod \"cert-manager-webhook-6486ffd997-6cwct\" (UID: \"b2f828cb-111c-4009-9af0-4c189fbcbf00\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6cwct"
Jul 23 13:13:02.268933 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.268914    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2f828cb-111c-4009-9af0-4c189fbcbf00-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6cwct\" (UID: \"b2f828cb-111c-4009-9af0-4c189fbcbf00\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6cwct"
Jul 23 13:13:02.365583 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.365521    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6cwct"
Jul 23 13:13:02.508235 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.508204    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6cwct"]
Jul 23 13:13:02.511453 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:13:02.511427    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2f828cb_111c_4009_9af0_4c189fbcbf00.slice/crio-ca394c560f9cfc81bccc18139fa0148fddfb2bc1df2d26dda5905e11fec0e161 WatchSource:0}: Error finding container ca394c560f9cfc81bccc18139fa0148fddfb2bc1df2d26dda5905e11fec0e161: Status 404 returned error can't find the container with id ca394c560f9cfc81bccc18139fa0148fddfb2bc1df2d26dda5905e11fec0e161
Jul 23 13:13:02.513341 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.513323    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:13:02.745629 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.745596    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6cwct" event={"ID":"b2f828cb-111c-4009-9af0-4c189fbcbf00","Type":"ContainerStarted","Data":"ca394c560f9cfc81bccc18139fa0148fddfb2bc1df2d26dda5905e11fec0e161"}
Jul 23 13:13:02.865974 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:02.865940    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:03.093566 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:03.093495    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:03.291805 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:03.291768    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:03.612712 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:03.612666    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:05.759001 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:05.758946    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6cwct" event={"ID":"b2f828cb-111c-4009-9af0-4c189fbcbf00","Type":"ContainerStarted","Data":"907c6dec1c2ef0ce0d0aa63b4783734a5767edad60b744265e018ec6d2288b86"}
Jul 23 13:13:05.759001 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:05.758999    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6cwct"
Jul 23 13:13:05.803849 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:05.803803    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-6cwct" podStartSLOduration=0.761224977 podStartE2EDuration="3.803788291s" totalImagesPullingTime="3.042563314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:13:05.802901097 +0000 UTC m=+328.056426974" watchObservedRunningTime="2026-07-23 13:13:05.803788291 +0000 UTC m=+328.057314166"
Jul 23 13:13:05.858661 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:05.858600    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:05.989181 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:05.989153    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:08.309140 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:08.309108    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:08.507198 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:08.507169    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:11.588616 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:11.588581    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:11.764582 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:11.764549    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6cwct"
Jul 23 13:13:12.269561 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:12.269529    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:12.405889 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:12.405858    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:13.533141 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.533109    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj"]
Jul 23 13:13:13.535398 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.535382    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj"
Jul 23 13:13:13.539923 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.539901    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xnmd2\""
Jul 23 13:13:13.540980 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.540949    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 13:13:13.541365 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.541225    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:13:13.554396 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.554374    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj"]
Jul 23 13:13:13.632844 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.632819    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kzg9\" (UniqueName: \"kubernetes.io/projected/e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db-kube-api-access-4kzg9\") pod \"openshift-lws-operator-fd8ccff4c-xfclj\" (UID: \"e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj"
Jul 23 13:13:13.632950 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.632851    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xfclj\" (UID: \"e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj"
Jul 23 13:13:13.733284 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.733254    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kzg9\" (UniqueName: \"kubernetes.io/projected/e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db-kube-api-access-4kzg9\") pod \"openshift-lws-operator-fd8ccff4c-xfclj\" (UID: \"e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj"
Jul 23 13:13:13.733284 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.733290    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xfclj\" (UID: \"e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj"
Jul 23 13:13:13.733644 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.733630    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xfclj\" (UID: \"e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj"
Jul 23 13:13:13.743736 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.743717    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kzg9\" (UniqueName: \"kubernetes.io/projected/e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db-kube-api-access-4kzg9\") pod \"openshift-lws-operator-fd8ccff4c-xfclj\" (UID: \"e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj"
Jul 23 13:13:13.843477 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.843423    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj"
Jul 23 13:13:13.971265 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:13.971231    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj"]
Jul 23 13:13:13.975373 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:13:13.975345    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9dbb4c9_63b0_42e6_90ed_53d4ef2c39db.slice/crio-b67ea5bb064cd6978ab1b2d2df26a6ff9fa44a8c00bc98531672cbc1308c3fe8 WatchSource:0}: Error finding container b67ea5bb064cd6978ab1b2d2df26a6ff9fa44a8c00bc98531672cbc1308c3fe8: Status 404 returned error can't find the container with id b67ea5bb064cd6978ab1b2d2df26a6ff9fa44a8c00bc98531672cbc1308c3fe8
Jul 23 13:13:14.795528 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:14.795494    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj" event={"ID":"e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db","Type":"ContainerStarted","Data":"b67ea5bb064cd6978ab1b2d2df26a6ff9fa44a8c00bc98531672cbc1308c3fe8"}
Jul 23 13:13:18.812818 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:18.812782    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj" event={"ID":"e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db","Type":"ContainerStarted","Data":"70294711cd272ae68ef11019d56a93471668c1b58d8257bf2cda107761370268"}
Jul 23 13:13:18.832774 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:18.832730    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xfclj" podStartSLOduration=1.5594283450000002 podStartE2EDuration="5.832716335s" totalImagesPullingTime="4.27328799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:13:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:13:18.83087529 +0000 UTC m=+341.084401166" watchObservedRunningTime="2026-07-23 13:13:18.832716335 +0000 UTC m=+341.086242210"
Jul 23 13:13:19.619829 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:19.619801    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:19.716804 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:19.716772    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:21.838018 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:21.837969    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:33.294434 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:33.294401    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:33.413564 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:33.413534    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:33.896847 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:33.896787    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:34.258035 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.257979    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:34.399621 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.399590    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:34.435730 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.435703    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"]
Jul 23 13:13:34.438861 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.438843    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.442158 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:13:34.442122    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="e31d9b36-d03f-4b52-b79b-16bd08bd4773" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.442392 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:13:34.442363    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret"
Jul 23 13:13:34.442504 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:13:34.442439    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 23 13:13:34.442504 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:13:34.442454    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret"
Jul 23 13:13:34.442726 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:13:34.442680    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-md9mv\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-md9mv\"" type="*v1.Secret"
Jul 23 13:13:34.442805 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:13:34.442738    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 23 13:13:34.472878 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.472853    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"]
Jul 23 13:13:34.484808 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.484781    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e31d9b36-d03f-4b52-b79b-16bd08bd4773-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.484951 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.484920    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpmdl\" (UniqueName: \"kubernetes.io/projected/e31d9b36-d03f-4b52-b79b-16bd08bd4773-kube-api-access-zpmdl\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.485047 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.485028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e31d9b36-d03f-4b52-b79b-16bd08bd4773-manifests\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.485123 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.485063    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e31d9b36-d03f-4b52-b79b-16bd08bd4773-tmp\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.485123 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.485078    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e31d9b36-d03f-4b52-b79b-16bd08bd4773-webhook-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.573946 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.573842    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:34.586509 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.586485    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e31d9b36-d03f-4b52-b79b-16bd08bd4773-manifests\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.586602 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.586514    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e31d9b36-d03f-4b52-b79b-16bd08bd4773-tmp\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.586602 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.586530    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e31d9b36-d03f-4b52-b79b-16bd08bd4773-webhook-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.586602 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.586571    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e31d9b36-d03f-4b52-b79b-16bd08bd4773-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.586602 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.586592    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpmdl\" (UniqueName: \"kubernetes.io/projected/e31d9b36-d03f-4b52-b79b-16bd08bd4773-kube-api-access-zpmdl\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.586885 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.586870    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e31d9b36-d03f-4b52-b79b-16bd08bd4773-manifests\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.588585 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.588568    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e31d9b36-d03f-4b52-b79b-16bd08bd4773-tmp\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:34.672139 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.672107    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:34.771641 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.771610    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:34.871065 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.870963    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:34.945158 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:34.945114    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:35.587083 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:13:35.587053    2570 secret.go:189] Couldn't get secret opendatahub/opendatahub-operator-controller-manager-service-cert: failed to sync secret cache: timed out waiting for the condition
Jul 23 13:13:35.587083 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:13:35.587071    2570 secret.go:189] Couldn't get secret opendatahub/opendatahub-operator-controller-manager-service-cert: failed to sync secret cache: timed out waiting for the condition
Jul 23 13:13:35.587497 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:13:35.587138    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31d9b36-d03f-4b52-b79b-16bd08bd4773-webhook-cert podName:e31d9b36-d03f-4b52-b79b-16bd08bd4773 nodeName:}" failed. No retries permitted until 2026-07-23 13:13:36.087119 +0000 UTC m=+358.340644854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e31d9b36-d03f-4b52-b79b-16bd08bd4773-webhook-cert") pod "opendatahub-operator-controller-manager-779cfbfdf-2vc95" (UID: "e31d9b36-d03f-4b52-b79b-16bd08bd4773") : failed to sync secret cache: timed out waiting for the condition
Jul 23 13:13:35.587497 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:13:35.587152    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31d9b36-d03f-4b52-b79b-16bd08bd4773-apiservice-cert podName:e31d9b36-d03f-4b52-b79b-16bd08bd4773 nodeName:}" failed. No retries permitted until 2026-07-23 13:13:36.087145693 +0000 UTC m=+358.340671547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/e31d9b36-d03f-4b52-b79b-16bd08bd4773-apiservice-cert") pod "opendatahub-operator-controller-manager-779cfbfdf-2vc95" (UID: "e31d9b36-d03f-4b52-b79b-16bd08bd4773") : failed to sync secret cache: timed out waiting for the condition
Jul 23 13:13:35.599229 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:13:35.599208    2570 projected.go:291] Couldn't get configMap opendatahub/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 23 13:13:35.619172 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:35.619151    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 13:13:35.718273 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:35.718253    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 13:13:35.749544 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:35.749525    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 13:13:35.822049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:35.822029    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 13:13:35.830009 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:13:35.829980    2570 projected.go:196] Error preparing data for projected volume kube-api-access-zpmdl for pod opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95: failed to sync configmap cache: timed out waiting for the condition
Jul 23 13:13:35.830067 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:13:35.830051    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e31d9b36-d03f-4b52-b79b-16bd08bd4773-kube-api-access-zpmdl podName:e31d9b36-d03f-4b52-b79b-16bd08bd4773 nodeName:}" failed. No retries permitted until 2026-07-23 13:13:36.330035735 +0000 UTC m=+358.583561590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zpmdl" (UniqueName: "kubernetes.io/projected/e31d9b36-d03f-4b52-b79b-16bd08bd4773-kube-api-access-zpmdl") pod "opendatahub-operator-controller-manager-779cfbfdf-2vc95" (UID: "e31d9b36-d03f-4b52-b79b-16bd08bd4773") : failed to sync configmap cache: timed out waiting for the condition
Jul 23 13:13:35.866133 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:35.866075    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-md9mv\""
Jul 23 13:13:36.098281 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:36.098236    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e31d9b36-d03f-4b52-b79b-16bd08bd4773-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:36.098455 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:36.098302    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e31d9b36-d03f-4b52-b79b-16bd08bd4773-webhook-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:36.100721 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:36.100692    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e31d9b36-d03f-4b52-b79b-16bd08bd4773-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:36.100833 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:36.100800    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e31d9b36-d03f-4b52-b79b-16bd08bd4773-webhook-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:36.401575 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:36.401541    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpmdl\" (UniqueName: \"kubernetes.io/projected/e31d9b36-d03f-4b52-b79b-16bd08bd4773-kube-api-access-zpmdl\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:36.403905 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:36.403879    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpmdl\" (UniqueName: \"kubernetes.io/projected/e31d9b36-d03f-4b52-b79b-16bd08bd4773-kube-api-access-zpmdl\") pod \"opendatahub-operator-controller-manager-779cfbfdf-2vc95\" (UID: \"e31d9b36-d03f-4b52-b79b-16bd08bd4773\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:36.549330 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:36.549296    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:36.682489 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:36.682469    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"]
Jul 23 13:13:36.684885 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:13:36.684861    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31d9b36_d03f_4b52_b79b_16bd08bd4773.slice/crio-4a9e7190470154e80d8314d4cf4ccdd3faad4da2850240e6c10d9b30155f62d6 WatchSource:0}: Error finding container 4a9e7190470154e80d8314d4cf4ccdd3faad4da2850240e6c10d9b30155f62d6: Status 404 returned error can't find the container with id 4a9e7190470154e80d8314d4cf4ccdd3faad4da2850240e6c10d9b30155f62d6
Jul 23 13:13:36.877031 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:36.876977    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95" event={"ID":"e31d9b36-d03f-4b52-b79b-16bd08bd4773","Type":"ContainerStarted","Data":"4a9e7190470154e80d8314d4cf4ccdd3faad4da2850240e6c10d9b30155f62d6"}
Jul 23 13:13:39.893072 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:39.893033    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95" event={"ID":"e31d9b36-d03f-4b52-b79b-16bd08bd4773","Type":"ContainerStarted","Data":"ab2949df76d3e1b4570de72ddc9a38d94dfc8b0fe6d5ce24718fbb1e792736f6"}
Jul 23 13:13:40.166340 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:40.166301    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:40.898381 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:40.898348    2570 generic.go:356] "Generic (PLEG): container finished" podID="e31d9b36-d03f-4b52-b79b-16bd08bd4773" containerID="ab2949df76d3e1b4570de72ddc9a38d94dfc8b0fe6d5ce24718fbb1e792736f6" exitCode=0
Jul 23 13:13:40.898782 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:40.898394    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95" event={"ID":"e31d9b36-d03f-4b52-b79b-16bd08bd4773","Type":"ContainerDied","Data":"ab2949df76d3e1b4570de72ddc9a38d94dfc8b0fe6d5ce24718fbb1e792736f6"}
Jul 23 13:13:41.516122 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:41.516044    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:41.905096 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:41.905004    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95" event={"ID":"e31d9b36-d03f-4b52-b79b-16bd08bd4773","Type":"ContainerStarted","Data":"c04ca6d0d9fc7c0d76cb3e2a2a87a1ce8f46344eb73381cd21390a51b43ae802"}
Jul 23 13:13:41.905469 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:41.905099    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:41.932356 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:41.932291    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95" podStartSLOduration=3.49505284 podStartE2EDuration="7.932270758s" totalImagesPullingTime="3.346355897s" totalInitContainerRuntime="1.090862021s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:13:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:13:41.930637593 +0000 UTC m=+364.184163471" watchObservedRunningTime="2026-07-23 13:13:41.932270758 +0000 UTC m=+364.185796636"
Jul 23 13:13:50.531186 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:50.531156    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:52.912223 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:52.912192    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-2vc95"
Jul 23 13:13:56.806041 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:56.806005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:57.013045 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.013010    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:57.469995 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.469954    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:57.562553 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.562478    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"]
Jul 23 13:13:57.572070 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.570754    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"
Jul 23 13:13:57.576348 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.576324    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 13:13:57.577523 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.577500    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 13:13:57.577631 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.577513    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 13:13:57.577631 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.577509    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4vrkk\""
Jul 23 13:13:57.577754 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.577542    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 13:13:57.583721 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.583698    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"]
Jul 23 13:13:57.673894 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.673856    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4884757f-2975-4d5d-8f71-8afa241a7e2f-tmp\") pod \"kube-auth-proxy-69f7f7699f-rdtrp\" (UID: \"4884757f-2975-4d5d-8f71-8afa241a7e2f\") " pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"
Jul 23 13:13:57.674085 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.673923    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl8p8\" (UniqueName: \"kubernetes.io/projected/4884757f-2975-4d5d-8f71-8afa241a7e2f-kube-api-access-bl8p8\") pod \"kube-auth-proxy-69f7f7699f-rdtrp\" (UID: \"4884757f-2975-4d5d-8f71-8afa241a7e2f\") " pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"
Jul 23 13:13:57.674085 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.674010    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4884757f-2975-4d5d-8f71-8afa241a7e2f-tls-certs\") pod \"kube-auth-proxy-69f7f7699f-rdtrp\" (UID: \"4884757f-2975-4d5d-8f71-8afa241a7e2f\") " pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"
Jul 23 13:13:57.736819 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.736734    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:57.775330 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.775294    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4884757f-2975-4d5d-8f71-8afa241a7e2f-tmp\") pod \"kube-auth-proxy-69f7f7699f-rdtrp\" (UID: \"4884757f-2975-4d5d-8f71-8afa241a7e2f\") " pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"
Jul 23 13:13:57.775543 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.775341    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl8p8\" (UniqueName: \"kubernetes.io/projected/4884757f-2975-4d5d-8f71-8afa241a7e2f-kube-api-access-bl8p8\") pod \"kube-auth-proxy-69f7f7699f-rdtrp\" (UID: \"4884757f-2975-4d5d-8f71-8afa241a7e2f\") " pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"
Jul 23 13:13:57.775543 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.775364    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4884757f-2975-4d5d-8f71-8afa241a7e2f-tls-certs\") pod \"kube-auth-proxy-69f7f7699f-rdtrp\" (UID: \"4884757f-2975-4d5d-8f71-8afa241a7e2f\") " pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"
Jul 23 13:13:57.778311 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.778281    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4884757f-2975-4d5d-8f71-8afa241a7e2f-tmp\") pod \"kube-auth-proxy-69f7f7699f-rdtrp\" (UID: \"4884757f-2975-4d5d-8f71-8afa241a7e2f\") " pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"
Jul 23 13:13:57.778467 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.778451    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4884757f-2975-4d5d-8f71-8afa241a7e2f-tls-certs\") pod \"kube-auth-proxy-69f7f7699f-rdtrp\" (UID: \"4884757f-2975-4d5d-8f71-8afa241a7e2f\") " pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"
Jul 23 13:13:57.816096 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.816074    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl8p8\" (UniqueName: \"kubernetes.io/projected/4884757f-2975-4d5d-8f71-8afa241a7e2f-kube-api-access-bl8p8\") pod \"kube-auth-proxy-69f7f7699f-rdtrp\" (UID: \"4884757f-2975-4d5d-8f71-8afa241a7e2f\") " pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"
Jul 23 13:13:57.878757 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.878716    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:57.884843 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.884813    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"
Jul 23 13:13:57.966105 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:57.966071    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:58.020295 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:58.020272    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp"]
Jul 23 13:13:58.022770 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:13:58.022732    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4884757f_2975_4d5d_8f71_8afa241a7e2f.slice/crio-6a0f76eb56d5125e7cd1b2d885c0614698354865b0e1b655c5340f9a7bb99ca7 WatchSource:0}: Error finding container 6a0f76eb56d5125e7cd1b2d885c0614698354865b0e1b655c5340f9a7bb99ca7: Status 404 returned error can't find the container with id 6a0f76eb56d5125e7cd1b2d885c0614698354865b0e1b655c5340f9a7bb99ca7
Jul 23 13:13:58.073413 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:58.073379    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:58.956590 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:58.956544    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:58.980701 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:58.980649    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp" event={"ID":"4884757f-2975-4d5d-8f71-8afa241a7e2f","Type":"ContainerStarted","Data":"6a0f76eb56d5125e7cd1b2d885c0614698354865b0e1b655c5340f9a7bb99ca7"}
Jul 23 13:13:59.056711 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.056678    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:59.188255 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.188223    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:59.198637 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.198610    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"]
Jul 23 13:13:59.201109 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.201092    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.204343 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.204307    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 23 13:13:59.204714 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.204695    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sw685\""
Jul 23 13:13:59.204827 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.204714    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 23 13:13:59.205020 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.204978    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 23 13:13:59.205129 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.204977    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 13:13:59.218825 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.218803    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"]
Jul 23 13:13:59.282530 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.282485    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:13:59.389179 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.389143    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-cacerts\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.389344 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.389193    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.389344 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.389285    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-token\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.389344 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.389324    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-local-certs\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.389491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.389360    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.389491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.389381    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxwzz\" (UniqueName: \"kubernetes.io/projected/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-kube-api-access-lxwzz\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.389491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.389428    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.490863 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.490774    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-token\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.490863 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.490821    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-local-certs\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.490863 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.490848    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.491183 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.490963    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxwzz\" (UniqueName: \"kubernetes.io/projected/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-kube-api-access-lxwzz\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.491183 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.491036    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.491183 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.491077    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-cacerts\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.491183 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.491105    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.491718 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.491692    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.493227 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.493200    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-local-certs\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.493685 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.493661    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-cacerts\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.493767 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.493687    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.493767 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.493690    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.501127 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.501105    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-token\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.501441 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.501423    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxwzz\" (UniqueName: \"kubernetes.io/projected/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-kube-api-access-lxwzz\") pod \"istiod-openshift-gateway-7574459656-zlg7w\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.512186 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.512169    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:13:59.673675 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.673643    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"]
Jul 23 13:13:59.676475 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:13:59.676442    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc91fbe_9367_4c59_9198_bd1bf3bfa4cc.slice/crio-42ccc3a15ede4cd330198333c73858abbe03ab46e3fee38bbc1c0efcf197ec66 WatchSource:0}: Error finding container 42ccc3a15ede4cd330198333c73858abbe03ab46e3fee38bbc1c0efcf197ec66: Status 404 returned error can't find the container with id 42ccc3a15ede4cd330198333c73858abbe03ab46e3fee38bbc1c0efcf197ec66
Jul 23 13:13:59.987005 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:13:59.986954    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w" event={"ID":"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc","Type":"ContainerStarted","Data":"42ccc3a15ede4cd330198333c73858abbe03ab46e3fee38bbc1c0efcf197ec66"}
Jul 23 13:14:01.652404 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:01.652367    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:02.004228 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:02.003751    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp" event={"ID":"4884757f-2975-4d5d-8f71-8afa241a7e2f","Type":"ContainerStarted","Data":"4244954bc75bcbb206b73405f27281b4f7c9aa9d9ad24360731259f2c5bda507"}
Jul 23 13:14:02.027077 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:02.027020    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69f7f7699f-rdtrp" podStartSLOduration=1.873722125 podStartE2EDuration="5.026997813s" totalImagesPullingTime="3.153275688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:14:02.02505933 +0000 UTC m=+384.278585207" watchObservedRunningTime="2026-07-23 13:14:02.026997813 +0000 UTC m=+384.280523680"
Jul 23 13:14:03.551029 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:03.550968    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 13:14:03.551440 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:03.551073    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 13:14:04.015525 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:04.015484    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w" event={"ID":"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc","Type":"ContainerStarted","Data":"8c937d5c6b7ebf8a70478b7179e41b37ca74510c20a3eea793e6addd08e9b21d"}
Jul 23 13:14:04.015720 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:04.015647    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:14:04.017455 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:04.017425    2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-zlg7w container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 13:14:04.017583 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:04.017493    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w" podUID="dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 13:14:04.062002 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:04.061937    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w" podStartSLOduration=1.189668118 podStartE2EDuration="5.061921559s" totalImagesPullingTime="3.872253441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:14:04.060964693 +0000 UTC m=+386.314490581" watchObservedRunningTime="2026-07-23 13:14:04.061921559 +0000 UTC m=+386.315447435"
Jul 23 13:14:04.448200 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:04.448113    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:04.553514 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:04.553483    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:05.021352 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:05.021320    2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-zlg7w container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 13:14:05.021510 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:05.021384    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w" podUID="dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 13:14:05.332129 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:05.332039    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:05.523176 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:05.523141    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:05.668127 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:05.668043    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:06.688725 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.688685    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"]
Jul 23 13:14:06.692372 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.692355    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:06.701234 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.701213    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 13:14:06.702216 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.702196    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4qt5p\""
Jul 23 13:14:06.702304 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.702223    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 13:14:06.702304 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.702244    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 13:14:06.723193 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.723158    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"]
Jul 23 13:14:06.747556 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.747525    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd8aea5b-ba65-46dc-80d6-ae10b270f842-metrics-cert\") pod \"lws-controller-manager-789dbd6fbb-xj5kw\" (UID: \"bd8aea5b-ba65-46dc-80d6-ae10b270f842\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:06.747721 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.747586    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd8aea5b-ba65-46dc-80d6-ae10b270f842-cert\") pod \"lws-controller-manager-789dbd6fbb-xj5kw\" (UID: \"bd8aea5b-ba65-46dc-80d6-ae10b270f842\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:06.747721 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.747610    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bd8aea5b-ba65-46dc-80d6-ae10b270f842-manager-config\") pod \"lws-controller-manager-789dbd6fbb-xj5kw\" (UID: \"bd8aea5b-ba65-46dc-80d6-ae10b270f842\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:06.747721 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.747634    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxghw\" (UniqueName: \"kubernetes.io/projected/bd8aea5b-ba65-46dc-80d6-ae10b270f842-kube-api-access-cxghw\") pod \"lws-controller-manager-789dbd6fbb-xj5kw\" (UID: \"bd8aea5b-ba65-46dc-80d6-ae10b270f842\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:06.848368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.848334    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd8aea5b-ba65-46dc-80d6-ae10b270f842-metrics-cert\") pod \"lws-controller-manager-789dbd6fbb-xj5kw\" (UID: \"bd8aea5b-ba65-46dc-80d6-ae10b270f842\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:06.848534 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.848400    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd8aea5b-ba65-46dc-80d6-ae10b270f842-cert\") pod \"lws-controller-manager-789dbd6fbb-xj5kw\" (UID: \"bd8aea5b-ba65-46dc-80d6-ae10b270f842\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:06.848534 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.848429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bd8aea5b-ba65-46dc-80d6-ae10b270f842-manager-config\") pod \"lws-controller-manager-789dbd6fbb-xj5kw\" (UID: \"bd8aea5b-ba65-46dc-80d6-ae10b270f842\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:06.848534 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.848452    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxghw\" (UniqueName: \"kubernetes.io/projected/bd8aea5b-ba65-46dc-80d6-ae10b270f842-kube-api-access-cxghw\") pod \"lws-controller-manager-789dbd6fbb-xj5kw\" (UID: \"bd8aea5b-ba65-46dc-80d6-ae10b270f842\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:06.849221 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.849192    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bd8aea5b-ba65-46dc-80d6-ae10b270f842-manager-config\") pod \"lws-controller-manager-789dbd6fbb-xj5kw\" (UID: \"bd8aea5b-ba65-46dc-80d6-ae10b270f842\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:06.850847 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.850819    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd8aea5b-ba65-46dc-80d6-ae10b270f842-cert\") pod \"lws-controller-manager-789dbd6fbb-xj5kw\" (UID: \"bd8aea5b-ba65-46dc-80d6-ae10b270f842\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:06.850941 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.850879    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd8aea5b-ba65-46dc-80d6-ae10b270f842-metrics-cert\") pod \"lws-controller-manager-789dbd6fbb-xj5kw\" (UID: \"bd8aea5b-ba65-46dc-80d6-ae10b270f842\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:06.862586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:06.862563    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxghw\" (UniqueName: \"kubernetes.io/projected/bd8aea5b-ba65-46dc-80d6-ae10b270f842-kube-api-access-cxghw\") pod \"lws-controller-manager-789dbd6fbb-xj5kw\" (UID: \"bd8aea5b-ba65-46dc-80d6-ae10b270f842\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:07.001701 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:07.001664    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:07.141021 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:07.138755    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"]
Jul 23 13:14:08.021745 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:08.021710    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:14:08.036471 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:08.036428    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw" event={"ID":"bd8aea5b-ba65-46dc-80d6-ae10b270f842","Type":"ContainerStarted","Data":"e1a94ab2dd2878961ca46556d4a9af1f366b1ac7e16c4475287816f121763805"}
Jul 23 13:14:08.876678 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:08.876597    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:08.993181 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:08.993149    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:09.042231 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.042189    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw" event={"ID":"bd8aea5b-ba65-46dc-80d6-ae10b270f842","Type":"ContainerStarted","Data":"23065fd855c9fbb246422977c7e68026b8eea5d8bedb2fcc8ccbd07a7015505a"}
Jul 23 13:14:09.042609 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.042326    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:09.091228 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.091202    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:09.411251 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.411163    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw" podStartSLOduration=1.9696635279999999 podStartE2EDuration="3.411143509s" totalImagesPullingTime="1.441479981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:14:09.06532219 +0000 UTC m=+391.318848078" watchObservedRunningTime="2026-07-23 13:14:09.411143509 +0000 UTC m=+391.664669386"
Jul 23 13:14:09.412419 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.412398    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"]
Jul 23 13:14:09.412580 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.412560    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w" podUID="dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" containerName="discovery" containerID="cri-o://8c937d5c6b7ebf8a70478b7179e41b37ca74510c20a3eea793e6addd08e9b21d" gracePeriod=30
Jul 23 13:14:09.442264 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.441875    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:09.645850 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.645826    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:14:09.670485 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.670413    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-cacerts\") pod \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") "
Jul 23 13:14:09.670485 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.670460    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-csr-ca-configmap\") pod \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") "
Jul 23 13:14:09.670485 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.670491    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-kubeconfig\") pod \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") "
Jul 23 13:14:09.670701 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.670553    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-local-certs\") pod \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") "
Jul 23 13:14:09.670701 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.670585    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxwzz\" (UniqueName: \"kubernetes.io/projected/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-kube-api-access-lxwzz\") pod \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") "
Jul 23 13:14:09.670701 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.670616    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-token\") pod \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") "
Jul 23 13:14:09.670701 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.670646    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-csr-dns-cert\") pod \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\" (UID: \"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc\") "
Jul 23 13:14:09.670912 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.670880    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" (UID: "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:14:09.672848 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.672819    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-cacerts" (OuterVolumeSpecName: "cacerts") pod "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" (UID: "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:14:09.672848 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.672827    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" (UID: "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:14:09.673014 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.672974    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-kube-api-access-lxwzz" (OuterVolumeSpecName: "kube-api-access-lxwzz") pod "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" (UID: "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc"). InnerVolumeSpecName "kube-api-access-lxwzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:14:09.673112 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.673093    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" (UID: "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:14:09.673257 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.673234    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" (UID: "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:14:09.673257 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.673232    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-local-certs" (OuterVolumeSpecName: "local-certs") pod "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" (UID: "dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:14:09.772131 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.772089    2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-cacerts\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:14:09.772131 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.772128    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-csr-ca-configmap\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:14:09.772131 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.772138    2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-kubeconfig\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:14:09.772346 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.772149    2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-local-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:14:09.772346 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.772157    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxwzz\" (UniqueName: \"kubernetes.io/projected/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-kube-api-access-lxwzz\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:14:09.772346 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.772165    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-token\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:14:09.772346 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:09.772173    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc-istio-csr-dns-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:14:10.047685 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:10.047649    2570 generic.go:356] "Generic (PLEG): container finished" podID="dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" containerID="8c937d5c6b7ebf8a70478b7179e41b37ca74510c20a3eea793e6addd08e9b21d" exitCode=0
Jul 23 13:14:10.048142 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:10.047698    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"
Jul 23 13:14:10.048142 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:10.047729    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w" event={"ID":"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc","Type":"ContainerDied","Data":"8c937d5c6b7ebf8a70478b7179e41b37ca74510c20a3eea793e6addd08e9b21d"}
Jul 23 13:14:10.048142 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:10.047775    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w" event={"ID":"dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc","Type":"ContainerDied","Data":"42ccc3a15ede4cd330198333c73858abbe03ab46e3fee38bbc1c0efcf197ec66"}
Jul 23 13:14:10.048142 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:10.047795    2570 scope.go:117] "RemoveContainer" containerID="8c937d5c6b7ebf8a70478b7179e41b37ca74510c20a3eea793e6addd08e9b21d"
Jul 23 13:14:10.055716 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:10.055698    2570 scope.go:117] "RemoveContainer" containerID="8c937d5c6b7ebf8a70478b7179e41b37ca74510c20a3eea793e6addd08e9b21d"
Jul 23 13:14:10.055958 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:14:10.055941    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c937d5c6b7ebf8a70478b7179e41b37ca74510c20a3eea793e6addd08e9b21d\": container with ID starting with 8c937d5c6b7ebf8a70478b7179e41b37ca74510c20a3eea793e6addd08e9b21d not found: ID does not exist" containerID="8c937d5c6b7ebf8a70478b7179e41b37ca74510c20a3eea793e6addd08e9b21d"
Jul 23 13:14:10.056024 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:10.055967    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c937d5c6b7ebf8a70478b7179e41b37ca74510c20a3eea793e6addd08e9b21d"} err="failed to get container status \"8c937d5c6b7ebf8a70478b7179e41b37ca74510c20a3eea793e6addd08e9b21d\": rpc error: code = NotFound desc = could not find container \"8c937d5c6b7ebf8a70478b7179e41b37ca74510c20a3eea793e6addd08e9b21d\": container with ID starting with 8c937d5c6b7ebf8a70478b7179e41b37ca74510c20a3eea793e6addd08e9b21d not found: ID does not exist"
Jul 23 13:14:10.076164 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:10.076143    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"]
Jul 23 13:14:10.084652 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:10.082558    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zlg7w"]
Jul 23 13:14:10.197521 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:10.197493    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:10.357407 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:10.357335    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" path="/var/lib/kubelet/pods/dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc/volumes"
Jul 23 13:14:10.550762 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:10.550729    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:20.051065 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:20.051034    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-xj5kw"
Jul 23 13:14:22.625741 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:22.625707    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:58.302335 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:58.302297    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:58.404864 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:58.404827    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:14:59.752951 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:14:59.752880    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:02.620074 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:02.620040    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:23.970689 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:23.970653    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:24.071639 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:24.071605    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:24.253831 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:24.253749    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:24.320329 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:24.320300    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:29.386812 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:29.386779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:30.979226 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:30.979194    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:32.550009 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:32.549956    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:32.933110 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:32.933023    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:34.057134 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:34.057104    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:34.160670 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:34.160639    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:35.473610 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:35.473544    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:37.248183 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.248146    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7mzcq"]
Jul 23 13:15:37.248568 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.248414    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" containerName="discovery"
Jul 23 13:15:37.248568 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.248424    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" containerName="discovery"
Jul 23 13:15:37.248568 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.248484    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcc91fbe-9367-4c59-9198-bd1bf3bfa4cc" containerName="discovery"
Jul 23 13:15:37.250214 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.250199    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7mzcq"
Jul 23 13:15:37.253132 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.253115    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7vx8t\""
Jul 23 13:15:37.253651 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.253638    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 23 13:15:37.253737 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.253718    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 13:15:37.254065 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.254052    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 13:15:37.262596 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.262574    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7mzcq"]
Jul 23 13:15:37.325755 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.325719    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:37.363411 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.363390    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47qns\" (UniqueName: \"kubernetes.io/projected/356e3ed2-c8b1-42fc-96bd-7a6ba996ef02-kube-api-access-47qns\") pod \"dns-operator-controller-manager-864dd78c4c-7mzcq\" (UID: \"356e3ed2-c8b1-42fc-96bd-7a6ba996ef02\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7mzcq"
Jul 23 13:15:37.430202 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.430179    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:37.463893 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.463863    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47qns\" (UniqueName: \"kubernetes.io/projected/356e3ed2-c8b1-42fc-96bd-7a6ba996ef02-kube-api-access-47qns\") pod \"dns-operator-controller-manager-864dd78c4c-7mzcq\" (UID: \"356e3ed2-c8b1-42fc-96bd-7a6ba996ef02\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7mzcq"
Jul 23 13:15:37.478230 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.478195    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47qns\" (UniqueName: \"kubernetes.io/projected/356e3ed2-c8b1-42fc-96bd-7a6ba996ef02-kube-api-access-47qns\") pod \"dns-operator-controller-manager-864dd78c4c-7mzcq\" (UID: \"356e3ed2-c8b1-42fc-96bd-7a6ba996ef02\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7mzcq"
Jul 23 13:15:37.559887 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.559819    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7mzcq"
Jul 23 13:15:37.692289 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.692265    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7mzcq"]
Jul 23 13:15:37.694469 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:15:37.694433    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356e3ed2_c8b1_42fc_96bd_7a6ba996ef02.slice/crio-c17292bbfe1afa2527806613a22c7b2fb6f26dc0965bff7d79cd3b4389e3e31b WatchSource:0}: Error finding container c17292bbfe1afa2527806613a22c7b2fb6f26dc0965bff7d79cd3b4389e3e31b: Status 404 returned error can't find the container with id c17292bbfe1afa2527806613a22c7b2fb6f26dc0965bff7d79cd3b4389e3e31b
Jul 23 13:15:37.748254 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:37.748230    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:38.395840 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:38.395804    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7mzcq" event={"ID":"356e3ed2-c8b1-42fc-96bd-7a6ba996ef02","Type":"ContainerStarted","Data":"c17292bbfe1afa2527806613a22c7b2fb6f26dc0965bff7d79cd3b4389e3e31b"}
Jul 23 13:15:39.104637 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:39.104600    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"]
Jul 23 13:15:39.107488 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:39.107472    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:15:39.110355 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:39.110335    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-t5wv8\""
Jul 23 13:15:39.128040 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:39.128012    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"]
Jul 23 13:15:39.177445 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:39.177414    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf24g\" (UniqueName: \"kubernetes.io/projected/0b3735fc-15ef-4b9f-9145-7e5b0882e4a5-kube-api-access-wf24g\") pod \"limitador-operator-controller-manager-859d7b78bd-lc5d8\" (UID: \"0b3735fc-15ef-4b9f-9145-7e5b0882e4a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:15:39.278305 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:39.278275    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf24g\" (UniqueName: \"kubernetes.io/projected/0b3735fc-15ef-4b9f-9145-7e5b0882e4a5-kube-api-access-wf24g\") pod \"limitador-operator-controller-manager-859d7b78bd-lc5d8\" (UID: \"0b3735fc-15ef-4b9f-9145-7e5b0882e4a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:15:39.289389 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:39.289365    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf24g\" (UniqueName: \"kubernetes.io/projected/0b3735fc-15ef-4b9f-9145-7e5b0882e4a5-kube-api-access-wf24g\") pod \"limitador-operator-controller-manager-859d7b78bd-lc5d8\" (UID: \"0b3735fc-15ef-4b9f-9145-7e5b0882e4a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:15:39.417230 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:39.417156    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:15:39.577858 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:39.577778    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"]
Jul 23 13:15:39.594344 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:39.594295    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:39.622582 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:15:39.622554    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3735fc_15ef_4b9f_9145_7e5b0882e4a5.slice/crio-6116e14580599ce22b1ac8817a7ec6ade191a8898f1f225c98ccf33fb8ca3c7b WatchSource:0}: Error finding container 6116e14580599ce22b1ac8817a7ec6ade191a8898f1f225c98ccf33fb8ca3c7b: Status 404 returned error can't find the container with id 6116e14580599ce22b1ac8817a7ec6ade191a8898f1f225c98ccf33fb8ca3c7b
Jul 23 13:15:40.407440 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:40.407401    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8" event={"ID":"0b3735fc-15ef-4b9f-9145-7e5b0882e4a5","Type":"ContainerStarted","Data":"6116e14580599ce22b1ac8817a7ec6ade191a8898f1f225c98ccf33fb8ca3c7b"}
Jul 23 13:15:41.006911 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.006879    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"]
Jul 23 13:15:41.010065 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.010045    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"
Jul 23 13:15:41.012472 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.012446    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 23 13:15:41.013091 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.013073    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 23 13:15:41.013382 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.013365    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5jhxm\""
Jul 23 13:15:41.018104 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.018080    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"]
Jul 23 13:15:41.018549 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.018529    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:41.096607 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.096574    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/acfa9d88-ff6a-49aa-abf1-eeff20285ab1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9cj94\" (UID: \"acfa9d88-ff6a-49aa-abf1-eeff20285ab1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"
Jul 23 13:15:41.096768 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.096654    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44ftg\" (UniqueName: \"kubernetes.io/projected/acfa9d88-ff6a-49aa-abf1-eeff20285ab1-kube-api-access-44ftg\") pod \"kuadrant-console-plugin-66b5774985-9cj94\" (UID: \"acfa9d88-ff6a-49aa-abf1-eeff20285ab1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"
Jul 23 13:15:41.096768 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.096722    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acfa9d88-ff6a-49aa-abf1-eeff20285ab1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9cj94\" (UID: \"acfa9d88-ff6a-49aa-abf1-eeff20285ab1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"
Jul 23 13:15:41.198076 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.198039    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44ftg\" (UniqueName: \"kubernetes.io/projected/acfa9d88-ff6a-49aa-abf1-eeff20285ab1-kube-api-access-44ftg\") pod \"kuadrant-console-plugin-66b5774985-9cj94\" (UID: \"acfa9d88-ff6a-49aa-abf1-eeff20285ab1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"
Jul 23 13:15:41.198229 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.198099    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acfa9d88-ff6a-49aa-abf1-eeff20285ab1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9cj94\" (UID: \"acfa9d88-ff6a-49aa-abf1-eeff20285ab1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"
Jul 23 13:15:41.198229 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.198132    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/acfa9d88-ff6a-49aa-abf1-eeff20285ab1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9cj94\" (UID: \"acfa9d88-ff6a-49aa-abf1-eeff20285ab1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"
Jul 23 13:15:41.198300 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:15:41.198228    2570 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 23 13:15:41.198300 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:15:41.198289    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acfa9d88-ff6a-49aa-abf1-eeff20285ab1-plugin-serving-cert podName:acfa9d88-ff6a-49aa-abf1-eeff20285ab1 nodeName:}" failed. No retries permitted until 2026-07-23 13:15:41.698268824 +0000 UTC m=+483.951794694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/acfa9d88-ff6a-49aa-abf1-eeff20285ab1-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9cj94" (UID: "acfa9d88-ff6a-49aa-abf1-eeff20285ab1") : secret "plugin-serving-cert" not found
Jul 23 13:15:41.198716 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.198698    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acfa9d88-ff6a-49aa-abf1-eeff20285ab1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9cj94\" (UID: \"acfa9d88-ff6a-49aa-abf1-eeff20285ab1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"
Jul 23 13:15:41.206583 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.206563    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44ftg\" (UniqueName: \"kubernetes.io/projected/acfa9d88-ff6a-49aa-abf1-eeff20285ab1-kube-api-access-44ftg\") pod \"kuadrant-console-plugin-66b5774985-9cj94\" (UID: \"acfa9d88-ff6a-49aa-abf1-eeff20285ab1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"
Jul 23 13:15:41.386054 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.385970    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:41.642650 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.642561    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:41.701815 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.701783    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/acfa9d88-ff6a-49aa-abf1-eeff20285ab1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9cj94\" (UID: \"acfa9d88-ff6a-49aa-abf1-eeff20285ab1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"
Jul 23 13:15:41.703934 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.703911    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/acfa9d88-ff6a-49aa-abf1-eeff20285ab1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9cj94\" (UID: \"acfa9d88-ff6a-49aa-abf1-eeff20285ab1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"
Jul 23 13:15:41.717644 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.717617    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:41.921739 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:41.921668    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"
Jul 23 13:15:42.268092 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:42.268070    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 23 13:15:42.339745 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:42.339721    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94"]
Jul 23 13:15:42.342470 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:15:42.342444    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacfa9d88_ff6a_49aa_abf1_eeff20285ab1.slice/crio-5d1fd8a649054db0e5675172311f350428749c4e3dde8ed43b817ece2f715e13 WatchSource:0}: Error finding container 5d1fd8a649054db0e5675172311f350428749c4e3dde8ed43b817ece2f715e13: Status 404 returned error can't find the container with id 5d1fd8a649054db0e5675172311f350428749c4e3dde8ed43b817ece2f715e13
Jul 23 13:15:42.417957 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:42.417917    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7mzcq" event={"ID":"356e3ed2-c8b1-42fc-96bd-7a6ba996ef02","Type":"ContainerStarted","Data":"e9cc46ac89c832522124203b9cd97cb4ada59e461b7ee9c0f1d409b6ab1d0fba"}
Jul 23 13:15:42.418144 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:42.418054    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7mzcq"
Jul 23 13:15:42.419485 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:42.419456    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8" event={"ID":"0b3735fc-15ef-4b9f-9145-7e5b0882e4a5","Type":"ContainerStarted","Data":"3a8e1b9125a8a0ebf5e6519978bf45fdf1e953236d2a2f405c945c73ffc19e2c"}
Jul 23 13:15:42.419590 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:42.419515    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:15:42.420502 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:42.420483    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94" event={"ID":"acfa9d88-ff6a-49aa-abf1-eeff20285ab1","Type":"ContainerStarted","Data":"5d1fd8a649054db0e5675172311f350428749c4e3dde8ed43b817ece2f715e13"}
Jul 23 13:15:42.435715 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:42.435672    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7mzcq" podStartSLOduration=0.867222465 podStartE2EDuration="5.435659323s" totalImagesPullingTime="4.568436858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:15:42.43516912 +0000 UTC m=+484.688694997" watchObservedRunningTime="2026-07-23 13:15:42.435659323 +0000 UTC m=+484.689185273"
Jul 23 13:15:42.457317 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:42.457274    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8" podStartSLOduration=0.870003986 podStartE2EDuration="3.457258925s" totalImagesPullingTime="2.587254939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:15:42.457013375 +0000 UTC m=+484.710539253" watchObservedRunningTime="2026-07-23 13:15:42.457258925 +0000 UTC m=+484.710784800"
Jul 23 13:15:50.987477 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:50.987445    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:51.093885 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:51.093850    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:51.346921 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:51.346833    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:51.447860 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:51.447832    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:51.715941 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:51.715907    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"]
Jul 23 13:15:51.716177 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:51.716144    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8" podUID="0b3735fc-15ef-4b9f-9145-7e5b0882e4a5" containerName="manager" containerID="cri-o://3a8e1b9125a8a0ebf5e6519978bf45fdf1e953236d2a2f405c945c73ffc19e2c" gracePeriod=2
Jul 23 13:15:51.718032 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:51.718012    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:15:51.735621 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:15:51.731395    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lc5d8\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="0b3735fc-15ef-4b9f-9145-7e5b0882e4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:15:51.735621 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:51.733786    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"]
Jul 23 13:15:52.820654 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:52.820614    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"]
Jul 23 13:15:52.821034 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:52.821015    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b3735fc-15ef-4b9f-9145-7e5b0882e4a5" containerName="manager"
Jul 23 13:15:52.821034 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:52.821028    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b3735fc-15ef-4b9f-9145-7e5b0882e4a5" containerName="manager"
Jul 23 13:15:52.821135 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:52.821103    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b3735fc-15ef-4b9f-9145-7e5b0882e4a5" containerName="manager"
Jul 23 13:15:52.840568 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:52.840371    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"
Jul 23 13:15:52.841526 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:52.841498    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"]
Jul 23 13:15:52.843360 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:52.843257    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-q5mc4\""
Jul 23 13:15:53.009655 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:53.009615    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4991cc8b-037e-4d9a-8ab2-ac7258ec0be3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k488n\" (UID: \"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"
Jul 23 13:15:53.009827 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:53.009674    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhkzc\" (UniqueName: \"kubernetes.io/projected/4991cc8b-037e-4d9a-8ab2-ac7258ec0be3-kube-api-access-fhkzc\") pod \"kuadrant-operator-controller-manager-86878c769f-k488n\" (UID: \"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"
Jul 23 13:15:53.110323 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:53.110248    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4991cc8b-037e-4d9a-8ab2-ac7258ec0be3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k488n\" (UID: \"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"
Jul 23 13:15:53.110323 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:53.110315    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhkzc\" (UniqueName: \"kubernetes.io/projected/4991cc8b-037e-4d9a-8ab2-ac7258ec0be3-kube-api-access-fhkzc\") pod \"kuadrant-operator-controller-manager-86878c769f-k488n\" (UID: \"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"
Jul 23 13:15:53.110734 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:53.110693    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4991cc8b-037e-4d9a-8ab2-ac7258ec0be3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k488n\" (UID: \"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"
Jul 23 13:15:53.129631 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:53.129600    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhkzc\" (UniqueName: \"kubernetes.io/projected/4991cc8b-037e-4d9a-8ab2-ac7258ec0be3-kube-api-access-fhkzc\") pod \"kuadrant-operator-controller-manager-86878c769f-k488n\" (UID: \"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"
Jul 23 13:15:53.154380 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:53.154354    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"
Jul 23 13:15:53.428586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:53.428503    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7mzcq"
Jul 23 13:15:54.809760 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:54.809686    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:56.593881 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:56.593826    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:58.873281 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:58.873245    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:58.934553 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:58.934518    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:59.310194 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:59.310150    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:15:59.407488 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:15:59.407454    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:01.992894 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:01.992867    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:02.091172 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:02.091142    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:04.492921 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:04.492893    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"]
Jul 23 13:16:04.494245 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:16:04.494220    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4991cc8b_037e_4d9a_8ab2_ac7258ec0be3.slice/crio-432b4bb44740b9df46c7741b32b18693f39369958da08ec478f7e13759e31de8 WatchSource:0}: Error finding container 432b4bb44740b9df46c7741b32b18693f39369958da08ec478f7e13759e31de8: Status 404 returned error can't find the container with id 432b4bb44740b9df46c7741b32b18693f39369958da08ec478f7e13759e31de8
Jul 23 13:16:04.502733 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:04.502712    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:16:04.505017 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:16:04.504973    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lc5d8\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="0b3735fc-15ef-4b9f-9145-7e5b0882e4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:16:04.517359 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:04.517337    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf24g\" (UniqueName: \"kubernetes.io/projected/0b3735fc-15ef-4b9f-9145-7e5b0882e4a5-kube-api-access-wf24g\") pod \"0b3735fc-15ef-4b9f-9145-7e5b0882e4a5\" (UID: \"0b3735fc-15ef-4b9f-9145-7e5b0882e4a5\") "
Jul 23 13:16:04.519495 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:04.519466    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b3735fc-15ef-4b9f-9145-7e5b0882e4a5-kube-api-access-wf24g" (OuterVolumeSpecName: "kube-api-access-wf24g") pod "0b3735fc-15ef-4b9f-9145-7e5b0882e4a5" (UID: "0b3735fc-15ef-4b9f-9145-7e5b0882e4a5"). InnerVolumeSpecName "kube-api-access-wf24g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:16:04.538361 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:04.538330    2570 generic.go:356] "Generic (PLEG): container finished" podID="0b3735fc-15ef-4b9f-9145-7e5b0882e4a5" containerID="3a8e1b9125a8a0ebf5e6519978bf45fdf1e953236d2a2f405c945c73ffc19e2c" exitCode=0
Jul 23 13:16:04.538474 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:04.538370    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:16:04.538474 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:04.538431    2570 scope.go:117] "RemoveContainer" containerID="3a8e1b9125a8a0ebf5e6519978bf45fdf1e953236d2a2f405c945c73ffc19e2c"
Jul 23 13:16:04.542941 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:16:04.542911    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lc5d8\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="0b3735fc-15ef-4b9f-9145-7e5b0882e4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:16:04.548299 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:04.548266    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n" event={"ID":"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3","Type":"ContainerStarted","Data":"432b4bb44740b9df46c7741b32b18693f39369958da08ec478f7e13759e31de8"}
Jul 23 13:16:04.553194 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:16:04.553170    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lc5d8\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="0b3735fc-15ef-4b9f-9145-7e5b0882e4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:16:04.558312 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:04.558289    2570 scope.go:117] "RemoveContainer" containerID="3a8e1b9125a8a0ebf5e6519978bf45fdf1e953236d2a2f405c945c73ffc19e2c"
Jul 23 13:16:04.558709 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:16:04.558689    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a8e1b9125a8a0ebf5e6519978bf45fdf1e953236d2a2f405c945c73ffc19e2c\": container with ID starting with 3a8e1b9125a8a0ebf5e6519978bf45fdf1e953236d2a2f405c945c73ffc19e2c not found: ID does not exist" containerID="3a8e1b9125a8a0ebf5e6519978bf45fdf1e953236d2a2f405c945c73ffc19e2c"
Jul 23 13:16:04.558797 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:04.558714    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8e1b9125a8a0ebf5e6519978bf45fdf1e953236d2a2f405c945c73ffc19e2c"} err="failed to get container status \"3a8e1b9125a8a0ebf5e6519978bf45fdf1e953236d2a2f405c945c73ffc19e2c\": rpc error: code = NotFound desc = could not find container \"3a8e1b9125a8a0ebf5e6519978bf45fdf1e953236d2a2f405c945c73ffc19e2c\": container with ID starting with 3a8e1b9125a8a0ebf5e6519978bf45fdf1e953236d2a2f405c945c73ffc19e2c not found: ID does not exist"
Jul 23 13:16:04.618745 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:04.618721    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf24g\" (UniqueName: \"kubernetes.io/projected/0b3735fc-15ef-4b9f-9145-7e5b0882e4a5-kube-api-access-wf24g\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:16:05.555801 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:05.555764    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94" event={"ID":"acfa9d88-ff6a-49aa-abf1-eeff20285ab1","Type":"ContainerStarted","Data":"9c2b96e7de0469c521040c4676752562698c20a6f90419a60aaca9f16f36196a"}
Jul 23 13:16:05.558453 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:16:05.558425    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lc5d8\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="0b3735fc-15ef-4b9f-9145-7e5b0882e4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lc5d8"
Jul 23 13:16:05.577291 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:05.577235    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9cj94" podStartSLOduration=3.401902049 podStartE2EDuration="25.577214449s" totalImagesPullingTime="22.1753124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:16:05.576070193 +0000 UTC m=+507.829596072" watchObservedRunningTime="2026-07-23 13:16:05.577214449 +0000 UTC m=+507.830740326"
Jul 23 13:16:06.357796 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:06.357765    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b3735fc-15ef-4b9f-9145-7e5b0882e4a5" path="/var/lib/kubelet/pods/0b3735fc-15ef-4b9f-9145-7e5b0882e4a5/volumes"
Jul 23 13:16:09.576744 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:09.576706    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n" event={"ID":"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3","Type":"ContainerStarted","Data":"0572ac1d2f0c226b5de4acc8008ffbd924ebcde73b4e45917453c820c10be884"}
Jul 23 13:16:09.577267 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:09.576834    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"
Jul 23 13:16:09.601815 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:09.601761    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n" podStartSLOduration=13.481538014 podStartE2EDuration="17.601745581s" totalImagesPullingTime="4.120207567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:16:09.599066974 +0000 UTC m=+511.852592846" watchObservedRunningTime="2026-07-23 13:16:09.601745581 +0000 UTC m=+511.855271457"
Jul 23 13:16:10.674386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:10.674354    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:10.771350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:10.771319    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:13.118672 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:13.118642    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:13.179490 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:13.179462    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:15.313366 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:15.313332    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:15.369508 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:15.369482    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:17.907725 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:17.907692    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:18.401187 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:18.401157    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:20.583038 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:20.583008    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"
Jul 23 13:16:22.090110 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:22.090079    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:22.280423 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:22.280396    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:29.261328 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:29.261291    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:29.363293 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:29.363253    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:31.090234 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:31.090203    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:31.200838 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:31.200807    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:33.656436 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:33.656401    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:33.715930 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:33.715898    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:37.095996 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:37.095913    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:37.171004 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:37.170954    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:38.285375 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:38.285339    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:39.044630 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:39.044597    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:40.796571 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:40.796533    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:40.892007 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:40.891957    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:41.002133 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.002101    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:41.587917 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.587886    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-ztp4n"]
Jul 23 13:16:41.625892 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.625858    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:41.658786 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.658754    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ztp4n"]
Jul 23 13:16:41.658938 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.658796    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7vbtc"]
Jul 23 13:16:41.658938 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.658873    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ztp4n"
Jul 23 13:16:41.661582 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.661564    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rg6f4\""
Jul 23 13:16:41.661839 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.661825    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7vbtc"]
Jul 23 13:16:41.661903 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.661893    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7vbtc"
Jul 23 13:16:41.820397 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.820359    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gs4m\" (UniqueName: \"kubernetes.io/projected/2be715cc-58fc-4ad5-909f-7860fd9e2320-kube-api-access-7gs4m\") pod \"authorino-75d556bd77-7vbtc\" (UID: \"2be715cc-58fc-4ad5-909f-7860fd9e2320\") " pod="kuadrant-system/authorino-75d556bd77-7vbtc"
Jul 23 13:16:41.820749 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.820422    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv2v6\" (UniqueName: \"kubernetes.io/projected/053067a1-c4dd-4776-bb32-177b0478be98-kube-api-access-vv2v6\") pod \"authorino-58cd955675-ztp4n\" (UID: \"053067a1-c4dd-4776-bb32-177b0478be98\") " pod="kuadrant-system/authorino-58cd955675-ztp4n"
Jul 23 13:16:41.921221 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.921142    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gs4m\" (UniqueName: \"kubernetes.io/projected/2be715cc-58fc-4ad5-909f-7860fd9e2320-kube-api-access-7gs4m\") pod \"authorino-75d556bd77-7vbtc\" (UID: \"2be715cc-58fc-4ad5-909f-7860fd9e2320\") " pod="kuadrant-system/authorino-75d556bd77-7vbtc"
Jul 23 13:16:41.921221 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.921210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv2v6\" (UniqueName: \"kubernetes.io/projected/053067a1-c4dd-4776-bb32-177b0478be98-kube-api-access-vv2v6\") pod \"authorino-58cd955675-ztp4n\" (UID: \"053067a1-c4dd-4776-bb32-177b0478be98\") " pod="kuadrant-system/authorino-58cd955675-ztp4n"
Jul 23 13:16:41.933452 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.933426    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv2v6\" (UniqueName: \"kubernetes.io/projected/053067a1-c4dd-4776-bb32-177b0478be98-kube-api-access-vv2v6\") pod \"authorino-58cd955675-ztp4n\" (UID: \"053067a1-c4dd-4776-bb32-177b0478be98\") " pod="kuadrant-system/authorino-58cd955675-ztp4n"
Jul 23 13:16:41.933570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.933503    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gs4m\" (UniqueName: \"kubernetes.io/projected/2be715cc-58fc-4ad5-909f-7860fd9e2320-kube-api-access-7gs4m\") pod \"authorino-75d556bd77-7vbtc\" (UID: \"2be715cc-58fc-4ad5-909f-7860fd9e2320\") " pod="kuadrant-system/authorino-75d556bd77-7vbtc"
Jul 23 13:16:41.972398 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.972375    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ztp4n"
Jul 23 13:16:41.977480 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:41.977464    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7vbtc"
Jul 23 13:16:42.112071 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:42.111963    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ztp4n"]
Jul 23 13:16:42.114644 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:16:42.114611    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod053067a1_c4dd_4776_bb32_177b0478be98.slice/crio-6de2a5ad5c38f8a2834fbc0c17f8dd935874b2532896c6645035fb8312cb60f3 WatchSource:0}: Error finding container 6de2a5ad5c38f8a2834fbc0c17f8dd935874b2532896c6645035fb8312cb60f3: Status 404 returned error can't find the container with id 6de2a5ad5c38f8a2834fbc0c17f8dd935874b2532896c6645035fb8312cb60f3
Jul 23 13:16:42.131108 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:42.131088    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7vbtc"]
Jul 23 13:16:42.132792 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:16:42.132758    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2be715cc_58fc_4ad5_909f_7860fd9e2320.slice/crio-02fdabb08bb94d943e61b53586e9afce1260263b7b2b2dbe3e7b62de9c53c1c3 WatchSource:0}: Error finding container 02fdabb08bb94d943e61b53586e9afce1260263b7b2b2dbe3e7b62de9c53c1c3: Status 404 returned error can't find the container with id 02fdabb08bb94d943e61b53586e9afce1260263b7b2b2dbe3e7b62de9c53c1c3
Jul 23 13:16:42.194218 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:42.194156    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:16:42.718691 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:42.718658    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7vbtc" event={"ID":"2be715cc-58fc-4ad5-909f-7860fd9e2320","Type":"ContainerStarted","Data":"02fdabb08bb94d943e61b53586e9afce1260263b7b2b2dbe3e7b62de9c53c1c3"}
Jul 23 13:16:42.719639 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:42.719620    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ztp4n" event={"ID":"053067a1-c4dd-4776-bb32-177b0478be98","Type":"ContainerStarted","Data":"6de2a5ad5c38f8a2834fbc0c17f8dd935874b2532896c6645035fb8312cb60f3"}
Jul 23 13:16:46.748445 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:46.748406    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7vbtc" event={"ID":"2be715cc-58fc-4ad5-909f-7860fd9e2320","Type":"ContainerStarted","Data":"93110cc0c7cfe5022f9be824c039ca1c6de3aa4d5de5d6feacb5758bc8b5941d"}
Jul 23 13:16:46.749735 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:46.749711    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ztp4n" event={"ID":"053067a1-c4dd-4776-bb32-177b0478be98","Type":"ContainerStarted","Data":"8c5d3bf6356359c012f72b98f3fef55dc77c3541a10786db974dc68873d3fec6"}
Jul 23 13:16:46.769962 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:46.769919    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7vbtc" podStartSLOduration=2.182361625 podStartE2EDuration="5.76990617s" totalImagesPullingTime="3.587544545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:16:46.768520819 +0000 UTC m=+549.022046696" watchObservedRunningTime="2026-07-23 13:16:46.76990617 +0000 UTC m=+549.023432046"
Jul 23 13:16:46.792492 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:46.792444    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-ztp4n" podStartSLOduration=2.176642502 podStartE2EDuration="5.792430316s" totalImagesPullingTime="3.615787814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:16:46.790489119 +0000 UTC m=+549.044014998" watchObservedRunningTime="2026-07-23 13:16:46.792430316 +0000 UTC m=+549.045956192"
Jul 23 13:16:46.836858 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:46.836829    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ztp4n"]
Jul 23 13:16:48.758706 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:48.758650    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-ztp4n" podUID="053067a1-c4dd-4776-bb32-177b0478be98" containerName="authorino" containerID="cri-o://8c5d3bf6356359c012f72b98f3fef55dc77c3541a10786db974dc68873d3fec6" gracePeriod=30
Jul 23 13:16:49.001221 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:49.001200    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ztp4n"
Jul 23 13:16:49.180396 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:49.180297    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv2v6\" (UniqueName: \"kubernetes.io/projected/053067a1-c4dd-4776-bb32-177b0478be98-kube-api-access-vv2v6\") pod \"053067a1-c4dd-4776-bb32-177b0478be98\" (UID: \"053067a1-c4dd-4776-bb32-177b0478be98\") "
Jul 23 13:16:49.182286 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:49.182261    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/053067a1-c4dd-4776-bb32-177b0478be98-kube-api-access-vv2v6" (OuterVolumeSpecName: "kube-api-access-vv2v6") pod "053067a1-c4dd-4776-bb32-177b0478be98" (UID: "053067a1-c4dd-4776-bb32-177b0478be98"). InnerVolumeSpecName "kube-api-access-vv2v6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:16:49.281855 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:49.281817    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv2v6\" (UniqueName: \"kubernetes.io/projected/053067a1-c4dd-4776-bb32-177b0478be98-kube-api-access-vv2v6\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:16:49.763693 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:49.763655    2570 generic.go:356] "Generic (PLEG): container finished" podID="053067a1-c4dd-4776-bb32-177b0478be98" containerID="8c5d3bf6356359c012f72b98f3fef55dc77c3541a10786db974dc68873d3fec6" exitCode=0
Jul 23 13:16:49.763693 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:49.763697    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ztp4n"
Jul 23 13:16:49.764243 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:49.763747    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ztp4n" event={"ID":"053067a1-c4dd-4776-bb32-177b0478be98","Type":"ContainerDied","Data":"8c5d3bf6356359c012f72b98f3fef55dc77c3541a10786db974dc68873d3fec6"}
Jul 23 13:16:49.764243 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:49.763801    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ztp4n" event={"ID":"053067a1-c4dd-4776-bb32-177b0478be98","Type":"ContainerDied","Data":"6de2a5ad5c38f8a2834fbc0c17f8dd935874b2532896c6645035fb8312cb60f3"}
Jul 23 13:16:49.764243 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:49.763826    2570 scope.go:117] "RemoveContainer" containerID="8c5d3bf6356359c012f72b98f3fef55dc77c3541a10786db974dc68873d3fec6"
Jul 23 13:16:49.771822 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:49.771804    2570 scope.go:117] "RemoveContainer" containerID="8c5d3bf6356359c012f72b98f3fef55dc77c3541a10786db974dc68873d3fec6"
Jul 23 13:16:49.772072 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:16:49.772052    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c5d3bf6356359c012f72b98f3fef55dc77c3541a10786db974dc68873d3fec6\": container with ID starting with 8c5d3bf6356359c012f72b98f3fef55dc77c3541a10786db974dc68873d3fec6 not found: ID does not exist" containerID="8c5d3bf6356359c012f72b98f3fef55dc77c3541a10786db974dc68873d3fec6"
Jul 23 13:16:49.772129 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:49.772081    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c5d3bf6356359c012f72b98f3fef55dc77c3541a10786db974dc68873d3fec6"} err="failed to get container status \"8c5d3bf6356359c012f72b98f3fef55dc77c3541a10786db974dc68873d3fec6\": rpc error: code = NotFound desc = could not find container \"8c5d3bf6356359c012f72b98f3fef55dc77c3541a10786db974dc68873d3fec6\": container with ID starting with 8c5d3bf6356359c012f72b98f3fef55dc77c3541a10786db974dc68873d3fec6 not found: ID does not exist"
Jul 23 13:16:49.790209 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:49.790184    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ztp4n"]
Jul 23 13:16:49.791455 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:49.791435    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-ztp4n"]
Jul 23 13:16:50.357579 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:16:50.357542    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="053067a1-c4dd-4776-bb32-177b0478be98" path="/var/lib/kubelet/pods/053067a1-c4dd-4776-bb32-177b0478be98/volumes"
Jul 23 13:17:00.350474 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:00.350431    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:17:00.456736 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:00.456708    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:17:00.872906 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:00.872870    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:17:12.791718 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:12.791680    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:17:13.032338 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.032301    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r5xbs"]
Jul 23 13:17:13.032627 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.032614    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="053067a1-c4dd-4776-bb32-177b0478be98" containerName="authorino"
Jul 23 13:17:13.032672 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.032629    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="053067a1-c4dd-4776-bb32-177b0478be98" containerName="authorino"
Jul 23 13:17:13.032706 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.032682    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="053067a1-c4dd-4776-bb32-177b0478be98" containerName="authorino"
Jul 23 13:17:13.037267 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.037249    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r5xbs"
Jul 23 13:17:13.043447 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.043393    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r5xbs"]
Jul 23 13:17:13.068148 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.068121    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh8st\" (UniqueName: \"kubernetes.io/projected/dd2a5733-e568-4297-91b5-b4ed770ba781-kube-api-access-qh8st\") pod \"authorino-5d4b67c446-r5xbs\" (UID: \"dd2a5733-e568-4297-91b5-b4ed770ba781\") " pod="kuadrant-system/authorino-5d4b67c446-r5xbs"
Jul 23 13:17:13.169271 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.169238    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh8st\" (UniqueName: \"kubernetes.io/projected/dd2a5733-e568-4297-91b5-b4ed770ba781-kube-api-access-qh8st\") pod \"authorino-5d4b67c446-r5xbs\" (UID: \"dd2a5733-e568-4297-91b5-b4ed770ba781\") " pod="kuadrant-system/authorino-5d4b67c446-r5xbs"
Jul 23 13:17:13.179431 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.179409    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh8st\" (UniqueName: \"kubernetes.io/projected/dd2a5733-e568-4297-91b5-b4ed770ba781-kube-api-access-qh8st\") pod \"authorino-5d4b67c446-r5xbs\" (UID: \"dd2a5733-e568-4297-91b5-b4ed770ba781\") " pod="kuadrant-system/authorino-5d4b67c446-r5xbs"
Jul 23 13:17:13.196639 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.196601    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:17:13.275104 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.275076    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r5xbs"]
Jul 23 13:17:13.275282 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.275271    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r5xbs"
Jul 23 13:17:13.299749 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.299683    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85f67464c7-jmt7m"]
Jul 23 13:17:13.303009 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.302973    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85f67464c7-jmt7m"
Jul 23 13:17:13.311606 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.311579    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85f67464c7-jmt7m"]
Jul 23 13:17:13.371498 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.371471    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blz9n\" (UniqueName: \"kubernetes.io/projected/951237d0-66fd-45f4-b45d-82a330d687a4-kube-api-access-blz9n\") pod \"authorino-85f67464c7-jmt7m\" (UID: \"951237d0-66fd-45f4-b45d-82a330d687a4\") " pod="kuadrant-system/authorino-85f67464c7-jmt7m"
Jul 23 13:17:13.404465 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.404429    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r5xbs"]
Jul 23 13:17:13.408042 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:17:13.408016    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd2a5733_e568_4297_91b5_b4ed770ba781.slice/crio-6ba6fcc579403e35e4febd89d76f83250b64c645829b01b5975f0398a6cbc946 WatchSource:0}: Error finding container 6ba6fcc579403e35e4febd89d76f83250b64c645829b01b5975f0398a6cbc946: Status 404 returned error can't find the container with id 6ba6fcc579403e35e4febd89d76f83250b64c645829b01b5975f0398a6cbc946
Jul 23 13:17:13.472091 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.472067    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blz9n\" (UniqueName: \"kubernetes.io/projected/951237d0-66fd-45f4-b45d-82a330d687a4-kube-api-access-blz9n\") pod \"authorino-85f67464c7-jmt7m\" (UID: \"951237d0-66fd-45f4-b45d-82a330d687a4\") " pod="kuadrant-system/authorino-85f67464c7-jmt7m"
Jul 23 13:17:13.483190 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.483165    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blz9n\" (UniqueName: \"kubernetes.io/projected/951237d0-66fd-45f4-b45d-82a330d687a4-kube-api-access-blz9n\") pod \"authorino-85f67464c7-jmt7m\" (UID: \"951237d0-66fd-45f4-b45d-82a330d687a4\") " pod="kuadrant-system/authorino-85f67464c7-jmt7m"
Jul 23 13:17:13.486317 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.486297    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85f67464c7-jmt7m"]
Jul 23 13:17:13.486500 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.486489    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85f67464c7-jmt7m"
Jul 23 13:17:13.516450 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.516423    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59b6df758f-gtv4z"]
Jul 23 13:17:13.520583 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.520562    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b6df758f-gtv4z"
Jul 23 13:17:13.523378 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.523362    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 13:17:13.530233 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.530212    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59b6df758f-gtv4z"]
Jul 23 13:17:13.573524 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.573498    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b-tls-cert\") pod \"authorino-59b6df758f-gtv4z\" (UID: \"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b\") " pod="kuadrant-system/authorino-59b6df758f-gtv4z"
Jul 23 13:17:13.573647 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.573558    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j582t\" (UniqueName: \"kubernetes.io/projected/3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b-kube-api-access-j582t\") pod \"authorino-59b6df758f-gtv4z\" (UID: \"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b\") " pod="kuadrant-system/authorino-59b6df758f-gtv4z"
Jul 23 13:17:13.612287 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.612258    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85f67464c7-jmt7m"]
Jul 23 13:17:13.615166 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:17:13.615135    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod951237d0_66fd_45f4_b45d_82a330d687a4.slice/crio-6799a89eb9458d2725277dfc7bee216f13f75f26595605eb33de1e057f465403 WatchSource:0}: Error finding container 6799a89eb9458d2725277dfc7bee216f13f75f26595605eb33de1e057f465403: Status 404 returned error can't find the container with id 6799a89eb9458d2725277dfc7bee216f13f75f26595605eb33de1e057f465403
Jul 23 13:17:13.674890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.674866    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j582t\" (UniqueName: \"kubernetes.io/projected/3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b-kube-api-access-j582t\") pod \"authorino-59b6df758f-gtv4z\" (UID: \"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b\") " pod="kuadrant-system/authorino-59b6df758f-gtv4z"
Jul 23 13:17:13.675004 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.674911    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b-tls-cert\") pod \"authorino-59b6df758f-gtv4z\" (UID: \"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b\") " pod="kuadrant-system/authorino-59b6df758f-gtv4z"
Jul 23 13:17:13.677156 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.677139    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b-tls-cert\") pod \"authorino-59b6df758f-gtv4z\" (UID: \"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b\") " pod="kuadrant-system/authorino-59b6df758f-gtv4z"
Jul 23 13:17:13.684781 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.684764    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j582t\" (UniqueName: \"kubernetes.io/projected/3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b-kube-api-access-j582t\") pod \"authorino-59b6df758f-gtv4z\" (UID: \"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b\") " pod="kuadrant-system/authorino-59b6df758f-gtv4z"
Jul 23 13:17:13.832322 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.832239    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b6df758f-gtv4z"
Jul 23 13:17:13.870310 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.870224    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r5xbs" event={"ID":"dd2a5733-e568-4297-91b5-b4ed770ba781","Type":"ContainerStarted","Data":"9c61f13f4d22a941f6efe3fcdcd719eceb35733cf88a5a4cbbebe38376808921"}
Jul 23 13:17:13.870310 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.870279    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-r5xbs" podUID="dd2a5733-e568-4297-91b5-b4ed770ba781" containerName="authorino" containerID="cri-o://9c61f13f4d22a941f6efe3fcdcd719eceb35733cf88a5a4cbbebe38376808921" gracePeriod=30
Jul 23 13:17:13.870564 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.870290    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r5xbs" event={"ID":"dd2a5733-e568-4297-91b5-b4ed770ba781","Type":"ContainerStarted","Data":"6ba6fcc579403e35e4febd89d76f83250b64c645829b01b5975f0398a6cbc946"}
Jul 23 13:17:13.871877 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.871852    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85f67464c7-jmt7m" event={"ID":"951237d0-66fd-45f4-b45d-82a330d687a4","Type":"ContainerStarted","Data":"6799a89eb9458d2725277dfc7bee216f13f75f26595605eb33de1e057f465403"}
Jul 23 13:17:13.888483 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.888321    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-r5xbs" podStartSLOduration=0.54205806 podStartE2EDuration="888.300567ms" totalImagesPullingTime="346.242507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:17:13.887566678 +0000 UTC m=+576.141092558" watchObservedRunningTime="2026-07-23 13:17:13.888300567 +0000 UTC m=+576.141826444"
Jul 23 13:17:13.962641 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:13.962606    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59b6df758f-gtv4z"]
Jul 23 13:17:13.965662 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:17:13.965635    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e8b883e_772e_4b6b_b0c8_3c3cd5ff8b4b.slice/crio-d405e5fd69922d2f3469f4717c6b7d4b1bf4e0c54d515b2a3ab84ae72e2a7152 WatchSource:0}: Error finding container d405e5fd69922d2f3469f4717c6b7d4b1bf4e0c54d515b2a3ab84ae72e2a7152: Status 404 returned error can't find the container with id d405e5fd69922d2f3469f4717c6b7d4b1bf4e0c54d515b2a3ab84ae72e2a7152
Jul 23 13:17:14.109633 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.109609    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r5xbs"
Jul 23 13:17:14.178699 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.178672    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh8st\" (UniqueName: \"kubernetes.io/projected/dd2a5733-e568-4297-91b5-b4ed770ba781-kube-api-access-qh8st\") pod \"dd2a5733-e568-4297-91b5-b4ed770ba781\" (UID: \"dd2a5733-e568-4297-91b5-b4ed770ba781\") "
Jul 23 13:17:14.180736 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.180710    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd2a5733-e568-4297-91b5-b4ed770ba781-kube-api-access-qh8st" (OuterVolumeSpecName: "kube-api-access-qh8st") pod "dd2a5733-e568-4297-91b5-b4ed770ba781" (UID: "dd2a5733-e568-4297-91b5-b4ed770ba781"). InnerVolumeSpecName "kube-api-access-qh8st". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:17:14.279449 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.279413    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh8st\" (UniqueName: \"kubernetes.io/projected/dd2a5733-e568-4297-91b5-b4ed770ba781-kube-api-access-qh8st\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:17:14.880195 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.880163    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b6df758f-gtv4z" event={"ID":"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b","Type":"ContainerStarted","Data":"7b6c66348f8362071c2cf15748136bc27516971b77cf88fc078113b0a3a9d3fe"}
Jul 23 13:17:14.880660 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.880205    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b6df758f-gtv4z" event={"ID":"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b","Type":"ContainerStarted","Data":"d405e5fd69922d2f3469f4717c6b7d4b1bf4e0c54d515b2a3ab84ae72e2a7152"}
Jul 23 13:17:14.881579 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.881533    2570 generic.go:356] "Generic (PLEG): container finished" podID="dd2a5733-e568-4297-91b5-b4ed770ba781" containerID="9c61f13f4d22a941f6efe3fcdcd719eceb35733cf88a5a4cbbebe38376808921" exitCode=0
Jul 23 13:17:14.881579 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.881572    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r5xbs"
Jul 23 13:17:14.881797 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.881630    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r5xbs" event={"ID":"dd2a5733-e568-4297-91b5-b4ed770ba781","Type":"ContainerDied","Data":"9c61f13f4d22a941f6efe3fcdcd719eceb35733cf88a5a4cbbebe38376808921"}
Jul 23 13:17:14.881797 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.881662    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r5xbs" event={"ID":"dd2a5733-e568-4297-91b5-b4ed770ba781","Type":"ContainerDied","Data":"6ba6fcc579403e35e4febd89d76f83250b64c645829b01b5975f0398a6cbc946"}
Jul 23 13:17:14.881797 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.881684    2570 scope.go:117] "RemoveContainer" containerID="9c61f13f4d22a941f6efe3fcdcd719eceb35733cf88a5a4cbbebe38376808921"
Jul 23 13:17:14.883262 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.883240    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85f67464c7-jmt7m" event={"ID":"951237d0-66fd-45f4-b45d-82a330d687a4","Type":"ContainerStarted","Data":"bb43f15e30e03b0b373424071abeb3865f99832ca087c3566f300aa3f29ee9b5"}
Jul 23 13:17:14.883382 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.883339    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-85f67464c7-jmt7m" podUID="951237d0-66fd-45f4-b45d-82a330d687a4" containerName="authorino" containerID="cri-o://bb43f15e30e03b0b373424071abeb3865f99832ca087c3566f300aa3f29ee9b5" gracePeriod=30
Jul 23 13:17:14.891118 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.891096    2570 scope.go:117] "RemoveContainer" containerID="9c61f13f4d22a941f6efe3fcdcd719eceb35733cf88a5a4cbbebe38376808921"
Jul 23 13:17:14.891442 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:17:14.891420    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c61f13f4d22a941f6efe3fcdcd719eceb35733cf88a5a4cbbebe38376808921\": container with ID starting with 9c61f13f4d22a941f6efe3fcdcd719eceb35733cf88a5a4cbbebe38376808921 not found: ID does not exist" containerID="9c61f13f4d22a941f6efe3fcdcd719eceb35733cf88a5a4cbbebe38376808921"
Jul 23 13:17:14.891540 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.891452    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c61f13f4d22a941f6efe3fcdcd719eceb35733cf88a5a4cbbebe38376808921"} err="failed to get container status \"9c61f13f4d22a941f6efe3fcdcd719eceb35733cf88a5a4cbbebe38376808921\": rpc error: code = NotFound desc = could not find container \"9c61f13f4d22a941f6efe3fcdcd719eceb35733cf88a5a4cbbebe38376808921\": container with ID starting with 9c61f13f4d22a941f6efe3fcdcd719eceb35733cf88a5a4cbbebe38376808921 not found: ID does not exist"
Jul 23 13:17:14.898291 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.898221    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59b6df758f-gtv4z" podStartSLOduration=1.126484686 podStartE2EDuration="1.898203905s" totalImagesPullingTime="771.719219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:17:14.896472958 +0000 UTC m=+577.149998836" watchObservedRunningTime="2026-07-23 13:17:14.898203905 +0000 UTC m=+577.151729783"
Jul 23 13:17:14.910485 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.910462    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r5xbs"]
Jul 23 13:17:14.916719 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.916699    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r5xbs"]
Jul 23 13:17:14.922742 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.922723    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7vbtc"]
Jul 23 13:17:14.922903 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.922881    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7vbtc" podUID="2be715cc-58fc-4ad5-909f-7860fd9e2320" containerName="authorino" containerID="cri-o://93110cc0c7cfe5022f9be824c039ca1c6de3aa4d5de5d6feacb5758bc8b5941d" gracePeriod=30
Jul 23 13:17:14.933391 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:14.933167    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85f67464c7-jmt7m" podStartSLOduration=1.563510642 podStartE2EDuration="1.933147983s" totalImagesPullingTime="369.637341ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:17:14.932884434 +0000 UTC m=+577.186410311" watchObservedRunningTime="2026-07-23 13:17:14.933147983 +0000 UTC m=+577.186673862"
Jul 23 13:17:15.166571 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.166546    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85f67464c7-jmt7m"
Jul 23 13:17:15.174070 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.174050    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7vbtc"
Jul 23 13:17:15.287799 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.287726    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gs4m\" (UniqueName: \"kubernetes.io/projected/2be715cc-58fc-4ad5-909f-7860fd9e2320-kube-api-access-7gs4m\") pod \"2be715cc-58fc-4ad5-909f-7860fd9e2320\" (UID: \"2be715cc-58fc-4ad5-909f-7860fd9e2320\") "
Jul 23 13:17:15.287799 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.287761    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blz9n\" (UniqueName: \"kubernetes.io/projected/951237d0-66fd-45f4-b45d-82a330d687a4-kube-api-access-blz9n\") pod \"951237d0-66fd-45f4-b45d-82a330d687a4\" (UID: \"951237d0-66fd-45f4-b45d-82a330d687a4\") "
Jul 23 13:17:15.289774 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.289748    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951237d0-66fd-45f4-b45d-82a330d687a4-kube-api-access-blz9n" (OuterVolumeSpecName: "kube-api-access-blz9n") pod "951237d0-66fd-45f4-b45d-82a330d687a4" (UID: "951237d0-66fd-45f4-b45d-82a330d687a4"). InnerVolumeSpecName "kube-api-access-blz9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:17:15.289888 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.289814    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2be715cc-58fc-4ad5-909f-7860fd9e2320-kube-api-access-7gs4m" (OuterVolumeSpecName: "kube-api-access-7gs4m") pod "2be715cc-58fc-4ad5-909f-7860fd9e2320" (UID: "2be715cc-58fc-4ad5-909f-7860fd9e2320"). InnerVolumeSpecName "kube-api-access-7gs4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:17:15.388886 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.388848    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gs4m\" (UniqueName: \"kubernetes.io/projected/2be715cc-58fc-4ad5-909f-7860fd9e2320-kube-api-access-7gs4m\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:17:15.388886 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.388881    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blz9n\" (UniqueName: \"kubernetes.io/projected/951237d0-66fd-45f4-b45d-82a330d687a4-kube-api-access-blz9n\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:17:15.890348 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.890311    2570 generic.go:356] "Generic (PLEG): container finished" podID="951237d0-66fd-45f4-b45d-82a330d687a4" containerID="bb43f15e30e03b0b373424071abeb3865f99832ca087c3566f300aa3f29ee9b5" exitCode=0
Jul 23 13:17:15.890793 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.890357    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85f67464c7-jmt7m"
Jul 23 13:17:15.890793 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.890402    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85f67464c7-jmt7m" event={"ID":"951237d0-66fd-45f4-b45d-82a330d687a4","Type":"ContainerDied","Data":"bb43f15e30e03b0b373424071abeb3865f99832ca087c3566f300aa3f29ee9b5"}
Jul 23 13:17:15.890793 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.890452    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85f67464c7-jmt7m" event={"ID":"951237d0-66fd-45f4-b45d-82a330d687a4","Type":"ContainerDied","Data":"6799a89eb9458d2725277dfc7bee216f13f75f26595605eb33de1e057f465403"}
Jul 23 13:17:15.890793 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.890477    2570 scope.go:117] "RemoveContainer" containerID="bb43f15e30e03b0b373424071abeb3865f99832ca087c3566f300aa3f29ee9b5"
Jul 23 13:17:15.891774 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.891707    2570 generic.go:356] "Generic (PLEG): container finished" podID="2be715cc-58fc-4ad5-909f-7860fd9e2320" containerID="93110cc0c7cfe5022f9be824c039ca1c6de3aa4d5de5d6feacb5758bc8b5941d" exitCode=0
Jul 23 13:17:15.891842 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.891782    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7vbtc"
Jul 23 13:17:15.891842 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.891777    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7vbtc" event={"ID":"2be715cc-58fc-4ad5-909f-7860fd9e2320","Type":"ContainerDied","Data":"93110cc0c7cfe5022f9be824c039ca1c6de3aa4d5de5d6feacb5758bc8b5941d"}
Jul 23 13:17:15.891842 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.891823    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7vbtc" event={"ID":"2be715cc-58fc-4ad5-909f-7860fd9e2320","Type":"ContainerDied","Data":"02fdabb08bb94d943e61b53586e9afce1260263b7b2b2dbe3e7b62de9c53c1c3"}
Jul 23 13:17:15.899145 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.899130    2570 scope.go:117] "RemoveContainer" containerID="bb43f15e30e03b0b373424071abeb3865f99832ca087c3566f300aa3f29ee9b5"
Jul 23 13:17:15.899433 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:17:15.899350    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb43f15e30e03b0b373424071abeb3865f99832ca087c3566f300aa3f29ee9b5\": container with ID starting with bb43f15e30e03b0b373424071abeb3865f99832ca087c3566f300aa3f29ee9b5 not found: ID does not exist" containerID="bb43f15e30e03b0b373424071abeb3865f99832ca087c3566f300aa3f29ee9b5"
Jul 23 13:17:15.899433 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.899381    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb43f15e30e03b0b373424071abeb3865f99832ca087c3566f300aa3f29ee9b5"} err="failed to get container status \"bb43f15e30e03b0b373424071abeb3865f99832ca087c3566f300aa3f29ee9b5\": rpc error: code = NotFound desc = could not find container \"bb43f15e30e03b0b373424071abeb3865f99832ca087c3566f300aa3f29ee9b5\": container with ID starting with bb43f15e30e03b0b373424071abeb3865f99832ca087c3566f300aa3f29ee9b5 not found: ID does not exist"
Jul 23 13:17:15.899433 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.899403    2570 scope.go:117] "RemoveContainer" containerID="93110cc0c7cfe5022f9be824c039ca1c6de3aa4d5de5d6feacb5758bc8b5941d"
Jul 23 13:17:15.906759 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.906744    2570 scope.go:117] "RemoveContainer" containerID="93110cc0c7cfe5022f9be824c039ca1c6de3aa4d5de5d6feacb5758bc8b5941d"
Jul 23 13:17:15.907020 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:17:15.907003    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93110cc0c7cfe5022f9be824c039ca1c6de3aa4d5de5d6feacb5758bc8b5941d\": container with ID starting with 93110cc0c7cfe5022f9be824c039ca1c6de3aa4d5de5d6feacb5758bc8b5941d not found: ID does not exist" containerID="93110cc0c7cfe5022f9be824c039ca1c6de3aa4d5de5d6feacb5758bc8b5941d"
Jul 23 13:17:15.907074 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.907026    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93110cc0c7cfe5022f9be824c039ca1c6de3aa4d5de5d6feacb5758bc8b5941d"} err="failed to get container status \"93110cc0c7cfe5022f9be824c039ca1c6de3aa4d5de5d6feacb5758bc8b5941d\": rpc error: code = NotFound desc = could not find container \"93110cc0c7cfe5022f9be824c039ca1c6de3aa4d5de5d6feacb5758bc8b5941d\": container with ID starting with 93110cc0c7cfe5022f9be824c039ca1c6de3aa4d5de5d6feacb5758bc8b5941d not found: ID does not exist"
Jul 23 13:17:15.915937 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.915916    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85f67464c7-jmt7m"]
Jul 23 13:17:15.922782 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.922764    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85f67464c7-jmt7m"]
Jul 23 13:17:15.934658 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.934638    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7vbtc"]
Jul 23 13:17:15.940552 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:15.940534    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7vbtc"]
Jul 23 13:17:16.358091 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:16.358058    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2be715cc-58fc-4ad5-909f-7860fd9e2320" path="/var/lib/kubelet/pods/2be715cc-58fc-4ad5-909f-7860fd9e2320/volumes"
Jul 23 13:17:16.358383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:16.358371    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="951237d0-66fd-45f4-b45d-82a330d687a4" path="/var/lib/kubelet/pods/951237d0-66fd-45f4-b45d-82a330d687a4/volumes"
Jul 23 13:17:16.358639 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:16.358628    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd2a5733-e568-4297-91b5-b4ed770ba781" path="/var/lib/kubelet/pods/dd2a5733-e568-4297-91b5-b4ed770ba781/volumes"
Jul 23 13:17:19.784329 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:19.784296    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:17:19.883060 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:19.883027    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:17:19.956478 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:19.956443    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:17:23.210267 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:23.210225    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:17:23.316155 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:23.316125    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:17:55.451410 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:55.451376    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:17:58.280659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:17:58.280619    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:18:07.777687 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:07.777605    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:18:07.876081 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:07.876052    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:18:23.117857 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:23.117822    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:18:26.693214 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:26.693171    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:18:33.245365 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:33.245330    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:18:33.347485 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:33.347458    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:18:44.157261 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.157224    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"]
Jul 23 13:18:44.157636 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.157558    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd2a5733-e568-4297-91b5-b4ed770ba781" containerName="authorino"
Jul 23 13:18:44.157636 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.157571    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd2a5733-e568-4297-91b5-b4ed770ba781" containerName="authorino"
Jul 23 13:18:44.157636 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.157583    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2be715cc-58fc-4ad5-909f-7860fd9e2320" containerName="authorino"
Jul 23 13:18:44.157636 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.157590    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2be715cc-58fc-4ad5-909f-7860fd9e2320" containerName="authorino"
Jul 23 13:18:44.157636 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.157598    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951237d0-66fd-45f4-b45d-82a330d687a4" containerName="authorino"
Jul 23 13:18:44.157636 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.157608    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="951237d0-66fd-45f4-b45d-82a330d687a4" containerName="authorino"
Jul 23 13:18:44.157819 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.157664    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd2a5733-e568-4297-91b5-b4ed770ba781" containerName="authorino"
Jul 23 13:18:44.157819 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.157673    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="951237d0-66fd-45f4-b45d-82a330d687a4" containerName="authorino"
Jul 23 13:18:44.157819 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.157683    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2be715cc-58fc-4ad5-909f-7860fd9e2320" containerName="authorino"
Jul 23 13:18:44.159500 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.159481    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.162009 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.161973    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 13:18:44.162111 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.162094    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 13:18:44.163253 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.163234    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7r8qz\""
Jul 23 13:18:44.163360 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.163269    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 23 13:18:44.171161 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.171140    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"]
Jul 23 13:18:44.212385 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.212357    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:18:44.294439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.294412    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35af5565-8ae7-46df-96f2-5bf98e84f55b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.294580 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.294451    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35af5565-8ae7-46df-96f2-5bf98e84f55b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.294580 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.294470    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35af5565-8ae7-46df-96f2-5bf98e84f55b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.294580 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.294526    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35af5565-8ae7-46df-96f2-5bf98e84f55b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.294580 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.294542    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35af5565-8ae7-46df-96f2-5bf98e84f55b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.294580 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.294574    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42nmr\" (UniqueName: \"kubernetes.io/projected/35af5565-8ae7-46df-96f2-5bf98e84f55b-kube-api-access-42nmr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.394936 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.394908    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35af5565-8ae7-46df-96f2-5bf98e84f55b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.395077 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.394945    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35af5565-8ae7-46df-96f2-5bf98e84f55b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.395077 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.394961    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35af5565-8ae7-46df-96f2-5bf98e84f55b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.395077 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.395005    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35af5565-8ae7-46df-96f2-5bf98e84f55b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.395077 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.395021    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35af5565-8ae7-46df-96f2-5bf98e84f55b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.395077 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.395043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42nmr\" (UniqueName: \"kubernetes.io/projected/35af5565-8ae7-46df-96f2-5bf98e84f55b-kube-api-access-42nmr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.395421 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.395396    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35af5565-8ae7-46df-96f2-5bf98e84f55b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.395513 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.395436    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35af5565-8ae7-46df-96f2-5bf98e84f55b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.395513 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.395471    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35af5565-8ae7-46df-96f2-5bf98e84f55b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.397174 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.397152    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35af5565-8ae7-46df-96f2-5bf98e84f55b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.397410 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.397394    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35af5565-8ae7-46df-96f2-5bf98e84f55b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.403233 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.403216    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42nmr\" (UniqueName: \"kubernetes.io/projected/35af5565-8ae7-46df-96f2-5bf98e84f55b-kube-api-access-42nmr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sg8rr\" (UID: \"35af5565-8ae7-46df-96f2-5bf98e84f55b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.469715 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.469688    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:44.596069 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.596042    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"]
Jul 23 13:18:44.598780 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:18:44.598750    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35af5565_8ae7_46df_96f2_5bf98e84f55b.slice/crio-2ab42e6218cc74635678f782f826d9fa90fcb0a2f7daaf39c3fe2f4dbdd4ed9a WatchSource:0}: Error finding container 2ab42e6218cc74635678f782f826d9fa90fcb0a2f7daaf39c3fe2f4dbdd4ed9a: Status 404 returned error can't find the container with id 2ab42e6218cc74635678f782f826d9fa90fcb0a2f7daaf39c3fe2f4dbdd4ed9a
Jul 23 13:18:44.600084 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:44.600066    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:18:45.274723 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:45.274690    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr" event={"ID":"35af5565-8ae7-46df-96f2-5bf98e84f55b","Type":"ContainerStarted","Data":"2ab42e6218cc74635678f782f826d9fa90fcb0a2f7daaf39c3fe2f4dbdd4ed9a"}
Jul 23 13:18:46.280910 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:46.280873    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr" event={"ID":"35af5565-8ae7-46df-96f2-5bf98e84f55b","Type":"ContainerStarted","Data":"cb426e6753cff0f268a2b07fd1df2436881bca391467862964edd5d9459f263a"}
Jul 23 13:18:46.299924 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:46.299857    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr" podStartSLOduration=1.178462447 podStartE2EDuration="2.299840884s" totalImagesPullingTime="1.121378437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:46.299325065 +0000 UTC m=+668.552850940" watchObservedRunningTime="2026-07-23 13:18:46.299840884 +0000 UTC m=+668.553366759"
Jul 23 13:18:54.470114 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:54.470074    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:54.470612 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:54.470157    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:54.482408 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:54.482375    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:18:55.330270 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:18:55.330243    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sg8rr"
Jul 23 13:19:06.160760 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.160727    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"]
Jul 23 13:19:06.163053 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.163036    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.166841 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.166820    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 23 13:19:06.166961 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.166906    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a435192b-dc19-4f24-ba11-e01d6713c810-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.166961 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.166943    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a435192b-dc19-4f24-ba11-e01d6713c810-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.167093 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.166970    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9clvt\" (UniqueName: \"kubernetes.io/projected/a435192b-dc19-4f24-ba11-e01d6713c810-kube-api-access-9clvt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.167093 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.167009    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a435192b-dc19-4f24-ba11-e01d6713c810-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.167093 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.167042    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a435192b-dc19-4f24-ba11-e01d6713c810-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.167093 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.167072    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a435192b-dc19-4f24-ba11-e01d6713c810-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.186030 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.186008    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"]
Jul 23 13:19:06.206108 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.206082    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:19:06.268358 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.268330    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a435192b-dc19-4f24-ba11-e01d6713c810-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.268474 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.268361    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a435192b-dc19-4f24-ba11-e01d6713c810-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.268474 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.268385    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9clvt\" (UniqueName: \"kubernetes.io/projected/a435192b-dc19-4f24-ba11-e01d6713c810-kube-api-access-9clvt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.268474 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.268404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a435192b-dc19-4f24-ba11-e01d6713c810-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.268474 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.268434    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a435192b-dc19-4f24-ba11-e01d6713c810-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.268474 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.268462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a435192b-dc19-4f24-ba11-e01d6713c810-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.268804 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.268783    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a435192b-dc19-4f24-ba11-e01d6713c810-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.268876 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.268834    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a435192b-dc19-4f24-ba11-e01d6713c810-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.268922 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.268877    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a435192b-dc19-4f24-ba11-e01d6713c810-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.270591 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.270574    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a435192b-dc19-4f24-ba11-e01d6713c810-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.270860 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.270842    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a435192b-dc19-4f24-ba11-e01d6713c810-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.278700 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.278676    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9clvt\" (UniqueName: \"kubernetes.io/projected/a435192b-dc19-4f24-ba11-e01d6713c810-kube-api-access-9clvt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g\" (UID: \"a435192b-dc19-4f24-ba11-e01d6713c810\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.472725 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.472690    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:06.621747 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:06.620044    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"]
Jul 23 13:19:06.626472 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:19:06.626442    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda435192b_dc19_4f24_ba11_e01d6713c810.slice/crio-1021cd7d4bcebd2856db26bbfc4ef6441e90613e104534b63d92a0481ff5f3e3 WatchSource:0}: Error finding container 1021cd7d4bcebd2856db26bbfc4ef6441e90613e104534b63d92a0481ff5f3e3: Status 404 returned error can't find the container with id 1021cd7d4bcebd2856db26bbfc4ef6441e90613e104534b63d92a0481ff5f3e3
Jul 23 13:19:07.369864 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:07.369831    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g" event={"ID":"a435192b-dc19-4f24-ba11-e01d6713c810","Type":"ContainerStarted","Data":"8f52eba6f275ed9d5a68cf515ee61098abeea5c27557ce93763072fb83fed7a4"}
Jul 23 13:19:07.370281 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:07.369880    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g" event={"ID":"a435192b-dc19-4f24-ba11-e01d6713c810","Type":"ContainerStarted","Data":"1021cd7d4bcebd2856db26bbfc4ef6441e90613e104534b63d92a0481ff5f3e3"}
Jul 23 13:19:07.387629 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:07.387586    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g" podStartSLOduration=1.147704316 podStartE2EDuration="1.387573545s" totalImagesPullingTime="239.869229ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:07.386718086 +0000 UTC m=+689.640243966" watchObservedRunningTime="2026-07-23 13:19:07.387573545 +0000 UTC m=+689.641099420"
Jul 23 13:19:12.265572 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:12.265531    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:19:12.333997 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:12.333947    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:19:16.473683 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:16.473652    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:16.474190 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:16.473706    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:16.485936 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:16.485914    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:17.421029 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:17.420999    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g"
Jul 23 13:19:18.376365 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.376328    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"]
Jul 23 13:19:18.381924 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.381900    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.385188 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.385168    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 23 13:19:18.407409 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.407382    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"]
Jul 23 13:19:18.457557 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.457522    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:19:18.472323 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.472283    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8480404-f40e-4024-a31f-2d7d6130d184-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.472482 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.472415    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8480404-f40e-4024-a31f-2d7d6130d184-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.472482 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.472448    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pfc5\" (UniqueName: \"kubernetes.io/projected/f8480404-f40e-4024-a31f-2d7d6130d184-kube-api-access-5pfc5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.472584 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.472491    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8480404-f40e-4024-a31f-2d7d6130d184-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.472656 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.472589    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8480404-f40e-4024-a31f-2d7d6130d184-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.472656 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.472627    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8480404-f40e-4024-a31f-2d7d6130d184-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.573481 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.573449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8480404-f40e-4024-a31f-2d7d6130d184-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.573641 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.573509    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8480404-f40e-4024-a31f-2d7d6130d184-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.573641 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.573535    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pfc5\" (UniqueName: \"kubernetes.io/projected/f8480404-f40e-4024-a31f-2d7d6130d184-kube-api-access-5pfc5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.573641 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.573565    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8480404-f40e-4024-a31f-2d7d6130d184-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.573641 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.573624    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8480404-f40e-4024-a31f-2d7d6130d184-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.573866 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.573646    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8480404-f40e-4024-a31f-2d7d6130d184-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.574036 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.574015    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8480404-f40e-4024-a31f-2d7d6130d184-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.574036 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.574027    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8480404-f40e-4024-a31f-2d7d6130d184-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.574159 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.574081    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8480404-f40e-4024-a31f-2d7d6130d184-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.575755 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.575735    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8480404-f40e-4024-a31f-2d7d6130d184-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.576025 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.576006    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8480404-f40e-4024-a31f-2d7d6130d184-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.583838 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.583820    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pfc5\" (UniqueName: \"kubernetes.io/projected/f8480404-f40e-4024-a31f-2d7d6130d184-kube-api-access-5pfc5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtffs\" (UID: \"f8480404-f40e-4024-a31f-2d7d6130d184\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.691974 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.691896    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:18.827231 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:18.827195    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"]
Jul 23 13:19:18.830170 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:19:18.830145    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8480404_f40e_4024_a31f_2d7d6130d184.slice/crio-0ed057791023e12d05304045770f111b93966535729f6e703245c45fbd290051 WatchSource:0}: Error finding container 0ed057791023e12d05304045770f111b93966535729f6e703245c45fbd290051: Status 404 returned error can't find the container with id 0ed057791023e12d05304045770f111b93966535729f6e703245c45fbd290051
Jul 23 13:19:19.421390 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:19.421296    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs" event={"ID":"f8480404-f40e-4024-a31f-2d7d6130d184","Type":"ContainerStarted","Data":"9f39c1b48e4cc233e0a87c092868e37f3c55b51b566a589e69cb84dd4e231eed"}
Jul 23 13:19:19.421390 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:19.421348    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs" event={"ID":"f8480404-f40e-4024-a31f-2d7d6130d184","Type":"ContainerStarted","Data":"0ed057791023e12d05304045770f111b93966535729f6e703245c45fbd290051"}
Jul 23 13:19:19.446839 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:19.446786    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs" podStartSLOduration=1.238383627 podStartE2EDuration="1.446770854s" totalImagesPullingTime="208.387227ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:19.444381656 +0000 UTC m=+701.697907531" watchObservedRunningTime="2026-07-23 13:19:19.446770854 +0000 UTC m=+701.700296859"
Jul 23 13:19:28.692829 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:28.692792    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:28.693250 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:28.692858    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:28.705424 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:28.705401    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:29.476785 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:29.476759    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtffs"
Jul 23 13:19:38.831737 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:19:38.831703    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:20:15.517124 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:15.517088    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:20:15.617867 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:15.617836    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:20:24.592573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:24.592523    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86758f95b8-d7kfs"]
Jul 23 13:20:24.594972 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:24.594950    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86758f95b8-d7kfs"
Jul 23 13:20:24.605835 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:24.605814    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86758f95b8-d7kfs"]
Jul 23 13:20:24.737235 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:24.737203    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrzsn\" (UniqueName: \"kubernetes.io/projected/051e6815-95ed-4911-82ff-36324689c47a-kube-api-access-hrzsn\") pod \"authorino-86758f95b8-d7kfs\" (UID: \"051e6815-95ed-4911-82ff-36324689c47a\") " pod="kuadrant-system/authorino-86758f95b8-d7kfs"
Jul 23 13:20:24.737397 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:24.737266    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/051e6815-95ed-4911-82ff-36324689c47a-tls-cert\") pod \"authorino-86758f95b8-d7kfs\" (UID: \"051e6815-95ed-4911-82ff-36324689c47a\") " pod="kuadrant-system/authorino-86758f95b8-d7kfs"
Jul 23 13:20:24.838542 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:24.838505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/051e6815-95ed-4911-82ff-36324689c47a-tls-cert\") pod \"authorino-86758f95b8-d7kfs\" (UID: \"051e6815-95ed-4911-82ff-36324689c47a\") " pod="kuadrant-system/authorino-86758f95b8-d7kfs"
Jul 23 13:20:24.838705 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:24.838562    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrzsn\" (UniqueName: \"kubernetes.io/projected/051e6815-95ed-4911-82ff-36324689c47a-kube-api-access-hrzsn\") pod \"authorino-86758f95b8-d7kfs\" (UID: \"051e6815-95ed-4911-82ff-36324689c47a\") " pod="kuadrant-system/authorino-86758f95b8-d7kfs"
Jul 23 13:20:24.840957 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:24.840928    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/051e6815-95ed-4911-82ff-36324689c47a-tls-cert\") pod \"authorino-86758f95b8-d7kfs\" (UID: \"051e6815-95ed-4911-82ff-36324689c47a\") " pod="kuadrant-system/authorino-86758f95b8-d7kfs"
Jul 23 13:20:24.846901 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:24.846836    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrzsn\" (UniqueName: \"kubernetes.io/projected/051e6815-95ed-4911-82ff-36324689c47a-kube-api-access-hrzsn\") pod \"authorino-86758f95b8-d7kfs\" (UID: \"051e6815-95ed-4911-82ff-36324689c47a\") " pod="kuadrant-system/authorino-86758f95b8-d7kfs"
Jul 23 13:20:24.904097 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:24.904076    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86758f95b8-d7kfs"
Jul 23 13:20:25.044667 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:25.044641    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86758f95b8-d7kfs"]
Jul 23 13:20:25.046554 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:20:25.046526    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod051e6815_95ed_4911_82ff_36324689c47a.slice/crio-ee8be36a6e1b998c3af44b7d5ed92276e506dfabc77396bf13627c1333090f23 WatchSource:0}: Error finding container ee8be36a6e1b998c3af44b7d5ed92276e506dfabc77396bf13627c1333090f23: Status 404 returned error can't find the container with id ee8be36a6e1b998c3af44b7d5ed92276e506dfabc77396bf13627c1333090f23
Jul 23 13:20:25.509413 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:25.509379    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:20:25.624439 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:25.624411    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:20:25.716997 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:25.716942    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86758f95b8-d7kfs" event={"ID":"051e6815-95ed-4911-82ff-36324689c47a","Type":"ContainerStarted","Data":"ee8be36a6e1b998c3af44b7d5ed92276e506dfabc77396bf13627c1333090f23"}
Jul 23 13:20:26.434963 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:26.434924    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:20:26.619806 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:26.619776    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:20:26.725213 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:26.725178    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86758f95b8-d7kfs" event={"ID":"051e6815-95ed-4911-82ff-36324689c47a","Type":"ContainerStarted","Data":"f8718ceb903693ede026fc176c3e5f73b708fa3be011bf7ae8e8079f8ad061ca"}
Jul 23 13:20:26.745076 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:26.745030    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86758f95b8-d7kfs" podStartSLOduration=2.003137617 podStartE2EDuration="2.74501305s" totalImagesPullingTime="741.875433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:20:26.743049863 +0000 UTC m=+768.996575739" watchObservedRunningTime="2026-07-23 13:20:26.74501305 +0000 UTC m=+768.998538927"
Jul 23 13:20:26.792024 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:26.791972    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59b6df758f-gtv4z"]
Jul 23 13:20:26.792240 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:26.792214    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59b6df758f-gtv4z" podUID="3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b" containerName="authorino" containerID="cri-o://7b6c66348f8362071c2cf15748136bc27516971b77cf88fc078113b0a3a9d3fe" gracePeriod=30
Jul 23 13:20:27.050922 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.050894    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b6df758f-gtv4z"
Jul 23 13:20:27.161951 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.161919    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b-tls-cert\") pod \"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b\" (UID: \"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b\") "
Jul 23 13:20:27.161951 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.161954    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j582t\" (UniqueName: \"kubernetes.io/projected/3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b-kube-api-access-j582t\") pod \"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b\" (UID: \"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b\") "
Jul 23 13:20:27.163938 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.163911    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b-kube-api-access-j582t" (OuterVolumeSpecName: "kube-api-access-j582t") pod "3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b" (UID: "3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b"). InnerVolumeSpecName "kube-api-access-j582t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:20:27.172872 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.172851    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b" (UID: "3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:27.263132 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.263102    2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b-tls-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.263132 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.263130    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j582t\" (UniqueName: \"kubernetes.io/projected/3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b-kube-api-access-j582t\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.731490 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.731450    2570 generic.go:356] "Generic (PLEG): container finished" podID="3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b" containerID="7b6c66348f8362071c2cf15748136bc27516971b77cf88fc078113b0a3a9d3fe" exitCode=0
Jul 23 13:20:27.732015 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.731495    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b6df758f-gtv4z"
Jul 23 13:20:27.732015 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.731532    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b6df758f-gtv4z" event={"ID":"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b","Type":"ContainerDied","Data":"7b6c66348f8362071c2cf15748136bc27516971b77cf88fc078113b0a3a9d3fe"}
Jul 23 13:20:27.732015 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.731584    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b6df758f-gtv4z" event={"ID":"3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b","Type":"ContainerDied","Data":"d405e5fd69922d2f3469f4717c6b7d4b1bf4e0c54d515b2a3ab84ae72e2a7152"}
Jul 23 13:20:27.732015 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.731608    2570 scope.go:117] "RemoveContainer" containerID="7b6c66348f8362071c2cf15748136bc27516971b77cf88fc078113b0a3a9d3fe"
Jul 23 13:20:27.741265 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.741248    2570 scope.go:117] "RemoveContainer" containerID="7b6c66348f8362071c2cf15748136bc27516971b77cf88fc078113b0a3a9d3fe"
Jul 23 13:20:27.741570 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:20:27.741550    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b6c66348f8362071c2cf15748136bc27516971b77cf88fc078113b0a3a9d3fe\": container with ID starting with 7b6c66348f8362071c2cf15748136bc27516971b77cf88fc078113b0a3a9d3fe not found: ID does not exist" containerID="7b6c66348f8362071c2cf15748136bc27516971b77cf88fc078113b0a3a9d3fe"
Jul 23 13:20:27.741618 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.741579    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b6c66348f8362071c2cf15748136bc27516971b77cf88fc078113b0a3a9d3fe"} err="failed to get container status \"7b6c66348f8362071c2cf15748136bc27516971b77cf88fc078113b0a3a9d3fe\": rpc error: code = NotFound desc = could not find container \"7b6c66348f8362071c2cf15748136bc27516971b77cf88fc078113b0a3a9d3fe\": container with ID starting with 7b6c66348f8362071c2cf15748136bc27516971b77cf88fc078113b0a3a9d3fe not found: ID does not exist"
Jul 23 13:20:27.757029 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.757005    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59b6df758f-gtv4z"]
Jul 23 13:20:27.762377 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:27.762356    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59b6df758f-gtv4z"]
Jul 23 13:20:28.364593 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:20:28.361031    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b" path="/var/lib/kubelet/pods/3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b/volumes"
Jul 23 13:22:33.476808 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:22:33.476774    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:22:35.000703 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:22:35.000668    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:22:38.694788 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:22:38.694759    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:23:06.582368 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:23:06.582333    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:23:15.400822 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:23:15.400784    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:23:15.489659 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:23:15.489626    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:23:17.995672 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:23:17.995630    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:23:21.398075 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:23:21.398039    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:23:21.506130 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:23:21.506090    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:23:21.599919 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:23:21.599887    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:23:21.760424 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:23:21.760374    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:23:22.818485 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:23:22.818445    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:23:23.784845 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:23:23.784799    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:23:27.616782 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:23:27.616735    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:23:27.719979 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:23:27.719935    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:24:48.528535 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:24:48.528495    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:24:48.628779 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:24:48.628748    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:27:22.538119 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:22.538028    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"]
Jul 23 13:27:22.538685 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:22.538632    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n" podUID="4991cc8b-037e-4d9a-8ab2-ac7258ec0be3" containerName="manager" containerID="cri-o://0572ac1d2f0c226b5de4acc8008ffbd924ebcde73b4e45917453c820c10be884" gracePeriod=10
Jul 23 13:27:25.480937 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.480912    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"
Jul 23 13:27:25.533511 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.533486    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4991cc8b-037e-4d9a-8ab2-ac7258ec0be3-extensions-socket-volume\") pod \"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3\" (UID: \"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3\") "
Jul 23 13:27:25.533647 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.533554    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhkzc\" (UniqueName: \"kubernetes.io/projected/4991cc8b-037e-4d9a-8ab2-ac7258ec0be3-kube-api-access-fhkzc\") pod \"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3\" (UID: \"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3\") "
Jul 23 13:27:25.533833 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.533810    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4991cc8b-037e-4d9a-8ab2-ac7258ec0be3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4991cc8b-037e-4d9a-8ab2-ac7258ec0be3" (UID: "4991cc8b-037e-4d9a-8ab2-ac7258ec0be3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:27:25.535468 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.535444    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4991cc8b-037e-4d9a-8ab2-ac7258ec0be3-kube-api-access-fhkzc" (OuterVolumeSpecName: "kube-api-access-fhkzc") pod "4991cc8b-037e-4d9a-8ab2-ac7258ec0be3" (UID: "4991cc8b-037e-4d9a-8ab2-ac7258ec0be3"). InnerVolumeSpecName "kube-api-access-fhkzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:27:25.590393 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.590326    2570 generic.go:356] "Generic (PLEG): container finished" podID="4991cc8b-037e-4d9a-8ab2-ac7258ec0be3" containerID="0572ac1d2f0c226b5de4acc8008ffbd924ebcde73b4e45917453c820c10be884" exitCode=0
Jul 23 13:27:25.590393 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.590364    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n" event={"ID":"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3","Type":"ContainerDied","Data":"0572ac1d2f0c226b5de4acc8008ffbd924ebcde73b4e45917453c820c10be884"}
Jul 23 13:27:25.590393 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.590377    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"
Jul 23 13:27:25.590551 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.590435    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n" event={"ID":"4991cc8b-037e-4d9a-8ab2-ac7258ec0be3","Type":"ContainerDied","Data":"432b4bb44740b9df46c7741b32b18693f39369958da08ec478f7e13759e31de8"}
Jul 23 13:27:25.590551 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.590458    2570 scope.go:117] "RemoveContainer" containerID="0572ac1d2f0c226b5de4acc8008ffbd924ebcde73b4e45917453c820c10be884"
Jul 23 13:27:25.599870 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.599856    2570 scope.go:117] "RemoveContainer" containerID="0572ac1d2f0c226b5de4acc8008ffbd924ebcde73b4e45917453c820c10be884"
Jul 23 13:27:25.600119 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:27:25.600098    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0572ac1d2f0c226b5de4acc8008ffbd924ebcde73b4e45917453c820c10be884\": container with ID starting with 0572ac1d2f0c226b5de4acc8008ffbd924ebcde73b4e45917453c820c10be884 not found: ID does not exist" containerID="0572ac1d2f0c226b5de4acc8008ffbd924ebcde73b4e45917453c820c10be884"
Jul 23 13:27:25.600171 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.600126    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0572ac1d2f0c226b5de4acc8008ffbd924ebcde73b4e45917453c820c10be884"} err="failed to get container status \"0572ac1d2f0c226b5de4acc8008ffbd924ebcde73b4e45917453c820c10be884\": rpc error: code = NotFound desc = could not find container \"0572ac1d2f0c226b5de4acc8008ffbd924ebcde73b4e45917453c820c10be884\": container with ID starting with 0572ac1d2f0c226b5de4acc8008ffbd924ebcde73b4e45917453c820c10be884 not found: ID does not exist"
Jul 23 13:27:25.611976 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.611957    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"]
Jul 23 13:27:25.616114 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.616094    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k488n"]
Jul 23 13:27:25.634128 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.634106    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4991cc8b-037e-4d9a-8ab2-ac7258ec0be3-extensions-socket-volume\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:27:25.634199 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:25.634128    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhkzc\" (UniqueName: \"kubernetes.io/projected/4991cc8b-037e-4d9a-8ab2-ac7258ec0be3-kube-api-access-fhkzc\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:27:26.358343 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:27:26.358313    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4991cc8b-037e-4d9a-8ab2-ac7258ec0be3" path="/var/lib/kubelet/pods/4991cc8b-037e-4d9a-8ab2-ac7258ec0be3/volumes"
Jul 23 13:28:23.896665 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:23.896630    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8"]
Jul 23 13:28:23.898867 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:23.896938    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4991cc8b-037e-4d9a-8ab2-ac7258ec0be3" containerName="manager"
Jul 23 13:28:23.898867 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:23.896949    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4991cc8b-037e-4d9a-8ab2-ac7258ec0be3" containerName="manager"
Jul 23 13:28:23.898867 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:23.896968    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b" containerName="authorino"
Jul 23 13:28:23.898867 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:23.896976    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b" containerName="authorino"
Jul 23 13:28:23.898867 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:23.897044    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e8b883e-772e-4b6b-b0c8-3c3cd5ff8b4b" containerName="authorino"
Jul 23 13:28:23.898867 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:23.897055    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4991cc8b-037e-4d9a-8ab2-ac7258ec0be3" containerName="manager"
Jul 23 13:28:23.899700 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:23.899684    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8"
Jul 23 13:28:23.903497 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:23.903475    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-q5mc4\""
Jul 23 13:28:23.924283 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:23.924248    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8"]
Jul 23 13:28:23.982888 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:23.982838    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1737d305-2cd2-4ed8-8490-8c36eab9b0da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-slzv8\" (UID: \"1737d305-2cd2-4ed8-8490-8c36eab9b0da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8"
Jul 23 13:28:23.983138 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:23.982899    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llqh7\" (UniqueName: \"kubernetes.io/projected/1737d305-2cd2-4ed8-8490-8c36eab9b0da-kube-api-access-llqh7\") pod \"kuadrant-operator-controller-manager-86878c769f-slzv8\" (UID: \"1737d305-2cd2-4ed8-8490-8c36eab9b0da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8"
Jul 23 13:28:24.084320 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:24.084282    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1737d305-2cd2-4ed8-8490-8c36eab9b0da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-slzv8\" (UID: \"1737d305-2cd2-4ed8-8490-8c36eab9b0da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8"
Jul 23 13:28:24.084320 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:24.084320    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llqh7\" (UniqueName: \"kubernetes.io/projected/1737d305-2cd2-4ed8-8490-8c36eab9b0da-kube-api-access-llqh7\") pod \"kuadrant-operator-controller-manager-86878c769f-slzv8\" (UID: \"1737d305-2cd2-4ed8-8490-8c36eab9b0da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8"
Jul 23 13:28:24.084693 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:24.084671    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1737d305-2cd2-4ed8-8490-8c36eab9b0da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-slzv8\" (UID: \"1737d305-2cd2-4ed8-8490-8c36eab9b0da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8"
Jul 23 13:28:24.095294 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:24.095263    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llqh7\" (UniqueName: \"kubernetes.io/projected/1737d305-2cd2-4ed8-8490-8c36eab9b0da-kube-api-access-llqh7\") pod \"kuadrant-operator-controller-manager-86878c769f-slzv8\" (UID: \"1737d305-2cd2-4ed8-8490-8c36eab9b0da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8"
Jul 23 13:28:24.209671 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:24.209639    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8"
Jul 23 13:28:24.357041 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:28:24.357009    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1737d305_2cd2_4ed8_8490_8c36eab9b0da.slice/crio-36abe5a3451cca2ea4d09333fba5106cb5f8a1199de6910eb991d206f0574f8d WatchSource:0}: Error finding container 36abe5a3451cca2ea4d09333fba5106cb5f8a1199de6910eb991d206f0574f8d: Status 404 returned error can't find the container with id 36abe5a3451cca2ea4d09333fba5106cb5f8a1199de6910eb991d206f0574f8d
Jul 23 13:28:24.358917 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:24.358892    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8"]
Jul 23 13:28:24.841322 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:24.841281    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8" event={"ID":"1737d305-2cd2-4ed8-8490-8c36eab9b0da","Type":"ContainerStarted","Data":"47238acbf0cfdc75c783b5e5ad8787793b65f3cf82947dfd74dd5a20c2b77b15"}
Jul 23 13:28:24.841512 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:24.841367    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8" event={"ID":"1737d305-2cd2-4ed8-8490-8c36eab9b0da","Type":"ContainerStarted","Data":"36abe5a3451cca2ea4d09333fba5106cb5f8a1199de6910eb991d206f0574f8d"}
Jul 23 13:28:24.841512 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:24.841423    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8"
Jul 23 13:28:24.881077 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:24.880942    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8" podStartSLOduration=1.880923525 podStartE2EDuration="1.880923525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:28:24.879671216 +0000 UTC m=+1247.133197096" watchObservedRunningTime="2026-07-23 13:28:24.880923525 +0000 UTC m=+1247.134449405"
Jul 23 13:28:35.848001 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:28:35.847952    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slzv8"
Jul 23 13:29:24.824438 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:29:24.824400    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:29:27.306996 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:29:27.306944    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:30:41.026073 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:30:41.026037    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:31:11.814280 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:11.814244    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:31:12.612094 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:12.612056    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:31:20.959583 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:20.959545    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"]
Jul 23 13:31:20.962733 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:20.962715    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:20.965926 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:20.965905    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-56651086-kserve-self-signed-certs\""
Jul 23 13:31:20.973782 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:20.973760    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"]
Jul 23 13:31:21.005860 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.005839    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:31:21.091232 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.091204    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tk84\" (UniqueName: \"kubernetes.io/projected/562187b5-4373-42dd-9748-4c711423df19-kube-api-access-6tk84\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.091356 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.091251    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-home\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.091356 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.091275    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-dshm\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.091356 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.091293    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/562187b5-4373-42dd-9748-4c711423df19-tls-certs\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.091356 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.091324    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-model-cache\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.091547 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.091377    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-tmp-dir\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.192726 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.192694    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-tmp-dir\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.192883 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.192742    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tk84\" (UniqueName: \"kubernetes.io/projected/562187b5-4373-42dd-9748-4c711423df19-kube-api-access-6tk84\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.192883 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.192773    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-home\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.192883 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.192790    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-dshm\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.192883 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.192808    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/562187b5-4373-42dd-9748-4c711423df19-tls-certs\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.192883 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.192842    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-model-cache\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.193208 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.193189    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-tmp-dir\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.193260 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.193220    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-home\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.193296 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.193268    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-model-cache\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.195090 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.195059    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-dshm\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.195311 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.195295    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/562187b5-4373-42dd-9748-4c711423df19-tls-certs\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.205023 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.202434    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tk84\" (UniqueName: \"kubernetes.io/projected/562187b5-4373-42dd-9748-4c711423df19-kube-api-access-6tk84\") pod \"e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") " pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.272614 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.272542    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:21.422547 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.422508    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"]
Jul 23 13:31:21.427428 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:31:21.427397    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod562187b5_4373_42dd_9748_4c711423df19.slice/crio-ff89bf659225127df970fa0c29907bb143112fc498ca330e80e7a294c33882e7 WatchSource:0}: Error finding container ff89bf659225127df970fa0c29907bb143112fc498ca330e80e7a294c33882e7: Status 404 returned error can't find the container with id ff89bf659225127df970fa0c29907bb143112fc498ca330e80e7a294c33882e7
Jul 23 13:31:21.618861 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.618772    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7" event={"ID":"562187b5-4373-42dd-9748-4c711423df19","Type":"ContainerStarted","Data":"204b132ce29213a4e1514c59054969a08cc0b380888779108f1969fbe49d3487"}
Jul 23 13:31:21.618861 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.618822    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7" event={"ID":"562187b5-4373-42dd-9748-4c711423df19","Type":"ContainerStarted","Data":"ff89bf659225127df970fa0c29907bb143112fc498ca330e80e7a294c33882e7"}
Jul 23 13:31:21.639041 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:21.638975    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7" podStartSLOduration=1.638959429 podStartE2EDuration="1.638959429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:31:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:31:21.637472553 +0000 UTC m=+1423.890998431" watchObservedRunningTime="2026-07-23 13:31:21.638959429 +0000 UTC m=+1423.892485333"
Jul 23 13:31:31.273212 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:31.273121    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:31.273212 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:31.273184    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:31.285689 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:31.285664    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:31.673143 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:31.673069    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:31:49.591461 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:49.591427    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"]
Jul 23 13:31:49.836301 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:49.836263    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:31:50.056340 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:31:50.056308    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:32:04.611032 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.610952    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7" podUID="562187b5-4373-42dd-9748-4c711423df19" containerName="main" containerID="cri-o://204b132ce29213a4e1514c59054969a08cc0b380888779108f1969fbe49d3487" gracePeriod=45
Jul 23 13:32:04.817087 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.817050    2570 generic.go:356] "Generic (PLEG): container finished" podID="562187b5-4373-42dd-9748-4c711423df19" containerID="204b132ce29213a4e1514c59054969a08cc0b380888779108f1969fbe49d3487" exitCode=0
Jul 23 13:32:04.817244 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.817098    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7" event={"ID":"562187b5-4373-42dd-9748-4c711423df19","Type":"ContainerDied","Data":"204b132ce29213a4e1514c59054969a08cc0b380888779108f1969fbe49d3487"}
Jul 23 13:32:04.855033 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.855009    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:32:04.969146 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.969118    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-home\") pod \"562187b5-4373-42dd-9748-4c711423df19\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") "
Jul 23 13:32:04.969306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.969161    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-model-cache\") pod \"562187b5-4373-42dd-9748-4c711423df19\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") "
Jul 23 13:32:04.969306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.969184    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/562187b5-4373-42dd-9748-4c711423df19-tls-certs\") pod \"562187b5-4373-42dd-9748-4c711423df19\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") "
Jul 23 13:32:04.969306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.969211    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-tmp-dir\") pod \"562187b5-4373-42dd-9748-4c711423df19\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") "
Jul 23 13:32:04.969306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.969243    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tk84\" (UniqueName: \"kubernetes.io/projected/562187b5-4373-42dd-9748-4c711423df19-kube-api-access-6tk84\") pod \"562187b5-4373-42dd-9748-4c711423df19\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") "
Jul 23 13:32:04.969306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.969265    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-dshm\") pod \"562187b5-4373-42dd-9748-4c711423df19\" (UID: \"562187b5-4373-42dd-9748-4c711423df19\") "
Jul 23 13:32:04.969586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.969421    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-model-cache" (OuterVolumeSpecName: "model-cache") pod "562187b5-4373-42dd-9748-4c711423df19" (UID: "562187b5-4373-42dd-9748-4c711423df19"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:32:04.969586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.969427    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-home" (OuterVolumeSpecName: "home") pod "562187b5-4373-42dd-9748-4c711423df19" (UID: "562187b5-4373-42dd-9748-4c711423df19"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:32:04.969586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.969535    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-home\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:32:04.969586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.969547    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-model-cache\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:32:04.969586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.969540    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "562187b5-4373-42dd-9748-4c711423df19" (UID: "562187b5-4373-42dd-9748-4c711423df19"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:32:04.971450 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.971419    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/562187b5-4373-42dd-9748-4c711423df19-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "562187b5-4373-42dd-9748-4c711423df19" (UID: "562187b5-4373-42dd-9748-4c711423df19"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:32:04.971552 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.971466    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-dshm" (OuterVolumeSpecName: "dshm") pod "562187b5-4373-42dd-9748-4c711423df19" (UID: "562187b5-4373-42dd-9748-4c711423df19"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:32:04.971552 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:04.971499    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/562187b5-4373-42dd-9748-4c711423df19-kube-api-access-6tk84" (OuterVolumeSpecName: "kube-api-access-6tk84") pod "562187b5-4373-42dd-9748-4c711423df19" (UID: "562187b5-4373-42dd-9748-4c711423df19"). InnerVolumeSpecName "kube-api-access-6tk84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:32:05.070221 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:05.070186    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/562187b5-4373-42dd-9748-4c711423df19-tls-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:32:05.070383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:05.070235    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-tmp-dir\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:32:05.070383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:05.070246    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tk84\" (UniqueName: \"kubernetes.io/projected/562187b5-4373-42dd-9748-4c711423df19-kube-api-access-6tk84\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:32:05.070383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:05.070256    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/562187b5-4373-42dd-9748-4c711423df19-dshm\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:32:05.823338 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:05.823302    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7" event={"ID":"562187b5-4373-42dd-9748-4c711423df19","Type":"ContainerDied","Data":"ff89bf659225127df970fa0c29907bb143112fc498ca330e80e7a294c33882e7"}
Jul 23 13:32:05.823338 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:05.823334    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"
Jul 23 13:32:05.823871 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:05.823352    2570 scope.go:117] "RemoveContainer" containerID="204b132ce29213a4e1514c59054969a08cc0b380888779108f1969fbe49d3487"
Jul 23 13:32:05.847495 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:05.847471    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"]
Jul 23 13:32:05.852296 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:05.852277    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-56651086-kserve-695d6c49f9-vnkf7"]
Jul 23 13:32:06.357918 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:06.357885    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="562187b5-4373-42dd-9748-4c711423df19" path="/var/lib/kubelet/pods/562187b5-4373-42dd-9748-4c711423df19/volumes"
Jul 23 13:32:58.995431 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:32:58.995392    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:03.484918 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:03.484876    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:25.000939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:25.000906    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:28.083539 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:28.083502    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:28.177836 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:28.177805    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:28.572622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:28.572584    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:34.515941 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:34.515880    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:34.642057 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:34.642025    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:34.908352 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:34.908272    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:35.191638 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:35.191562    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:35.371943 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:35.371910    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:37.642237 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:37.642205    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:37.758336 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:37.758297    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:37.968532 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:37.968503    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:38.080114 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:38.080080    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:38.718796 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:38.718762    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:35:38.818739 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:35:38.818707    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:14.153728 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:14.153645    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:18.443100 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:18.443065    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:18.681727 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:18.681683    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:18.946434 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:18.946401    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:19.269614 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:19.269577    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:19.446132 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:19.446097    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:19.570752 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:19.570669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:20.114876 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:20.114842    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:20.290479 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:20.290445    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:23.112532 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:23.112499    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:23.317516 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:23.317482    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:23.529180 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:23.529150    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:24.206197 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:24.206166    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:24.320914 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:24.320875    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:36:58.851898 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:36:58.851863    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:03.370259 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:03.370223    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:03.531219 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:03.531185    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:03.919176 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:03.919144    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:04.107165 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:04.107133    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:04.503243 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:04.503212    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:05.022233 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:05.022200    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:07.233164 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:07.233130    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:07.361005 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:07.360947    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:07.468725 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:07.468687    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:07.805459 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:07.805430    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:08.413803 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:08.413776    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:08.536738 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:08.536708    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:43.813457 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:43.813423    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:48.204916 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:48.204880    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:49.493246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:49.493212    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:49.724280 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:49.724242    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:49.957389 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:49.957305    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:50.304928 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:50.304871    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:50.433517 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:50.433478    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:52.397774 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:52.397725    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:52.501670 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:52.501634    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:52.693788 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:52.693704    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:52.888898 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:52.888864    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:53.390057 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:53.390025    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:53.486833 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:53.486793    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:58.024707 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:58.024675    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:37:58.126195 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:37:58.126159    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:14.167276 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:14.167225    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:14.285119 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:14.285085    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:27.980735 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:27.980701    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:32.415431 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:32.415394    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:32.585194 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:32.585168    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:32.830921 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:32.830883    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:33.324750 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:33.324716    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:33.413042 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:33.413008    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:33.512846 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:33.512819    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:34.996512 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:34.996481    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:38.933905 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:38.933848    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:41.988212 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:41.988165    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:42.099298 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:42.099265    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:42.213506 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:42.213471    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:42.323546 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:42.323456    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:42.745434 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:42.745383    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:38:50.259323 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:38:50.259292    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:08.744267 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:08.744153    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:15.182975 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:15.182938    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:15.295905 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:15.295859    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:15.389399 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:15.389347    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:31.349534 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:31.349498    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:37.588095 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:37.588062    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:37.708703 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:37.708669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:37.833079 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:37.833043    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:44.693573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:44.693535    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:46.470627 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:46.470570    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:48.384498 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:48.384464    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:49.240946 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:49.240911    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:55.758696 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:55.758629    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:55.859175 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:55.859122    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:55.988545 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:55.988505    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:56.118466 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:56.118378    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:57.287257 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:57.287224    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:39:57.708482 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:39:57.708451    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:04.541524 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:04.541490    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:11.540677 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:11.540639    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:12.842476 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:12.842435    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:18.257642 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:18.257606    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:18.322755 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:18.322717    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:18.509287 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:18.509209    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:18.882305 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:18.882208    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:19.086880 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:19.086846    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:21.967967 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:21.967928    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:22.057702 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:22.057670    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:22.166876 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:22.166850    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:22.275021 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:22.274929    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:22.763100 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:22.763070    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:22.868230 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:22.868198    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:26.426938 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:26.426901    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:27.124913 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:27.124877    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:27.219710 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:27.219673    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:27.560610 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:27.560566    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:33.324551 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:33.324468    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:33.400665 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:33.400638    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:44.199752 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:44.199717    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:48.761773 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:48.761709    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:49.277386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:49.277355    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:55.051379 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:55.051342    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:55.151562 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:55.151533    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:55.350224 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:55.350144    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:55.588343 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:55.588312    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:55.718858 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:55.718826    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:55.821911 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:55.821878    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:40:55.939161 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:40:55.939126    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:01.862875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:01.862839    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:01.939341 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:01.939316    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:02.043801 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:02.043773    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:02.140717 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:02.140624    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:02.241496 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:02.241466    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:08.080921 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:08.080871    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:08.181609 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:08.181578    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:15.097727 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:15.097689    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:15.392938 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:15.392863    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:15.740245 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:15.740213    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:18.234209 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:18.228210    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:18.335751 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:18.335708    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:21.028843 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:21.028810    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:21.090589 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:21.090564    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:22.753216 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:22.753182    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:28.241316 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.241279    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"]
Jul 23 13:41:28.241807 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.241789    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="562187b5-4373-42dd-9748-4c711423df19" containerName="main"
Jul 23 13:41:28.241856 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.241814    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="562187b5-4373-42dd-9748-4c711423df19" containerName="main"
Jul 23 13:41:28.241911 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.241899    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="562187b5-4373-42dd-9748-4c711423df19" containerName="main"
Jul 23 13:41:28.245153 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.245135    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.249018 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.248966    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-da798329\"/\"kube-root-ca.crt\""
Jul 23 13:41:28.249018 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.248963    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-da798329\"/\"openshift-service-ca.crt\""
Jul 23 13:41:28.249204 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.248963    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-da798329\"/\"default-dockercfg-rfrjf\""
Jul 23 13:41:28.249204 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.248969    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-da798329\"/\"e2e-lifecycle-model-da798329-kserve-self-signed-certs\""
Jul 23 13:41:28.255115 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.255068    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"]
Jul 23 13:41:28.279910 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.279872    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:41:28.318045 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.318019    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-home\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.318159 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.318047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-tls-certs\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.318159 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.318090    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-dshm\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.318239 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.318170    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-tmp-dir\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.318239 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.318205    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nm8p\" (UniqueName: \"kubernetes.io/projected/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-kube-api-access-9nm8p\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.318306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.318257    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-model-cache\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.419622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.419596    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-dshm\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.419764 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.419633    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-tmp-dir\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.419764 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.419653    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nm8p\" (UniqueName: \"kubernetes.io/projected/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-kube-api-access-9nm8p\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.419764 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.419695    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-model-cache\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.419764 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.419719    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-home\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.419764 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.419738    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-tls-certs\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.420095 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.420074    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-tmp-dir\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.420160 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.420118    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-model-cache\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.420201 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.420165    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-home\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.421673 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.421649    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-dshm\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.421959 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.421944    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-tls-certs\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.429264 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.429245    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nm8p\" (UniqueName: \"kubernetes.io/projected/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-kube-api-access-9nm8p\") pod \"e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") " pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.555953 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.555892    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:28.935173 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:28.935142    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"]
Jul 23 13:41:28.939357 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:41:28.939334    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5192df7_0c18_4688_a2b5_3b7bbc3c0946.slice/crio-5d945e01ed455694f851ef786b61dfabf630d1e4831f942f5d8f76747b75ef60 WatchSource:0}: Error finding container 5d945e01ed455694f851ef786b61dfabf630d1e4831f942f5d8f76747b75ef60: Status 404 returned error can't find the container with id 5d945e01ed455694f851ef786b61dfabf630d1e4831f942f5d8f76747b75ef60
Jul 23 13:41:29.317441 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:29.317410    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj" event={"ID":"c5192df7-0c18-4688-a2b5-3b7bbc3c0946","Type":"ContainerStarted","Data":"fbbf0f9aa82f50821f894a8d6751258e32ca5024718279a6439beb8244a7495e"}
Jul 23 13:41:29.317441 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:29.317448    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj" event={"ID":"c5192df7-0c18-4688-a2b5-3b7bbc3c0946","Type":"ContainerStarted","Data":"5d945e01ed455694f851ef786b61dfabf630d1e4831f942f5d8f76747b75ef60"}
Jul 23 13:41:29.337572 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:29.337531    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj" podStartSLOduration=1.337516113 podStartE2EDuration="1.337516113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:41:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:29.335387334 +0000 UTC m=+2031.588913213" watchObservedRunningTime="2026-07-23 13:41:29.337516113 +0000 UTC m=+2031.591041988"
Jul 23 13:41:38.556821 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:38.556785    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:38.556821 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:38.556827    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:38.568946 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:38.568929    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:41:39.374954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:41:39.374929    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:42:22.142412 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:22.142329    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:26.688978 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:26.688942    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:29.153362 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:29.153286    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:34.092222 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:34.092185    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"]
Jul 23 13:42:34.186854 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:34.186821    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:49.111954 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.111916    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj" podUID="c5192df7-0c18-4688-a2b5-3b7bbc3c0946" containerName="main" containerID="cri-o://fbbf0f9aa82f50821f894a8d6751258e32ca5024718279a6439beb8244a7495e" gracePeriod=45
Jul 23 13:42:49.356042 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.356019    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:42:49.492004 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.491963    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-tls-certs\") pod \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") "
Jul 23 13:42:49.492149 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.492020    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-model-cache\") pod \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") "
Jul 23 13:42:49.492149 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.492126    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-home\") pod \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") "
Jul 23 13:42:49.492246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.492150    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-dshm\") pod \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") "
Jul 23 13:42:49.492246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.492204    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-tmp-dir\") pod \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") "
Jul 23 13:42:49.492246 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.492230    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nm8p\" (UniqueName: \"kubernetes.io/projected/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-kube-api-access-9nm8p\") pod \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\" (UID: \"c5192df7-0c18-4688-a2b5-3b7bbc3c0946\") "
Jul 23 13:42:49.492398 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.492259    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-model-cache" (OuterVolumeSpecName: "model-cache") pod "c5192df7-0c18-4688-a2b5-3b7bbc3c0946" (UID: "c5192df7-0c18-4688-a2b5-3b7bbc3c0946"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:42:49.492458 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.492418    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-home" (OuterVolumeSpecName: "home") pod "c5192df7-0c18-4688-a2b5-3b7bbc3c0946" (UID: "c5192df7-0c18-4688-a2b5-3b7bbc3c0946"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:42:49.492520 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.492463    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c5192df7-0c18-4688-a2b5-3b7bbc3c0946" (UID: "c5192df7-0c18-4688-a2b5-3b7bbc3c0946"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:42:49.492595 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.492530    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-home\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:42:49.492595 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.492555    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-model-cache\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:42:49.494188 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.494165    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-dshm" (OuterVolumeSpecName: "dshm") pod "c5192df7-0c18-4688-a2b5-3b7bbc3c0946" (UID: "c5192df7-0c18-4688-a2b5-3b7bbc3c0946"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:42:49.494188 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.494169    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c5192df7-0c18-4688-a2b5-3b7bbc3c0946" (UID: "c5192df7-0c18-4688-a2b5-3b7bbc3c0946"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:42:49.494362 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.494250    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-kube-api-access-9nm8p" (OuterVolumeSpecName: "kube-api-access-9nm8p") pod "c5192df7-0c18-4688-a2b5-3b7bbc3c0946" (UID: "c5192df7-0c18-4688-a2b5-3b7bbc3c0946"). InnerVolumeSpecName "kube-api-access-9nm8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:42:49.593420 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.593395    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-tmp-dir\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:42:49.593420 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.593419    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nm8p\" (UniqueName: \"kubernetes.io/projected/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-kube-api-access-9nm8p\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:42:49.593565 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.593428    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-tls-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:42:49.593565 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.593436    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5192df7-0c18-4688-a2b5-3b7bbc3c0946-dshm\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:42:49.670565 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.670539    2570 generic.go:356] "Generic (PLEG): container finished" podID="c5192df7-0c18-4688-a2b5-3b7bbc3c0946" containerID="fbbf0f9aa82f50821f894a8d6751258e32ca5024718279a6439beb8244a7495e" exitCode=0
Jul 23 13:42:49.670677 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.670583    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"
Jul 23 13:42:49.670677 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.670627    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj" event={"ID":"c5192df7-0c18-4688-a2b5-3b7bbc3c0946","Type":"ContainerDied","Data":"fbbf0f9aa82f50821f894a8d6751258e32ca5024718279a6439beb8244a7495e"}
Jul 23 13:42:49.670677 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.670666    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj" event={"ID":"c5192df7-0c18-4688-a2b5-3b7bbc3c0946","Type":"ContainerDied","Data":"5d945e01ed455694f851ef786b61dfabf630d1e4831f942f5d8f76747b75ef60"}
Jul 23 13:42:49.670804 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.670682    2570 scope.go:117] "RemoveContainer" containerID="fbbf0f9aa82f50821f894a8d6751258e32ca5024718279a6439beb8244a7495e"
Jul 23 13:42:49.678634 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.678620    2570 scope.go:117] "RemoveContainer" containerID="fbbf0f9aa82f50821f894a8d6751258e32ca5024718279a6439beb8244a7495e"
Jul 23 13:42:49.678858 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:42:49.678843    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbbf0f9aa82f50821f894a8d6751258e32ca5024718279a6439beb8244a7495e\": container with ID starting with fbbf0f9aa82f50821f894a8d6751258e32ca5024718279a6439beb8244a7495e not found: ID does not exist" containerID="fbbf0f9aa82f50821f894a8d6751258e32ca5024718279a6439beb8244a7495e"
Jul 23 13:42:49.678917 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.678864    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbbf0f9aa82f50821f894a8d6751258e32ca5024718279a6439beb8244a7495e"} err="failed to get container status \"fbbf0f9aa82f50821f894a8d6751258e32ca5024718279a6439beb8244a7495e\": rpc error: code = NotFound desc = could not find container \"fbbf0f9aa82f50821f894a8d6751258e32ca5024718279a6439beb8244a7495e\": container with ID starting with fbbf0f9aa82f50821f894a8d6751258e32ca5024718279a6439beb8244a7495e not found: ID does not exist"
Jul 23 13:42:49.695304 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.695286    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"]
Jul 23 13:42:49.699799 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:49.699771    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-da798329/e2e-lifecycle-model-da798329-kserve-6778bc947-8fkmj"]
Jul 23 13:42:50.357868 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:50.357837    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5192df7-0c18-4688-a2b5-3b7bbc3c0946" path="/var/lib/kubelet/pods/c5192df7-0c18-4688-a2b5-3b7bbc3c0946/volumes"
Jul 23 13:42:58.928870 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:58.928811    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:42:59.035557 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:42:59.035517    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:10.568550 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:10.568509    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:11.596324 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:11.596272    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:17.254876 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:17.254841    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:17.359225 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:17.359196    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:17.644316 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:17.644238    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:17.880120 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:17.880084    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:19.099465 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:19.099432    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:19.314474 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:19.314433    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:20.105190 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:20.105136    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:20.202546 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:20.202513    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:20.444583 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:20.444486    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:21.927820 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:21.927776    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:28.650296 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:28.650259    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:28.746760 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:28.746720    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:29.518031 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:29.517997    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:35.915690 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:35.915658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:36.068006 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:36.067957    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:36.157497 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:36.157468    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:47.327482 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:47.327442    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:47.427225 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:47.427194    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:53.807558 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:53.807523    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:43:57.957311 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:43:57.957281    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:08.278797 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:08.278767    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:14.542605 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:14.542565    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:14.643714 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:14.643675    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:14.917255 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:14.917174    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:15.244337 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:15.244297    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:15.355201 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:15.355173    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:18.223843 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:18.223810    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:18.341068 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:18.341014    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:18.877101 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:18.877063    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:18.979106 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:18.979076    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:19.137721 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:19.137650    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:19.231712 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:19.231681    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:22.732461 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:22.732432    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:23.080794 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:23.080719    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:23.404508 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:23.404438    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:23.600896 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:23.600864    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:26.289462 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:26.289427    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:26.463501 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:26.463473    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:26.584540 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:26.584464    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:27.056170 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:27.056138    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:27.406254 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:27.406167    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:27.508904 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:27.508878    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:30.784818 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:30.784781    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:40.001934 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:40.001894    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:40.108181 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:40.108147    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:41.867420 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:41.867388    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"]
Jul 23 13:44:41.867796 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:41.867723    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5192df7-0c18-4688-a2b5-3b7bbc3c0946" containerName="main"
Jul 23 13:44:41.867796 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:41.867737    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5192df7-0c18-4688-a2b5-3b7bbc3c0946" containerName="main"
Jul 23 13:44:41.867796 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:41.867789    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5192df7-0c18-4688-a2b5-3b7bbc3c0946" containerName="main"
Jul 23 13:44:41.870530 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:41.870509    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:41.873207 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:41.873186    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-98925a\"/\"openshift-service-ca.crt\""
Jul 23 13:44:41.873302 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:41.873186    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-98925a\"/\"kube-root-ca.crt\""
Jul 23 13:44:41.874173 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:41.874153    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-98925a\"/\"default-dockercfg-vxqbt\""
Jul 23 13:44:41.874291 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:41.874228    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-98925a\"/\"test-model-98925a-kserve-self-signed-certs\""
Jul 23 13:44:41.884149 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:41.884128    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"]
Jul 23 13:44:42.021527 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.021501    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-home\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.021527 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.021528    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-tmp-dir\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.021715 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.021548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-dshm\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.021715 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.021568    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-model-cache\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.021715 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.021683    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/002c24f9-131e-478f-bc2b-a525173fcde1-tls-certs\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.021840 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.021727    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxvp9\" (UniqueName: \"kubernetes.io/projected/002c24f9-131e-478f-bc2b-a525173fcde1-kube-api-access-dxvp9\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.062548 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.062522    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:42.122958 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.122894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxvp9\" (UniqueName: \"kubernetes.io/projected/002c24f9-131e-478f-bc2b-a525173fcde1-kube-api-access-dxvp9\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.123073 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.122971    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-home\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.123073 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.123015    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-tmp-dir\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.123073 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.123044    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-dshm\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.123073 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.123066    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-model-cache\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.123258 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.123103    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/002c24f9-131e-478f-bc2b-a525173fcde1-tls-certs\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.123434 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.123411    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-tmp-dir\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.123434 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.123426    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-home\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.123548 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.123475    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-model-cache\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.125252 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.125234    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-dshm\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.125602 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.125584    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/002c24f9-131e-478f-bc2b-a525173fcde1-tls-certs\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.131523 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.131502    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxvp9\" (UniqueName: \"kubernetes.io/projected/002c24f9-131e-478f-bc2b-a525173fcde1-kube-api-access-dxvp9\") pod \"test-model-98925a-kserve-75d45f99c-fdxwn\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") " pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.179282 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.179259    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:42.307580 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:42.307523    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"]
Jul 23 13:44:42.309831 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:44:42.309805    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod002c24f9_131e_478f_bc2b_a525173fcde1.slice/crio-5d85537226696ea0b6e01a5b3c93cc082559d0bb3a8459936d789c24e4efb4cf WatchSource:0}: Error finding container 5d85537226696ea0b6e01a5b3c93cc082559d0bb3a8459936d789c24e4efb4cf: Status 404 returned error can't find the container with id 5d85537226696ea0b6e01a5b3c93cc082559d0bb3a8459936d789c24e4efb4cf
Jul 23 13:44:43.187905 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:43.187871    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn" event={"ID":"002c24f9-131e-478f-bc2b-a525173fcde1","Type":"ContainerStarted","Data":"91a87d2531d50c3dcddabdbe4601295f4792e660bb276782e8dcc5f04c196d97"}
Jul 23 13:44:43.188294 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:43.187909    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn" event={"ID":"002c24f9-131e-478f-bc2b-a525173fcde1","Type":"ContainerStarted","Data":"5d85537226696ea0b6e01a5b3c93cc082559d0bb3a8459936d789c24e4efb4cf"}
Jul 23 13:44:43.206803 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:43.206758    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn" podStartSLOduration=2.206743065 podStartE2EDuration="2.206743065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:44:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:44:43.205296428 +0000 UTC m=+2225.458822304" watchObservedRunningTime="2026-07-23 13:44:43.206743065 +0000 UTC m=+2225.460268962"
Jul 23 13:44:48.203038 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:48.203005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:48.310720 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:48.310690    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:44:52.179433 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:52.179388    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:52.181830 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:52.179452    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:52.195722 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:52.195693    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:44:52.244094 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:44:52.244065    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:45:15.671136 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.671061    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"]
Jul 23 13:45:15.674380 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.674360    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.678831 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.678809    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-38ab5f\"/\"kube-root-ca.crt\""
Jul 23 13:45:15.678831 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.678823    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-38ab5f\"/\"test-model-38ab5f-kserve-self-signed-certs\""
Jul 23 13:45:15.679047 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.678842    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-38ab5f\"/\"default-dockercfg-2jhtt\""
Jul 23 13:45:15.679047 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.678881    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-38ab5f\"/\"openshift-service-ca.crt\""
Jul 23 13:45:15.684786 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.684765    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"]
Jul 23 13:45:15.766106 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.766075    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:45:15.796261 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.796237    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-tmp-dir\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.796379 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.796264    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htmrc\" (UniqueName: \"kubernetes.io/projected/f129beb0-a017-4bc9-bf9c-ed56151dade2-kube-api-access-htmrc\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.796379 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.796291    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f129beb0-a017-4bc9-bf9c-ed56151dade2-tls-certs\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.796379 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.796317    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-model-cache\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.796486 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.796381    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-home\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.796486 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.796437    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-dshm\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.897293 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.897262    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-model-cache\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.897427 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.897316    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-home\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.897427 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.897410    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-dshm\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.897510 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.897451    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-tmp-dir\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.897510 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.897470    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htmrc\" (UniqueName: \"kubernetes.io/projected/f129beb0-a017-4bc9-bf9c-ed56151dade2-kube-api-access-htmrc\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.897510 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.897507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f129beb0-a017-4bc9-bf9c-ed56151dade2-tls-certs\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.897725 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.897701    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-model-cache\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.897791 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.897718    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-home\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.897848 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.897829    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-tmp-dir\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.899660 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.899641    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-dshm\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.899836 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.899817    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f129beb0-a017-4bc9-bf9c-ed56151dade2-tls-certs\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.915158 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.915137    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htmrc\" (UniqueName: \"kubernetes.io/projected/f129beb0-a017-4bc9-bf9c-ed56151dade2-kube-api-access-htmrc\") pod \"test-model-38ab5f-kserve-57797d6d99-l696r\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") " pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:15.984712 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:15.984687    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:16.117861 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:16.117832    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"]
Jul 23 13:45:16.121698 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:45:16.121668    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf129beb0_a017_4bc9_bf9c_ed56151dade2.slice/crio-34c9a9011aa933cc52e632089a1683ec2a481b0447ea78303431e753d149704b WatchSource:0}: Error finding container 34c9a9011aa933cc52e632089a1683ec2a481b0447ea78303431e753d149704b: Status 404 returned error can't find the container with id 34c9a9011aa933cc52e632089a1683ec2a481b0447ea78303431e753d149704b
Jul 23 13:45:16.340607 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:16.340513    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r" event={"ID":"f129beb0-a017-4bc9-bf9c-ed56151dade2","Type":"ContainerStarted","Data":"9a4d3cee50d9ce353675ee6f138ff78c7b6002cfc955363ea283501e13e63f80"}
Jul 23 13:45:16.340607 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:16.340573    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r" event={"ID":"f129beb0-a017-4bc9-bf9c-ed56151dade2","Type":"ContainerStarted","Data":"34c9a9011aa933cc52e632089a1683ec2a481b0447ea78303431e753d149704b"}
Jul 23 13:45:16.362818 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:16.362771    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r" podStartSLOduration=1.362753371 podStartE2EDuration="1.362753371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:45:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:45:16.362042191 +0000 UTC m=+2258.615568067" watchObservedRunningTime="2026-07-23 13:45:16.362753371 +0000 UTC m=+2258.616279247"
Jul 23 13:45:25.985824 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:25.985785    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:25.986429 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:25.985856    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:26.002215 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:26.002189    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:45:26.395746 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:45:26.395679    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:46:00.874183 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:00.874151    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"]
Jul 23 13:46:00.910921 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:00.910894    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:01.741730 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:01.741695    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"]
Jul 23 13:46:01.763111 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:01.763077    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:02.605078 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:02.605043    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:02.705197 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:02.705166    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:12.351591 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:12.351560    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:15.893783 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:15.893727    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn" podUID="002c24f9-131e-478f-bc2b-a525173fcde1" containerName="main" containerID="cri-o://91a87d2531d50c3dcddabdbe4601295f4792e660bb276782e8dcc5f04c196d97" gracePeriod=45
Jul 23 13:46:16.142627 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.142604    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:46:16.182262 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.182196    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-tmp-dir\") pod \"002c24f9-131e-478f-bc2b-a525173fcde1\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") "
Jul 23 13:46:16.182262 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.182238    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-home\") pod \"002c24f9-131e-478f-bc2b-a525173fcde1\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") "
Jul 23 13:46:16.182428 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.182288    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-model-cache\") pod \"002c24f9-131e-478f-bc2b-a525173fcde1\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") "
Jul 23 13:46:16.182428 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.182305    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/002c24f9-131e-478f-bc2b-a525173fcde1-tls-certs\") pod \"002c24f9-131e-478f-bc2b-a525173fcde1\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") "
Jul 23 13:46:16.182428 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.182322    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-dshm\") pod \"002c24f9-131e-478f-bc2b-a525173fcde1\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") "
Jul 23 13:46:16.182428 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.182369    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxvp9\" (UniqueName: \"kubernetes.io/projected/002c24f9-131e-478f-bc2b-a525173fcde1-kube-api-access-dxvp9\") pod \"002c24f9-131e-478f-bc2b-a525173fcde1\" (UID: \"002c24f9-131e-478f-bc2b-a525173fcde1\") "
Jul 23 13:46:16.182645 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.182517    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "002c24f9-131e-478f-bc2b-a525173fcde1" (UID: "002c24f9-131e-478f-bc2b-a525173fcde1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:46:16.182645 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.182544    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-model-cache" (OuterVolumeSpecName: "model-cache") pod "002c24f9-131e-478f-bc2b-a525173fcde1" (UID: "002c24f9-131e-478f-bc2b-a525173fcde1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:46:16.182645 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.182591    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-home" (OuterVolumeSpecName: "home") pod "002c24f9-131e-478f-bc2b-a525173fcde1" (UID: "002c24f9-131e-478f-bc2b-a525173fcde1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:46:16.182797 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.182701    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-tmp-dir\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:46:16.182797 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.182718    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-home\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:46:16.182797 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.182733    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-model-cache\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:46:16.184508 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.184482    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002c24f9-131e-478f-bc2b-a525173fcde1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "002c24f9-131e-478f-bc2b-a525173fcde1" (UID: "002c24f9-131e-478f-bc2b-a525173fcde1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:46:16.184847 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.184829    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/002c24f9-131e-478f-bc2b-a525173fcde1-kube-api-access-dxvp9" (OuterVolumeSpecName: "kube-api-access-dxvp9") pod "002c24f9-131e-478f-bc2b-a525173fcde1" (UID: "002c24f9-131e-478f-bc2b-a525173fcde1"). InnerVolumeSpecName "kube-api-access-dxvp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:46:16.184913 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.184827    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-dshm" (OuterVolumeSpecName: "dshm") pod "002c24f9-131e-478f-bc2b-a525173fcde1" (UID: "002c24f9-131e-478f-bc2b-a525173fcde1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:46:16.283407 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.283367    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/002c24f9-131e-478f-bc2b-a525173fcde1-tls-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:46:16.283407 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.283405    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/002c24f9-131e-478f-bc2b-a525173fcde1-dshm\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:46:16.283549 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.283420    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxvp9\" (UniqueName: \"kubernetes.io/projected/002c24f9-131e-478f-bc2b-a525173fcde1-kube-api-access-dxvp9\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:46:16.610582 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.610553    2570 generic.go:356] "Generic (PLEG): container finished" podID="002c24f9-131e-478f-bc2b-a525173fcde1" containerID="91a87d2531d50c3dcddabdbe4601295f4792e660bb276782e8dcc5f04c196d97" exitCode=0
Jul 23 13:46:16.610764 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.610594    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"
Jul 23 13:46:16.610764 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.610626    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn" event={"ID":"002c24f9-131e-478f-bc2b-a525173fcde1","Type":"ContainerDied","Data":"91a87d2531d50c3dcddabdbe4601295f4792e660bb276782e8dcc5f04c196d97"}
Jul 23 13:46:16.610764 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.610673    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn" event={"ID":"002c24f9-131e-478f-bc2b-a525173fcde1","Type":"ContainerDied","Data":"5d85537226696ea0b6e01a5b3c93cc082559d0bb3a8459936d789c24e4efb4cf"}
Jul 23 13:46:16.610764 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.610699    2570 scope.go:117] "RemoveContainer" containerID="91a87d2531d50c3dcddabdbe4601295f4792e660bb276782e8dcc5f04c196d97"
Jul 23 13:46:16.618529 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.618513    2570 scope.go:117] "RemoveContainer" containerID="91a87d2531d50c3dcddabdbe4601295f4792e660bb276782e8dcc5f04c196d97"
Jul 23 13:46:16.618768 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:46:16.618750    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91a87d2531d50c3dcddabdbe4601295f4792e660bb276782e8dcc5f04c196d97\": container with ID starting with 91a87d2531d50c3dcddabdbe4601295f4792e660bb276782e8dcc5f04c196d97 not found: ID does not exist" containerID="91a87d2531d50c3dcddabdbe4601295f4792e660bb276782e8dcc5f04c196d97"
Jul 23 13:46:16.618826 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.618775    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91a87d2531d50c3dcddabdbe4601295f4792e660bb276782e8dcc5f04c196d97"} err="failed to get container status \"91a87d2531d50c3dcddabdbe4601295f4792e660bb276782e8dcc5f04c196d97\": rpc error: code = NotFound desc = could not find container \"91a87d2531d50c3dcddabdbe4601295f4792e660bb276782e8dcc5f04c196d97\": container with ID starting with 91a87d2531d50c3dcddabdbe4601295f4792e660bb276782e8dcc5f04c196d97 not found: ID does not exist"
Jul 23 13:46:16.639034 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.639012    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"]
Jul 23 13:46:16.651765 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.651742    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-98925a/test-model-98925a-kserve-75d45f99c-fdxwn"]
Jul 23 13:46:16.761171 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:16.761142    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r" podUID="f129beb0-a017-4bc9-bf9c-ed56151dade2" containerName="main" containerID="cri-o://9a4d3cee50d9ce353675ee6f138ff78c7b6002cfc955363ea283501e13e63f80" gracePeriod=45
Jul 23 13:46:17.003194 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.003166    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:46:17.079732 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.079705    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:17.090727 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.090701    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f129beb0-a017-4bc9-bf9c-ed56151dade2-tls-certs\") pod \"f129beb0-a017-4bc9-bf9c-ed56151dade2\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") "
Jul 23 13:46:17.090861 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.090745    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htmrc\" (UniqueName: \"kubernetes.io/projected/f129beb0-a017-4bc9-bf9c-ed56151dade2-kube-api-access-htmrc\") pod \"f129beb0-a017-4bc9-bf9c-ed56151dade2\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") "
Jul 23 13:46:17.090861 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.090762    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-dshm\") pod \"f129beb0-a017-4bc9-bf9c-ed56151dade2\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") "
Jul 23 13:46:17.090861 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.090798    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-tmp-dir\") pod \"f129beb0-a017-4bc9-bf9c-ed56151dade2\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") "
Jul 23 13:46:17.090861 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.090825    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-home\") pod \"f129beb0-a017-4bc9-bf9c-ed56151dade2\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") "
Jul 23 13:46:17.090861 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.090849    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-model-cache\") pod \"f129beb0-a017-4bc9-bf9c-ed56151dade2\" (UID: \"f129beb0-a017-4bc9-bf9c-ed56151dade2\") "
Jul 23 13:46:17.091154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.091105    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-home" (OuterVolumeSpecName: "home") pod "f129beb0-a017-4bc9-bf9c-ed56151dade2" (UID: "f129beb0-a017-4bc9-bf9c-ed56151dade2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:46:17.091154 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.091120    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f129beb0-a017-4bc9-bf9c-ed56151dade2" (UID: "f129beb0-a017-4bc9-bf9c-ed56151dade2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:46:17.091277 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.091206    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-model-cache" (OuterVolumeSpecName: "model-cache") pod "f129beb0-a017-4bc9-bf9c-ed56151dade2" (UID: "f129beb0-a017-4bc9-bf9c-ed56151dade2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:46:17.093019 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.092971    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-dshm" (OuterVolumeSpecName: "dshm") pod "f129beb0-a017-4bc9-bf9c-ed56151dade2" (UID: "f129beb0-a017-4bc9-bf9c-ed56151dade2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:46:17.093126 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.093066    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f129beb0-a017-4bc9-bf9c-ed56151dade2-kube-api-access-htmrc" (OuterVolumeSpecName: "kube-api-access-htmrc") pod "f129beb0-a017-4bc9-bf9c-ed56151dade2" (UID: "f129beb0-a017-4bc9-bf9c-ed56151dade2"). InnerVolumeSpecName "kube-api-access-htmrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:46:17.093126 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.093116    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f129beb0-a017-4bc9-bf9c-ed56151dade2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f129beb0-a017-4bc9-bf9c-ed56151dade2" (UID: "f129beb0-a017-4bc9-bf9c-ed56151dade2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:46:17.191850 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.191804    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htmrc\" (UniqueName: \"kubernetes.io/projected/f129beb0-a017-4bc9-bf9c-ed56151dade2-kube-api-access-htmrc\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:46:17.191850 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.191823    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-dshm\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:46:17.191850 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.191832    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-tmp-dir\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:46:17.191850 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.191840    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-home\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:46:17.191850 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.191849    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f129beb0-a017-4bc9-bf9c-ed56151dade2-model-cache\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:46:17.191850 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.191857    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f129beb0-a017-4bc9-bf9c-ed56151dade2-tls-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:46:17.510664 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.510629    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:17.617709 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.617679    2570 generic.go:356] "Generic (PLEG): container finished" podID="f129beb0-a017-4bc9-bf9c-ed56151dade2" containerID="9a4d3cee50d9ce353675ee6f138ff78c7b6002cfc955363ea283501e13e63f80" exitCode=0
Jul 23 13:46:17.617890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.617717    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"
Jul 23 13:46:17.617890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.617741    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r" event={"ID":"f129beb0-a017-4bc9-bf9c-ed56151dade2","Type":"ContainerDied","Data":"9a4d3cee50d9ce353675ee6f138ff78c7b6002cfc955363ea283501e13e63f80"}
Jul 23 13:46:17.617890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.617771    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r" event={"ID":"f129beb0-a017-4bc9-bf9c-ed56151dade2","Type":"ContainerDied","Data":"34c9a9011aa933cc52e632089a1683ec2a481b0447ea78303431e753d149704b"}
Jul 23 13:46:17.617890 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.617788    2570 scope.go:117] "RemoveContainer" containerID="9a4d3cee50d9ce353675ee6f138ff78c7b6002cfc955363ea283501e13e63f80"
Jul 23 13:46:17.626270 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.626246    2570 scope.go:117] "RemoveContainer" containerID="9a4d3cee50d9ce353675ee6f138ff78c7b6002cfc955363ea283501e13e63f80"
Jul 23 13:46:17.626565 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:46:17.626538    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a4d3cee50d9ce353675ee6f138ff78c7b6002cfc955363ea283501e13e63f80\": container with ID starting with 9a4d3cee50d9ce353675ee6f138ff78c7b6002cfc955363ea283501e13e63f80 not found: ID does not exist" containerID="9a4d3cee50d9ce353675ee6f138ff78c7b6002cfc955363ea283501e13e63f80"
Jul 23 13:46:17.626665 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.626572    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a4d3cee50d9ce353675ee6f138ff78c7b6002cfc955363ea283501e13e63f80"} err="failed to get container status \"9a4d3cee50d9ce353675ee6f138ff78c7b6002cfc955363ea283501e13e63f80\": rpc error: code = NotFound desc = could not find container \"9a4d3cee50d9ce353675ee6f138ff78c7b6002cfc955363ea283501e13e63f80\": container with ID starting with 9a4d3cee50d9ce353675ee6f138ff78c7b6002cfc955363ea283501e13e63f80 not found: ID does not exist"
Jul 23 13:46:17.641072 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.641047    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"]
Jul 23 13:46:17.653675 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:17.653651    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-38ab5f/test-model-38ab5f-kserve-57797d6d99-l696r"]
Jul 23 13:46:18.362156 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:18.362121    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="002c24f9-131e-478f-bc2b-a525173fcde1" path="/var/lib/kubelet/pods/002c24f9-131e-478f-bc2b-a525173fcde1/volumes"
Jul 23 13:46:18.362536 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:18.362506    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f129beb0-a017-4bc9-bf9c-ed56151dade2" path="/var/lib/kubelet/pods/f129beb0-a017-4bc9-bf9c-ed56151dade2/volumes"
Jul 23 13:46:23.744031 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:23.743977    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:23.810370 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:23.810330    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:24.037016 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:24.036910    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:24.349487 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:24.349410    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:25.002316 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:25.002284    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:25.105915 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:25.105885    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:34.898349 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:34.898265    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:39.528766 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:39.528710    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:39.940914 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:39.940836    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:45.794370 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:45.794333    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:45.868359 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:45.868319    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:46.248029 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:46.247995    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:46.438689 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:46.438654    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:46.778998 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:46.778957    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:47.161903 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:47.161824    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:47.549677 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:47.549640    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:50.117910 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:50.117874    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:50.212346 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:50.212312    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:50.388339 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:50.388262    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:50.624258 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:50.624224    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:50.928043 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:50.928009    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:51.028563 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:51.028521    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:54.643266 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:54.643228    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:55.145585 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:55.145538    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:55.524901 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:55.524863    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:56.001360 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:56.001326    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:58.245623 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:58.245588    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:58.914593 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:58.914564    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:59.026510 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:59.026483    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:59.209857 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:59.209825    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:46:59.314004 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:46:59.313964    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:02.756110 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:02.756083    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:11.447897 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:11.447856    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:11.548614 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:11.548580    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:15.089136 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:15.089067    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:15.193051 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:15.193019    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:20.034142 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:20.034107    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:20.138761 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:20.138726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:21.609844 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:21.609790    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:21.709971 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:21.709927    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:26.888505 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:26.888474    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:30.985192 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:30.985161    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:31.401820 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:31.401735    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:37.339939 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:37.339898    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:37.414323 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:37.414293    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:37.662105 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:37.662025    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:37.881358 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:37.881323    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:38.698873 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:38.698842    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:38.824544 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:38.824498    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:53.542455 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:53.542425    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:58.102289 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:58.102256    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:58.483251 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:58.483217    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:59.709750 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:59.709661    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:47:59.810046 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:47:59.810005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:04.582303 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:04.582271    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:04.680962 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:04.680928    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:04.856348 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:04.856277    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:05.098241 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:05.098208    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:05.497656 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:05.497623    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:05.894338 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:05.894256    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:06.302115 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:06.302083    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:08.638115 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:08.638080    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:08.757614 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:08.757579    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:08.837427 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:08.837386    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:09.249850 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:09.249809    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:09.417472 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:09.417438    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:09.511555 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:09.511490    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:13.116794 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:13.116757    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:13.454901 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:13.454833    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:13.832792 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:13.832762    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:14.145976 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:14.145899    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:16.702713 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:16.702673    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:16.834157 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:16.834121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:16.980567 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:16.980517    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:17.333325 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:17.333233    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:18.079819 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:18.079779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:18.185102 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:18.185068    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:21.190672 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:21.190640    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:30.275461 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:30.275424    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:30.375460 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:30.375431    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:37.052633 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.052603    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"]
Jul 23 13:48:37.053264 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.052930    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="002c24f9-131e-478f-bc2b-a525173fcde1" containerName="main"
Jul 23 13:48:37.053264 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.052941    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="002c24f9-131e-478f-bc2b-a525173fcde1" containerName="main"
Jul 23 13:48:37.053264 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.052949    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f129beb0-a017-4bc9-bf9c-ed56151dade2" containerName="main"
Jul 23 13:48:37.053264 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.052955    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f129beb0-a017-4bc9-bf9c-ed56151dade2" containerName="main"
Jul 23 13:48:37.053264 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.053027    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f129beb0-a017-4bc9-bf9c-ed56151dade2" containerName="main"
Jul 23 13:48:37.053264 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.053038    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="002c24f9-131e-478f-bc2b-a525173fcde1" containerName="main"
Jul 23 13:48:37.055960 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.055938    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.059685 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.059659    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5ddc60\"/\"kube-root-ca.crt\""
Jul 23 13:48:37.059816 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.059688    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5ddc60\"/\"default-dockercfg-qp87l\""
Jul 23 13:48:37.059816 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.059709    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5ddc60\"/\"openshift-service-ca.crt\""
Jul 23 13:48:37.059816 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.059795    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5ddc60\"/\"auth-test-model-5ddc60-kserve-self-signed-certs\""
Jul 23 13:48:37.066108 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.066077    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"]
Jul 23 13:48:37.083686 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.083661    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:37.227082 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.227043    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-model-cache\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.227236 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.227111    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-tmp-dir\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.227236 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.227157    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-dshm\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.227236 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.227181    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59c2825e-5d24-426d-bbc9-fcffc165cc60-tls-certs\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.227236 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.227210    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgbwx\" (UniqueName: \"kubernetes.io/projected/59c2825e-5d24-426d-bbc9-fcffc165cc60-kube-api-access-fgbwx\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.227396 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.227267    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-home\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.328303 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.328236    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-tmp-dir\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.328303 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.328275    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-dshm\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.328303 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.328291    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59c2825e-5d24-426d-bbc9-fcffc165cc60-tls-certs\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.328486 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.328416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgbwx\" (UniqueName: \"kubernetes.io/projected/59c2825e-5d24-426d-bbc9-fcffc165cc60-kube-api-access-fgbwx\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.328540 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.328514    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-home\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.328607 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.328589    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-model-cache\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.328706 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.328687    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-tmp-dir\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.328881 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.328862    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-home\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.328956 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.328889    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-model-cache\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.330562 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.330539    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-dshm\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.330922 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.330900    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59c2825e-5d24-426d-bbc9-fcffc165cc60-tls-certs\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.336661 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.336643    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgbwx\" (UniqueName: \"kubernetes.io/projected/59c2825e-5d24-426d-bbc9-fcffc165cc60-kube-api-access-fgbwx\") pod \"auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") " pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.367779 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.367754    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:37.504612 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:37.504589    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"]
Jul 23 13:48:37.506738 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:48:37.506710    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59c2825e_5d24_426d_bbc9_fcffc165cc60.slice/crio-07e54cf299fab0cb7ff71b3e93839bd119a6a9de7018cbb3a7f2a7657bc01557 WatchSource:0}: Error finding container 07e54cf299fab0cb7ff71b3e93839bd119a6a9de7018cbb3a7f2a7657bc01557: Status 404 returned error can't find the container with id 07e54cf299fab0cb7ff71b3e93839bd119a6a9de7018cbb3a7f2a7657bc01557
Jul 23 13:48:38.226052 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:38.226019    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v" event={"ID":"59c2825e-5d24-426d-bbc9-fcffc165cc60","Type":"ContainerStarted","Data":"994ead560292ced504992b9dd2226b50524db85d7d550f1519cc3e348196272f"}
Jul 23 13:48:38.226443 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:38.226068    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v" event={"ID":"59c2825e-5d24-426d-bbc9-fcffc165cc60","Type":"ContainerStarted","Data":"07e54cf299fab0cb7ff71b3e93839bd119a6a9de7018cbb3a7f2a7657bc01557"}
Jul 23 13:48:38.247159 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:38.247113    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v" podStartSLOduration=1.247098083 podStartE2EDuration="1.247098083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:48:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:48:38.244844856 +0000 UTC m=+2460.498370744" watchObservedRunningTime="2026-07-23 13:48:38.247098083 +0000 UTC m=+2460.500623979"
Jul 23 13:48:38.992788 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:38.992747    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:39.093925 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:39.093896    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:48:47.368002 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:47.367957    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:47.368527 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:47.368026    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:47.380288 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:47.380265    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:48:48.280718 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:48:48.280693    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:49:14.972786 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:14.972751    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"]
Jul 23 13:49:14.975852 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:14.975836    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:14.979930 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:14.979900    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-690897\"/\"auth-test-model-690897-kserve-self-signed-certs\""
Jul 23 13:49:14.980071 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:14.979947    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-690897\"/\"openshift-service-ca.crt\""
Jul 23 13:49:14.980169 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:14.980155    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-690897\"/\"default-dockercfg-96l58\""
Jul 23 13:49:14.980231 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:14.980212    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-690897\"/\"kube-root-ca.crt\""
Jul 23 13:49:14.986668 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:14.986648    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"]
Jul 23 13:49:15.015240 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.015219    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-model-cache\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.015360 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.015252    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-tls-certs\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.015360 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.015327    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frvpb\" (UniqueName: \"kubernetes.io/projected/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-kube-api-access-frvpb\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.015445 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.015395    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-home\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.015445 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.015418    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-tmp-dir\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.015528 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.015446    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-dshm\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.058446 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.058415    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:49:15.116092 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.116070    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frvpb\" (UniqueName: \"kubernetes.io/projected/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-kube-api-access-frvpb\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.116202 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.116120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-home\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.116202 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.116149    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-tmp-dir\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.116202 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.116183    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-dshm\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.116366 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.116245    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-model-cache\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.116366 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.116269    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-tls-certs\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.116570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.116530    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-home\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.116672 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.116587    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-tmp-dir\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.116737 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.116669    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-model-cache\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.118502 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.118469    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-dshm\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.118648 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.118631    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-tls-certs\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.124887 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.124869    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frvpb\" (UniqueName: \"kubernetes.io/projected/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-kube-api-access-frvpb\") pod \"auth-test-model-690897-kserve-69f8cd8c-7bg9t\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") " pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.284949 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.284887    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:15.420603 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:15.420571    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"]
Jul 23 13:49:15.423680 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:49:15.423657    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc98ca8e5_b22f_4eaa_97a3_5dee2291d2dc.slice/crio-86ace5c7ccb46a2ff0331cab791e79e5929af6cfe51960362b18e6832e2fc3c5 WatchSource:0}: Error finding container 86ace5c7ccb46a2ff0331cab791e79e5929af6cfe51960362b18e6832e2fc3c5: Status 404 returned error can't find the container with id 86ace5c7ccb46a2ff0331cab791e79e5929af6cfe51960362b18e6832e2fc3c5
Jul 23 13:49:16.405379 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:16.405338    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t" event={"ID":"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc","Type":"ContainerStarted","Data":"97fb15102773468ddaaa10520302008207370aecc1acaac905094c07d973ff7d"}
Jul 23 13:49:16.405379 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:16.405383    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t" event={"ID":"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc","Type":"ContainerStarted","Data":"86ace5c7ccb46a2ff0331cab791e79e5929af6cfe51960362b18e6832e2fc3c5"}
Jul 23 13:49:16.424702 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:16.424653    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t" podStartSLOduration=2.424638317 podStartE2EDuration="2.424638317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:49:16.423561245 +0000 UTC m=+2498.677087122" watchObservedRunningTime="2026-07-23 13:49:16.424638317 +0000 UTC m=+2498.678164194"
Jul 23 13:49:25.285710 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:25.285674    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:25.286196 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:25.285767    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:25.298206 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:25.298185    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:25.456123 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:25.456091    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:49:25.526170 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:49:25.526137    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:50:16.858280 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:50:16.858246    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:08.937850 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:08.937770    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:23.014188 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:23.014154    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"]
Jul 23 13:51:23.058777 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:23.058745    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:23.792077 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:23.792049    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"]
Jul 23 13:51:23.822806 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:23.822779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:29.768131 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:29.768090    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:38.033762 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.033696    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v" podUID="59c2825e-5d24-426d-bbc9-fcffc165cc60" containerName="main" containerID="cri-o://994ead560292ced504992b9dd2226b50524db85d7d550f1519cc3e348196272f" gracePeriod=45
Jul 23 13:51:38.274570 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.274546    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:51:38.390134 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.390060    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-dshm\") pod \"59c2825e-5d24-426d-bbc9-fcffc165cc60\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") "
Jul 23 13:51:38.390134 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.390105    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgbwx\" (UniqueName: \"kubernetes.io/projected/59c2825e-5d24-426d-bbc9-fcffc165cc60-kube-api-access-fgbwx\") pod \"59c2825e-5d24-426d-bbc9-fcffc165cc60\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") "
Jul 23 13:51:38.390335 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.390200    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-model-cache\") pod \"59c2825e-5d24-426d-bbc9-fcffc165cc60\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") "
Jul 23 13:51:38.390335 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.390238    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-tmp-dir\") pod \"59c2825e-5d24-426d-bbc9-fcffc165cc60\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") "
Jul 23 13:51:38.390335 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.390269    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59c2825e-5d24-426d-bbc9-fcffc165cc60-tls-certs\") pod \"59c2825e-5d24-426d-bbc9-fcffc165cc60\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") "
Jul 23 13:51:38.390335 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.390295    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-home\") pod \"59c2825e-5d24-426d-bbc9-fcffc165cc60\" (UID: \"59c2825e-5d24-426d-bbc9-fcffc165cc60\") "
Jul 23 13:51:38.390587 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.390504    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-model-cache" (OuterVolumeSpecName: "model-cache") pod "59c2825e-5d24-426d-bbc9-fcffc165cc60" (UID: "59c2825e-5d24-426d-bbc9-fcffc165cc60"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:51:38.390587 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.390541    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "59c2825e-5d24-426d-bbc9-fcffc165cc60" (UID: "59c2825e-5d24-426d-bbc9-fcffc165cc60"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:51:38.390587 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.390569    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-home" (OuterVolumeSpecName: "home") pod "59c2825e-5d24-426d-bbc9-fcffc165cc60" (UID: "59c2825e-5d24-426d-bbc9-fcffc165cc60"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:51:38.392293 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.392273    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59c2825e-5d24-426d-bbc9-fcffc165cc60-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "59c2825e-5d24-426d-bbc9-fcffc165cc60" (UID: "59c2825e-5d24-426d-bbc9-fcffc165cc60"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:51:38.392529 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.392506    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-dshm" (OuterVolumeSpecName: "dshm") pod "59c2825e-5d24-426d-bbc9-fcffc165cc60" (UID: "59c2825e-5d24-426d-bbc9-fcffc165cc60"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:51:38.392529 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.392522    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59c2825e-5d24-426d-bbc9-fcffc165cc60-kube-api-access-fgbwx" (OuterVolumeSpecName: "kube-api-access-fgbwx") pod "59c2825e-5d24-426d-bbc9-fcffc165cc60" (UID: "59c2825e-5d24-426d-bbc9-fcffc165cc60"). InnerVolumeSpecName "kube-api-access-fgbwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:51:38.491541 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.491520    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-model-cache\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:51:38.491541 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.491542    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-tmp-dir\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:51:38.491683 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.491555    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59c2825e-5d24-426d-bbc9-fcffc165cc60-tls-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:51:38.491683 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.491567    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-home\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:51:38.491683 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.491576    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59c2825e-5d24-426d-bbc9-fcffc165cc60-dshm\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:51:38.491683 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.491584    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgbwx\" (UniqueName: \"kubernetes.io/projected/59c2825e-5d24-426d-bbc9-fcffc165cc60-kube-api-access-fgbwx\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:51:38.811830 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:38.811787    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t" podUID="c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc" containerName="main" containerID="cri-o://97fb15102773468ddaaa10520302008207370aecc1acaac905094c07d973ff7d" gracePeriod=45
Jul 23 13:51:39.025286 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.025243    2570 generic.go:356] "Generic (PLEG): container finished" podID="59c2825e-5d24-426d-bbc9-fcffc165cc60" containerID="994ead560292ced504992b9dd2226b50524db85d7d550f1519cc3e348196272f" exitCode=0
Jul 23 13:51:39.025723 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.025474    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"
Jul 23 13:51:39.025723 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.025503    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v" event={"ID":"59c2825e-5d24-426d-bbc9-fcffc165cc60","Type":"ContainerDied","Data":"994ead560292ced504992b9dd2226b50524db85d7d550f1519cc3e348196272f"}
Jul 23 13:51:39.025723 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.025564    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v" event={"ID":"59c2825e-5d24-426d-bbc9-fcffc165cc60","Type":"ContainerDied","Data":"07e54cf299fab0cb7ff71b3e93839bd119a6a9de7018cbb3a7f2a7657bc01557"}
Jul 23 13:51:39.025723 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.025588    2570 scope.go:117] "RemoveContainer" containerID="994ead560292ced504992b9dd2226b50524db85d7d550f1519cc3e348196272f"
Jul 23 13:51:39.027620 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.027592    2570 generic.go:356] "Generic (PLEG): container finished" podID="c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc" containerID="97fb15102773468ddaaa10520302008207370aecc1acaac905094c07d973ff7d" exitCode=0
Jul 23 13:51:39.027758 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.027664    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t" event={"ID":"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc","Type":"ContainerDied","Data":"97fb15102773468ddaaa10520302008207370aecc1acaac905094c07d973ff7d"}
Jul 23 13:51:39.034573 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.034326    2570 scope.go:117] "RemoveContainer" containerID="994ead560292ced504992b9dd2226b50524db85d7d550f1519cc3e348196272f"
Jul 23 13:51:39.034875 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:51:39.034615    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"994ead560292ced504992b9dd2226b50524db85d7d550f1519cc3e348196272f\": container with ID starting with 994ead560292ced504992b9dd2226b50524db85d7d550f1519cc3e348196272f not found: ID does not exist" containerID="994ead560292ced504992b9dd2226b50524db85d7d550f1519cc3e348196272f"
Jul 23 13:51:39.034875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.034643    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"994ead560292ced504992b9dd2226b50524db85d7d550f1519cc3e348196272f"} err="failed to get container status \"994ead560292ced504992b9dd2226b50524db85d7d550f1519cc3e348196272f\": rpc error: code = NotFound desc = could not find container \"994ead560292ced504992b9dd2226b50524db85d7d550f1519cc3e348196272f\": container with ID starting with 994ead560292ced504992b9dd2226b50524db85d7d550f1519cc3e348196272f not found: ID does not exist"
Jul 23 13:51:39.052288 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.052267    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"]
Jul 23 13:51:39.057129 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.057109    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v"]
Jul 23 13:51:39.074775 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.074719    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:51:39.197696 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.197662    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frvpb\" (UniqueName: \"kubernetes.io/projected/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-kube-api-access-frvpb\") pod \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") "
Jul 23 13:51:39.197892 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.197720    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-home\") pod \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") "
Jul 23 13:51:39.197892 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.197755    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-model-cache\") pod \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") "
Jul 23 13:51:39.197892 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.197807    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-tmp-dir\") pod \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") "
Jul 23 13:51:39.197892 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.197829    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-dshm\") pod \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") "
Jul 23 13:51:39.198193 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.197975    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-tls-certs\") pod \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\" (UID: \"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc\") "
Jul 23 13:51:39.198320 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.198003    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-model-cache" (OuterVolumeSpecName: "model-cache") pod "c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc" (UID: "c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:51:39.198320 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.198017    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-home" (OuterVolumeSpecName: "home") pod "c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc" (UID: "c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:51:39.198320 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.198064    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc" (UID: "c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:51:39.198491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.198449    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-home\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:51:39.198491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.198467    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-model-cache\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:51:39.198491 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.198476    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-tmp-dir\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:51:39.200028 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.200008    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-kube-api-access-frvpb" (OuterVolumeSpecName: "kube-api-access-frvpb") pod "c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc" (UID: "c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc"). InnerVolumeSpecName "kube-api-access-frvpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:51:39.200028 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.200017    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-dshm" (OuterVolumeSpecName: "dshm") pod "c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc" (UID: "c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:51:39.200153 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.200037    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc" (UID: "c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:51:39.299190 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.299164    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-dshm\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:51:39.299190 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.299186    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-tls-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:51:39.299190 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:39.299196    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frvpb\" (UniqueName: \"kubernetes.io/projected/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc-kube-api-access-frvpb\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:51:40.033774 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:40.033741    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t" event={"ID":"c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc","Type":"ContainerDied","Data":"86ace5c7ccb46a2ff0331cab791e79e5929af6cfe51960362b18e6832e2fc3c5"}
Jul 23 13:51:40.033951 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:40.033788    2570 scope.go:117] "RemoveContainer" containerID="97fb15102773468ddaaa10520302008207370aecc1acaac905094c07d973ff7d"
Jul 23 13:51:40.033951 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:40.033786    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"
Jul 23 13:51:40.058216 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:40.058189    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"]
Jul 23 13:51:40.061929 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:40.061909    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-690897/auth-test-model-690897-kserve-69f8cd8c-7bg9t"]
Jul 23 13:51:40.358805 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:40.358729    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59c2825e-5d24-426d-bbc9-fcffc165cc60" path="/var/lib/kubelet/pods/59c2825e-5d24-426d-bbc9-fcffc165cc60/volumes"
Jul 23 13:51:40.359124 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:40.359111    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc" path="/var/lib/kubelet/pods/c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc/volumes"
Jul 23 13:51:43.270821 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:43.270779    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-5ddc60/auth-test-model-5ddc60-kserve-7ffc8cbb67-zls9v" podUID="59c2825e-5d24-426d-bbc9-fcffc165cc60" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 13:51:46.294061 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:46.294025    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:46.449225 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:46.449174    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:55.664177 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.664143    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"]
Jul 23 13:51:55.664566 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.664479    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59c2825e-5d24-426d-bbc9-fcffc165cc60" containerName="main"
Jul 23 13:51:55.664566 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.664490    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="59c2825e-5d24-426d-bbc9-fcffc165cc60" containerName="main"
Jul 23 13:51:55.664566 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.664501    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc" containerName="main"
Jul 23 13:51:55.664566 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.664507    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc" containerName="main"
Jul 23 13:51:55.664717 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.664579    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="59c2825e-5d24-426d-bbc9-fcffc165cc60" containerName="main"
Jul 23 13:51:55.664717 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.664588    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98ca8e5-b22f-4eaa-97a3-5dee2291d2dc" containerName="main"
Jul 23 13:51:55.667597 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.667578    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.670697 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.670675    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-690897\"/\"default-dockercfg-96l58\""
Jul 23 13:51:55.671807 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.671788    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-690897\"/\"openshift-service-ca.crt\""
Jul 23 13:51:55.671879 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.671804    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-690897\"/\"kube-root-ca.crt\""
Jul 23 13:51:55.671951 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.671936    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-690897\"/\"sub-test-model-690897-kserve-self-signed-certs\""
Jul 23 13:51:55.680898 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.680878    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"]
Jul 23 13:51:55.696298 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.696262    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:51:55.834582 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.834554    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-model-cache\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.834697 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.834598    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82f375a9-789f-4094-b19c-aa0e36d5a283-tls-certs\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.834697 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.834653    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-dshm\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.834771 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.834700    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxztb\" (UniqueName: \"kubernetes.io/projected/82f375a9-789f-4094-b19c-aa0e36d5a283-kube-api-access-sxztb\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.834771 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.834740    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-tmp-dir\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.834771 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.834757    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-home\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.935616 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.935551    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxztb\" (UniqueName: \"kubernetes.io/projected/82f375a9-789f-4094-b19c-aa0e36d5a283-kube-api-access-sxztb\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.935616 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.935593    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-tmp-dir\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.935616 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.935611    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-home\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.935829 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.935792    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-model-cache\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.935883 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.935841    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82f375a9-789f-4094-b19c-aa0e36d5a283-tls-certs\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.935929 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.935902    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-dshm\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.936007 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.935966    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-tmp-dir\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.936059 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.936025    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-home\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.936146 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.936128    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-model-cache\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.938024 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.937979    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-dshm\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.938228 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.938213    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82f375a9-789f-4094-b19c-aa0e36d5a283-tls-certs\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.946767 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.946745    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxztb\" (UniqueName: \"kubernetes.io/projected/82f375a9-789f-4094-b19c-aa0e36d5a283-kube-api-access-sxztb\") pod \"sub-test-model-690897-kserve-54597cbc85-bvcgm\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") " pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:55.976608 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:55.976585    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:51:56.107203 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:56.107010    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"]
Jul 23 13:51:56.109303 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:51:56.109279    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82f375a9_789f_4094_b19c_aa0e36d5a283.slice/crio-476b08e3506e1f582d7ee0c2e2cdced783ee9ce8b4b0d1f212d45ee27be4a639 WatchSource:0}: Error finding container 476b08e3506e1f582d7ee0c2e2cdced783ee9ce8b4b0d1f212d45ee27be4a639: Status 404 returned error can't find the container with id 476b08e3506e1f582d7ee0c2e2cdced783ee9ce8b4b0d1f212d45ee27be4a639
Jul 23 13:51:57.114239 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:57.114205    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm" event={"ID":"82f375a9-789f-4094-b19c-aa0e36d5a283","Type":"ContainerStarted","Data":"c0a8b4178efa59b87ee736c156253e4d10f6ccc87e28d7ec151117c70790a5e3"}
Jul 23 13:51:57.114608 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:57.114245    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm" event={"ID":"82f375a9-789f-4094-b19c-aa0e36d5a283","Type":"ContainerStarted","Data":"476b08e3506e1f582d7ee0c2e2cdced783ee9ce8b4b0d1f212d45ee27be4a639"}
Jul 23 13:51:57.136850 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:51:57.136807    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm" podStartSLOduration=2.136792284 podStartE2EDuration="2.136792284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:51:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:51:57.135189559 +0000 UTC m=+2659.388715436" watchObservedRunningTime="2026-07-23 13:51:57.136792284 +0000 UTC m=+2659.390318160"
Jul 23 13:52:05.977138 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:05.977104    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:52:05.977621 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:05.977350    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:52:05.989396 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:05.989370    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:52:06.165842 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:06.165815    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:52:26.746049 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:26.745972    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:52:26.847171 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:26.847139    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:52:37.066284 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:37.066245    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:52:37.963174 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:37.963138    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"]
Jul 23 13:52:37.984736 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:37.984677    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:52:45.041673 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.041641    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"]
Jul 23 13:52:45.046350 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.046330    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.048866 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.048832    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5ddc60\"/\"kube-root-ca.crt\""
Jul 23 13:52:45.048866 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.048859    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5ddc60\"/\"openshift-service-ca.crt\""
Jul 23 13:52:45.049048 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.048894    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5ddc60\"/\"default-dockercfg-qp87l\""
Jul 23 13:52:45.049048 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.048894    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5ddc60\"/\"rate-test-model-5ddc60-kserve-self-signed-certs\""
Jul 23 13:52:45.054681 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.054662    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"]
Jul 23 13:52:45.070660 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.070632    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:52:45.149823 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.149798    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-home\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.149945 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.149828    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-model-cache\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.149945 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.149844    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-dshm\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.149945 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.149879    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a854288-8bb1-4d20-8433-f7f14441e0fe-tls-certs\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.150075 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.149942    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-tmp-dir\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.150075 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.150032    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlh6j\" (UniqueName: \"kubernetes.io/projected/1a854288-8bb1-4d20-8433-f7f14441e0fe-kube-api-access-mlh6j\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.250591 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.250565    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlh6j\" (UniqueName: \"kubernetes.io/projected/1a854288-8bb1-4d20-8433-f7f14441e0fe-kube-api-access-mlh6j\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.250728 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.250630    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-home\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.250728 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.250655    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-model-cache\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.250728 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.250677    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-dshm\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.250728 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.250714    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a854288-8bb1-4d20-8433-f7f14441e0fe-tls-certs\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.250948 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.250750    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-tmp-dir\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.251123 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.251104    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-home\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.251177 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.251121    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-model-cache\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.251215 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.251185    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-tmp-dir\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.252930 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.252910    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-dshm\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.253201 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.253187    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a854288-8bb1-4d20-8433-f7f14441e0fe-tls-certs\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.259173 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.259152    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlh6j\" (UniqueName: \"kubernetes.io/projected/1a854288-8bb1-4d20-8433-f7f14441e0fe-kube-api-access-mlh6j\") pod \"rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") " pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.355965 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.355902    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:45.483665 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:45.483639    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"]
Jul 23 13:52:45.485835 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:52:45.485797    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a854288_8bb1_4d20_8433_f7f14441e0fe.slice/crio-8c28296c0300cf2d5103271ab97e2c3b49fcc4ad73c5a12d9d113d86ba072d39 WatchSource:0}: Error finding container 8c28296c0300cf2d5103271ab97e2c3b49fcc4ad73c5a12d9d113d86ba072d39: Status 404 returned error can't find the container with id 8c28296c0300cf2d5103271ab97e2c3b49fcc4ad73c5a12d9d113d86ba072d39
Jul 23 13:52:46.338630 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:46.338589    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq" event={"ID":"1a854288-8bb1-4d20-8433-f7f14441e0fe","Type":"ContainerStarted","Data":"8343c94418ecd4d76be4a17b61e5eac3ca586bf65f65384d89c8ccd98066fea7"}
Jul 23 13:52:46.339012 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:46.338637    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq" event={"ID":"1a854288-8bb1-4d20-8433-f7f14441e0fe","Type":"ContainerStarted","Data":"8c28296c0300cf2d5103271ab97e2c3b49fcc4ad73c5a12d9d113d86ba072d39"}
Jul 23 13:52:46.358604 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:46.358558    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq" podStartSLOduration=1.358541529 podStartE2EDuration="1.358541529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:52:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:52:46.358277298 +0000 UTC m=+2708.611803171" watchObservedRunningTime="2026-07-23 13:52:46.358541529 +0000 UTC m=+2708.612067430"
Jul 23 13:52:52.982640 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:52.982575    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm" podUID="82f375a9-789f-4094-b19c-aa0e36d5a283" containerName="main" containerID="cri-o://c0a8b4178efa59b87ee736c156253e4d10f6ccc87e28d7ec151117c70790a5e3" gracePeriod=45
Jul 23 13:52:53.236383 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.236320    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:52:53.315158 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.315123    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxztb\" (UniqueName: \"kubernetes.io/projected/82f375a9-789f-4094-b19c-aa0e36d5a283-kube-api-access-sxztb\") pod \"82f375a9-789f-4094-b19c-aa0e36d5a283\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") "
Jul 23 13:52:53.315158 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.315157    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-tmp-dir\") pod \"82f375a9-789f-4094-b19c-aa0e36d5a283\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") "
Jul 23 13:52:53.315420 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.315185    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82f375a9-789f-4094-b19c-aa0e36d5a283-tls-certs\") pod \"82f375a9-789f-4094-b19c-aa0e36d5a283\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") "
Jul 23 13:52:53.315420 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.315200    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-home\") pod \"82f375a9-789f-4094-b19c-aa0e36d5a283\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") "
Jul 23 13:52:53.315420 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.315234    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-model-cache\") pod \"82f375a9-789f-4094-b19c-aa0e36d5a283\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") "
Jul 23 13:52:53.315420 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.315263    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-dshm\") pod \"82f375a9-789f-4094-b19c-aa0e36d5a283\" (UID: \"82f375a9-789f-4094-b19c-aa0e36d5a283\") "
Jul 23 13:52:53.315613 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.315450    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "82f375a9-789f-4094-b19c-aa0e36d5a283" (UID: "82f375a9-789f-4094-b19c-aa0e36d5a283"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:52:53.315613 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.315520    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-model-cache" (OuterVolumeSpecName: "model-cache") pod "82f375a9-789f-4094-b19c-aa0e36d5a283" (UID: "82f375a9-789f-4094-b19c-aa0e36d5a283"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:52:53.315613 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.315530    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-home" (OuterVolumeSpecName: "home") pod "82f375a9-789f-4094-b19c-aa0e36d5a283" (UID: "82f375a9-789f-4094-b19c-aa0e36d5a283"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:52:53.315724 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.315624    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-tmp-dir\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:52:53.315724 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.315643    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-home\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:52:53.315724 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.315658    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-model-cache\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:52:53.317437 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.317401    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82f375a9-789f-4094-b19c-aa0e36d5a283-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "82f375a9-789f-4094-b19c-aa0e36d5a283" (UID: "82f375a9-789f-4094-b19c-aa0e36d5a283"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:52:53.317437 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.317414    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f375a9-789f-4094-b19c-aa0e36d5a283-kube-api-access-sxztb" (OuterVolumeSpecName: "kube-api-access-sxztb") pod "82f375a9-789f-4094-b19c-aa0e36d5a283" (UID: "82f375a9-789f-4094-b19c-aa0e36d5a283"). InnerVolumeSpecName "kube-api-access-sxztb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:52:53.317592 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.317477    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-dshm" (OuterVolumeSpecName: "dshm") pod "82f375a9-789f-4094-b19c-aa0e36d5a283" (UID: "82f375a9-789f-4094-b19c-aa0e36d5a283"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:52:53.373053 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.373024    2570 generic.go:356] "Generic (PLEG): container finished" podID="82f375a9-789f-4094-b19c-aa0e36d5a283" containerID="c0a8b4178efa59b87ee736c156253e4d10f6ccc87e28d7ec151117c70790a5e3" exitCode=0
Jul 23 13:52:53.373203 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.373068    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"
Jul 23 13:52:53.373203 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.373112    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm" event={"ID":"82f375a9-789f-4094-b19c-aa0e36d5a283","Type":"ContainerDied","Data":"c0a8b4178efa59b87ee736c156253e4d10f6ccc87e28d7ec151117c70790a5e3"}
Jul 23 13:52:53.373203 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.373153    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm" event={"ID":"82f375a9-789f-4094-b19c-aa0e36d5a283","Type":"ContainerDied","Data":"476b08e3506e1f582d7ee0c2e2cdced783ee9ce8b4b0d1f212d45ee27be4a639"}
Jul 23 13:52:53.373203 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.373182    2570 scope.go:117] "RemoveContainer" containerID="c0a8b4178efa59b87ee736c156253e4d10f6ccc87e28d7ec151117c70790a5e3"
Jul 23 13:52:53.382723 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.382688    2570 scope.go:117] "RemoveContainer" containerID="c0a8b4178efa59b87ee736c156253e4d10f6ccc87e28d7ec151117c70790a5e3"
Jul 23 13:52:53.382947 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:52:53.382930    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0a8b4178efa59b87ee736c156253e4d10f6ccc87e28d7ec151117c70790a5e3\": container with ID starting with c0a8b4178efa59b87ee736c156253e4d10f6ccc87e28d7ec151117c70790a5e3 not found: ID does not exist" containerID="c0a8b4178efa59b87ee736c156253e4d10f6ccc87e28d7ec151117c70790a5e3"
Jul 23 13:52:53.383020 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.382953    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0a8b4178efa59b87ee736c156253e4d10f6ccc87e28d7ec151117c70790a5e3"} err="failed to get container status \"c0a8b4178efa59b87ee736c156253e4d10f6ccc87e28d7ec151117c70790a5e3\": rpc error: code = NotFound desc = could not find container \"c0a8b4178efa59b87ee736c156253e4d10f6ccc87e28d7ec151117c70790a5e3\": container with ID starting with c0a8b4178efa59b87ee736c156253e4d10f6ccc87e28d7ec151117c70790a5e3 not found: ID does not exist"
Jul 23 13:52:53.396768 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.396740    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"]
Jul 23 13:52:53.401742 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.401723    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-690897/sub-test-model-690897-kserve-54597cbc85-bvcgm"]
Jul 23 13:52:53.416535 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.416516    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82f375a9-789f-4094-b19c-aa0e36d5a283-dshm\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:52:53.416535 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.416537    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxztb\" (UniqueName: \"kubernetes.io/projected/82f375a9-789f-4094-b19c-aa0e36d5a283-kube-api-access-sxztb\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:52:53.416673 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:53.416546    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82f375a9-789f-4094-b19c-aa0e36d5a283-tls-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:52:54.358308 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:54.358278    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82f375a9-789f-4094-b19c-aa0e36d5a283" path="/var/lib/kubelet/pods/82f375a9-789f-4094-b19c-aa0e36d5a283/volumes"
Jul 23 13:52:55.356385 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:55.356353    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:55.356597 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:55.356571    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:55.369548 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:55.369520    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:52:55.394023 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:52:55.393998    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:53:00.774738 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:53:00.774702    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:00.871137 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:53:00.871098    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:14.571666 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:53:14.571633    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:31.300379 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:53:31.300347    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:31.400019 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:53:31.399974    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:40.012340 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:53:40.012296    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:40.117293 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:53:40.117262    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:53:59.465599 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:53:59.465563    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"]
Jul 23 13:53:59.499129 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:53:59.499097    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:00.417868 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:00.417831    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:04.004455 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.004420    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7241-139755630893360"]
Jul 23 13:54:04.004944 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.004896    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f375a9-789f-4094-b19c-aa0e36d5a283" containerName="main"
Jul 23 13:54:04.004944 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.004914    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f375a9-789f-4094-b19c-aa0e36d5a283" containerName="main"
Jul 23 13:54:04.005086 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.005035    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="82f375a9-789f-4094-b19c-aa0e36d5a283" containerName="main"
Jul 23 13:54:04.007953 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.007933    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755630893360"
Jul 23 13:54:04.010607 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.010589    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9rv6n\""
Jul 23 13:54:04.015463 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.015043    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7241-139755630893360"]
Jul 23 13:54:04.113386 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.113360    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-656lf\" (UniqueName: \"kubernetes.io/projected/90f04990-5fcf-494f-8e95-6fc4dce73273-kube-api-access-656lf\") pod \"test-curl-7241-139755630893360\" (UID: \"90f04990-5fcf-494f-8e95-6fc4dce73273\") " pod="opendatahub/test-curl-7241-139755630893360"
Jul 23 13:54:04.214579 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.214548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-656lf\" (UniqueName: \"kubernetes.io/projected/90f04990-5fcf-494f-8e95-6fc4dce73273-kube-api-access-656lf\") pod \"test-curl-7241-139755630893360\" (UID: \"90f04990-5fcf-494f-8e95-6fc4dce73273\") " pod="opendatahub/test-curl-7241-139755630893360"
Jul 23 13:54:04.223172 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.223148    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-656lf\" (UniqueName: \"kubernetes.io/projected/90f04990-5fcf-494f-8e95-6fc4dce73273-kube-api-access-656lf\") pod \"test-curl-7241-139755630893360\" (UID: \"90f04990-5fcf-494f-8e95-6fc4dce73273\") " pod="opendatahub/test-curl-7241-139755630893360"
Jul 23 13:54:04.318053 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.317974    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755630893360"
Jul 23 13:54:04.443903 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.443875    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7241-139755630893360"]
Jul 23 13:54:04.447421 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:54:04.447396    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90f04990_5fcf_494f_8e95_6fc4dce73273.slice/crio-7103628abd6b31d6391aa67ea991ffcbf32b595bd7bb556766d4305fcf656bc8 WatchSource:0}: Error finding container 7103628abd6b31d6391aa67ea991ffcbf32b595bd7bb556766d4305fcf656bc8: Status 404 returned error can't find the container with id 7103628abd6b31d6391aa67ea991ffcbf32b595bd7bb556766d4305fcf656bc8
Jul 23 13:54:04.449166 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.449146    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:54:04.693679 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:04.693607    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7241-139755630893360" event={"ID":"90f04990-5fcf-494f-8e95-6fc4dce73273","Type":"ContainerStarted","Data":"7103628abd6b31d6391aa67ea991ffcbf32b595bd7bb556766d4305fcf656bc8"}
Jul 23 13:54:05.698959 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:05.698921    2570 generic.go:356] "Generic (PLEG): container finished" podID="90f04990-5fcf-494f-8e95-6fc4dce73273" containerID="ca5f5187b613764967c3a338f95ee2e4f024ea3bdf0f2fa2e2c2ba4d1c6defdc" exitCode=0
Jul 23 13:54:05.699365 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:05.699009    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7241-139755630893360" event={"ID":"90f04990-5fcf-494f-8e95-6fc4dce73273","Type":"ContainerDied","Data":"ca5f5187b613764967c3a338f95ee2e4f024ea3bdf0f2fa2e2c2ba4d1c6defdc"}
Jul 23 13:54:06.831744 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:06.831716    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755630893360"
Jul 23 13:54:06.852058 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:06.852025    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7241-139755630893360_90f04990-5fcf-494f-8e95-6fc4dce73273/test-curl-7241-139755630893360/0.log"
Jul 23 13:54:06.876392 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:06.876345    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7241-139755630893360"]
Jul 23 13:54:06.880372 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:06.880348    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7241-139755630893360"]
Jul 23 13:54:06.938225 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:06.938193    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-656lf\" (UniqueName: \"kubernetes.io/projected/90f04990-5fcf-494f-8e95-6fc4dce73273-kube-api-access-656lf\") pod \"90f04990-5fcf-494f-8e95-6fc4dce73273\" (UID: \"90f04990-5fcf-494f-8e95-6fc4dce73273\") "
Jul 23 13:54:06.940361 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:06.940332    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90f04990-5fcf-494f-8e95-6fc4dce73273-kube-api-access-656lf" (OuterVolumeSpecName: "kube-api-access-656lf") pod "90f04990-5fcf-494f-8e95-6fc4dce73273" (UID: "90f04990-5fcf-494f-8e95-6fc4dce73273"). InnerVolumeSpecName "kube-api-access-656lf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:54:07.039743 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.039707    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-656lf\" (UniqueName: \"kubernetes.io/projected/90f04990-5fcf-494f-8e95-6fc4dce73273-kube-api-access-656lf\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:54:07.055091 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.055058    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7241-139755629741952"]
Jul 23 13:54:07.055394 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.055381    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f04990-5fcf-494f-8e95-6fc4dce73273" containerName="test-curl-7241-139755630893360"
Jul 23 13:54:07.055437 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.055395    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f04990-5fcf-494f-8e95-6fc4dce73273" containerName="test-curl-7241-139755630893360"
Jul 23 13:54:07.055476 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.055459    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="90f04990-5fcf-494f-8e95-6fc4dce73273" containerName="test-curl-7241-139755630893360"
Jul 23 13:54:07.058247 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.058229    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:07.066107 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.065566    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7241-139755629741952"]
Jul 23 13:54:07.140911 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.140871    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vphwf\" (UniqueName: \"kubernetes.io/projected/e1755796-8431-408b-8194-9bcea4f50cc6-kube-api-access-vphwf\") pod \"test-curl-7241-139755629741952\" (UID: \"e1755796-8431-408b-8194-9bcea4f50cc6\") " pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:07.241909 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.241867    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vphwf\" (UniqueName: \"kubernetes.io/projected/e1755796-8431-408b-8194-9bcea4f50cc6-kube-api-access-vphwf\") pod \"test-curl-7241-139755629741952\" (UID: \"e1755796-8431-408b-8194-9bcea4f50cc6\") " pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:07.250568 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.250545    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vphwf\" (UniqueName: \"kubernetes.io/projected/e1755796-8431-408b-8194-9bcea4f50cc6-kube-api-access-vphwf\") pod \"test-curl-7241-139755629741952\" (UID: \"e1755796-8431-408b-8194-9bcea4f50cc6\") " pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:07.369088 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.369004    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:07.505674 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.505648    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7241-139755629741952"]
Jul 23 13:54:07.508129 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:54:07.508107    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1755796_8431_408b_8194_9bcea4f50cc6.slice/crio-e90c729e46bd23af1703a44283283de61012b174443545be8e134915dacb6ba4 WatchSource:0}: Error finding container e90c729e46bd23af1703a44283283de61012b174443545be8e134915dacb6ba4: Status 404 returned error can't find the container with id e90c729e46bd23af1703a44283283de61012b174443545be8e134915dacb6ba4
Jul 23 13:54:07.708301 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.708275    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7241-139755629741952" event={"ID":"e1755796-8431-408b-8194-9bcea4f50cc6","Type":"ContainerStarted","Data":"e90c729e46bd23af1703a44283283de61012b174443545be8e134915dacb6ba4"}
Jul 23 13:54:07.709586 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.709558    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7103628abd6b31d6391aa67ea991ffcbf32b595bd7bb556766d4305fcf656bc8"
Jul 23 13:54:07.709753 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:07.709591    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755630893360"
Jul 23 13:54:07.720445 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:54:07.720413    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7241-139755630893360\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="90f04990-5fcf-494f-8e95-6fc4dce73273" pod="opendatahub/test-curl-7241-139755630893360"
Jul 23 13:54:08.357791 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:54:08.357759    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7241-139755630893360\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="90f04990-5fcf-494f-8e95-6fc4dce73273" pod="opendatahub/test-curl-7241-139755630893360"
Jul 23 13:54:08.359071 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:08.359048    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90f04990-5fcf-494f-8e95-6fc4dce73273" path="/var/lib/kubelet/pods/90f04990-5fcf-494f-8e95-6fc4dce73273/volumes"
Jul 23 13:54:08.715163 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:08.715131    2570 generic.go:356] "Generic (PLEG): container finished" podID="e1755796-8431-408b-8194-9bcea4f50cc6" containerID="67a3cd551f6ec2bb48a86b5d769d3309176df994a1e02a00acea9375c435fa5d" exitCode=0
Jul 23 13:54:08.715336 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:08.715214    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7241-139755629741952" event={"ID":"e1755796-8431-408b-8194-9bcea4f50cc6","Type":"ContainerDied","Data":"67a3cd551f6ec2bb48a86b5d769d3309176df994a1e02a00acea9375c435fa5d"}
Jul 23 13:54:09.849051 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:09.849031    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:09.877450 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:09.877417    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7241-139755629741952_e1755796-8431-408b-8194-9bcea4f50cc6/test-curl-7241-139755629741952/0.log"
Jul 23 13:54:09.903523 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:09.903497    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7241-139755629741952"]
Jul 23 13:54:09.907704 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:09.907684    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7241-139755629741952"]
Jul 23 13:54:09.964513 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:09.964493    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vphwf\" (UniqueName: \"kubernetes.io/projected/e1755796-8431-408b-8194-9bcea4f50cc6-kube-api-access-vphwf\") pod \"e1755796-8431-408b-8194-9bcea4f50cc6\" (UID: \"e1755796-8431-408b-8194-9bcea4f50cc6\") "
Jul 23 13:54:09.966440 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:09.966412    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1755796-8431-408b-8194-9bcea4f50cc6-kube-api-access-vphwf" (OuterVolumeSpecName: "kube-api-access-vphwf") pod "e1755796-8431-408b-8194-9bcea4f50cc6" (UID: "e1755796-8431-408b-8194-9bcea4f50cc6"). InnerVolumeSpecName "kube-api-access-vphwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:54:10.040266 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.040233    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7241-139755629741952"]
Jul 23 13:54:10.040718 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.040701    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1755796-8431-408b-8194-9bcea4f50cc6" containerName="test-curl-7241-139755629741952"
Jul 23 13:54:10.040765 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.040722    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1755796-8431-408b-8194-9bcea4f50cc6" containerName="test-curl-7241-139755629741952"
Jul 23 13:54:10.040839 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.040828    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1755796-8431-408b-8194-9bcea4f50cc6" containerName="test-curl-7241-139755629741952"
Jul 23 13:54:10.043845 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.043825    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:10.052870 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.052846    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7241-139755629741952"]
Jul 23 13:54:10.065323 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.065296    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vphwf\" (UniqueName: \"kubernetes.io/projected/e1755796-8431-408b-8194-9bcea4f50cc6-kube-api-access-vphwf\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:54:10.166051 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.166016    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2rfz\" (UniqueName: \"kubernetes.io/projected/c6f4f0ad-41ce-4f6d-8a34-344de7b6b523-kube-api-access-f2rfz\") pod \"test-curl-7241-139755629741952\" (UID: \"c6f4f0ad-41ce-4f6d-8a34-344de7b6b523\") " pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:10.267331 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.267255    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2rfz\" (UniqueName: \"kubernetes.io/projected/c6f4f0ad-41ce-4f6d-8a34-344de7b6b523-kube-api-access-f2rfz\") pod \"test-curl-7241-139755629741952\" (UID: \"c6f4f0ad-41ce-4f6d-8a34-344de7b6b523\") " pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:10.277116 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.277088    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2rfz\" (UniqueName: \"kubernetes.io/projected/c6f4f0ad-41ce-4f6d-8a34-344de7b6b523-kube-api-access-f2rfz\") pod \"test-curl-7241-139755629741952\" (UID: \"c6f4f0ad-41ce-4f6d-8a34-344de7b6b523\") " pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:10.353538 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.353512    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:10.364388 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.358294    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1755796-8431-408b-8194-9bcea4f50cc6" path="/var/lib/kubelet/pods/e1755796-8431-408b-8194-9bcea4f50cc6/volumes"
Jul 23 13:54:10.497294 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.497273    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7241-139755629741952"]
Jul 23 13:54:10.499771 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:54:10.499745    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6f4f0ad_41ce_4f6d_8a34_344de7b6b523.slice/crio-976dc315aa03e6cc5a76085d97a79ee0a36f488ce671243e2f96c5d3a86af373 WatchSource:0}: Error finding container 976dc315aa03e6cc5a76085d97a79ee0a36f488ce671243e2f96c5d3a86af373: Status 404 returned error can't find the container with id 976dc315aa03e6cc5a76085d97a79ee0a36f488ce671243e2f96c5d3a86af373
Jul 23 13:54:10.724965 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.724944    2570 scope.go:117] "RemoveContainer" containerID="67a3cd551f6ec2bb48a86b5d769d3309176df994a1e02a00acea9375c435fa5d"
Jul 23 13:54:10.725132 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.724945    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:10.726357 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:10.726326    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7241-139755629741952" event={"ID":"c6f4f0ad-41ce-4f6d-8a34-344de7b6b523","Type":"ContainerStarted","Data":"976dc315aa03e6cc5a76085d97a79ee0a36f488ce671243e2f96c5d3a86af373"}
Jul 23 13:54:11.733398 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:11.733360    2570 generic.go:356] "Generic (PLEG): container finished" podID="c6f4f0ad-41ce-4f6d-8a34-344de7b6b523" containerID="adc4429297547482c55cb04a487b5b8e698ab5ea3b805387bc9f43e49a7da240" exitCode=0
Jul 23 13:54:11.733787 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:11.733445    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7241-139755629741952" event={"ID":"c6f4f0ad-41ce-4f6d-8a34-344de7b6b523","Type":"ContainerDied","Data":"adc4429297547482c55cb04a487b5b8e698ab5ea3b805387bc9f43e49a7da240"}
Jul 23 13:54:12.870719 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:12.870696    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:12.892731 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:12.892708    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7241-139755629741952_c6f4f0ad-41ce-4f6d-8a34-344de7b6b523/test-curl-7241-139755629741952/0.log"
Jul 23 13:54:12.920524 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:12.920499    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7241-139755629741952"]
Jul 23 13:54:12.924485 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:12.924461    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7241-139755629741952"]
Jul 23 13:54:12.990227 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:12.990163    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2rfz\" (UniqueName: \"kubernetes.io/projected/c6f4f0ad-41ce-4f6d-8a34-344de7b6b523-kube-api-access-f2rfz\") pod \"c6f4f0ad-41ce-4f6d-8a34-344de7b6b523\" (UID: \"c6f4f0ad-41ce-4f6d-8a34-344de7b6b523\") "
Jul 23 13:54:12.992098 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:12.992069    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6f4f0ad-41ce-4f6d-8a34-344de7b6b523-kube-api-access-f2rfz" (OuterVolumeSpecName: "kube-api-access-f2rfz") pod "c6f4f0ad-41ce-4f6d-8a34-344de7b6b523" (UID: "c6f4f0ad-41ce-4f6d-8a34-344de7b6b523"). InnerVolumeSpecName "kube-api-access-f2rfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:54:13.091503 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:13.091475    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2rfz\" (UniqueName: \"kubernetes.io/projected/c6f4f0ad-41ce-4f6d-8a34-344de7b6b523-kube-api-access-f2rfz\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:54:13.743511 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:13.743480    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="976dc315aa03e6cc5a76085d97a79ee0a36f488ce671243e2f96c5d3a86af373"
Jul 23 13:54:13.743511 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:13.743494    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:13.753414 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:54:13.753385    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7241-139755629741952\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="c6f4f0ad-41ce-4f6d-8a34-344de7b6b523" pod="opendatahub/test-curl-7241-139755629741952"
Jul 23 13:54:14.357700 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.357669    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6f4f0ad-41ce-4f6d-8a34-344de7b6b523" path="/var/lib/kubelet/pods/c6f4f0ad-41ce-4f6d-8a34-344de7b6b523/volumes"
Jul 23 13:54:14.485073 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.485044    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq" podUID="1a854288-8bb1-4d20-8433-f7f14441e0fe" containerName="main" containerID="cri-o://8343c94418ecd4d76be4a17b61e5eac3ca586bf65f65384d89c8ccd98066fea7" gracePeriod=45
Jul 23 13:54:14.747544 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.747520    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:54:14.748759 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.748733    2570 generic.go:356] "Generic (PLEG): container finished" podID="1a854288-8bb1-4d20-8433-f7f14441e0fe" containerID="8343c94418ecd4d76be4a17b61e5eac3ca586bf65f65384d89c8ccd98066fea7" exitCode=0
Jul 23 13:54:14.748850 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.748806    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq" event={"ID":"1a854288-8bb1-4d20-8433-f7f14441e0fe","Type":"ContainerDied","Data":"8343c94418ecd4d76be4a17b61e5eac3ca586bf65f65384d89c8ccd98066fea7"}
Jul 23 13:54:14.748899 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.748847    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq" event={"ID":"1a854288-8bb1-4d20-8433-f7f14441e0fe","Type":"ContainerDied","Data":"8c28296c0300cf2d5103271ab97e2c3b49fcc4ad73c5a12d9d113d86ba072d39"}
Jul 23 13:54:14.748899 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.748864    2570 scope.go:117] "RemoveContainer" containerID="8343c94418ecd4d76be4a17b61e5eac3ca586bf65f65384d89c8ccd98066fea7"
Jul 23 13:54:14.756875 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.756846    2570 scope.go:117] "RemoveContainer" containerID="8343c94418ecd4d76be4a17b61e5eac3ca586bf65f65384d89c8ccd98066fea7"
Jul 23 13:54:14.757182 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:54:14.757160    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8343c94418ecd4d76be4a17b61e5eac3ca586bf65f65384d89c8ccd98066fea7\": container with ID starting with 8343c94418ecd4d76be4a17b61e5eac3ca586bf65f65384d89c8ccd98066fea7 not found: ID does not exist" containerID="8343c94418ecd4d76be4a17b61e5eac3ca586bf65f65384d89c8ccd98066fea7"
Jul 23 13:54:14.757266 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.757192    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8343c94418ecd4d76be4a17b61e5eac3ca586bf65f65384d89c8ccd98066fea7"} err="failed to get container status \"8343c94418ecd4d76be4a17b61e5eac3ca586bf65f65384d89c8ccd98066fea7\": rpc error: code = NotFound desc = could not find container \"8343c94418ecd4d76be4a17b61e5eac3ca586bf65f65384d89c8ccd98066fea7\": container with ID starting with 8343c94418ecd4d76be4a17b61e5eac3ca586bf65f65384d89c8ccd98066fea7 not found: ID does not exist"
Jul 23 13:54:14.804763 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.804733    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-home\") pod \"1a854288-8bb1-4d20-8433-f7f14441e0fe\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") "
Jul 23 13:54:14.804872 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.804787    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a854288-8bb1-4d20-8433-f7f14441e0fe-tls-certs\") pod \"1a854288-8bb1-4d20-8433-f7f14441e0fe\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") "
Jul 23 13:54:14.804872 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.804827    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-tmp-dir\") pod \"1a854288-8bb1-4d20-8433-f7f14441e0fe\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") "
Jul 23 13:54:14.804872 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.804852    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlh6j\" (UniqueName: \"kubernetes.io/projected/1a854288-8bb1-4d20-8433-f7f14441e0fe-kube-api-access-mlh6j\") pod \"1a854288-8bb1-4d20-8433-f7f14441e0fe\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") "
Jul 23 13:54:14.805054 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.804918    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-model-cache\") pod \"1a854288-8bb1-4d20-8433-f7f14441e0fe\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") "
Jul 23 13:54:14.805054 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.804940    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-dshm\") pod \"1a854288-8bb1-4d20-8433-f7f14441e0fe\" (UID: \"1a854288-8bb1-4d20-8433-f7f14441e0fe\") "
Jul 23 13:54:14.805054 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.804949    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-home" (OuterVolumeSpecName: "home") pod "1a854288-8bb1-4d20-8433-f7f14441e0fe" (UID: "1a854288-8bb1-4d20-8433-f7f14441e0fe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:54:14.805170 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.805055    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1a854288-8bb1-4d20-8433-f7f14441e0fe" (UID: "1a854288-8bb1-4d20-8433-f7f14441e0fe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:54:14.805224 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.805197    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-home\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:54:14.805224 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.805200    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-model-cache" (OuterVolumeSpecName: "model-cache") pod "1a854288-8bb1-4d20-8433-f7f14441e0fe" (UID: "1a854288-8bb1-4d20-8433-f7f14441e0fe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:54:14.805224 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.805216    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-tmp-dir\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:54:14.806764 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.806742    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a854288-8bb1-4d20-8433-f7f14441e0fe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1a854288-8bb1-4d20-8433-f7f14441e0fe" (UID: "1a854288-8bb1-4d20-8433-f7f14441e0fe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:54:14.806931 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.806913    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-dshm" (OuterVolumeSpecName: "dshm") pod "1a854288-8bb1-4d20-8433-f7f14441e0fe" (UID: "1a854288-8bb1-4d20-8433-f7f14441e0fe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:54:14.807033 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.807017    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a854288-8bb1-4d20-8433-f7f14441e0fe-kube-api-access-mlh6j" (OuterVolumeSpecName: "kube-api-access-mlh6j") pod "1a854288-8bb1-4d20-8433-f7f14441e0fe" (UID: "1a854288-8bb1-4d20-8433-f7f14441e0fe"). InnerVolumeSpecName "kube-api-access-mlh6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:54:14.906410 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.906360    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-model-cache\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:54:14.906410 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.906380    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a854288-8bb1-4d20-8433-f7f14441e0fe-dshm\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:54:14.906410 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.906389    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a854288-8bb1-4d20-8433-f7f14441e0fe-tls-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:54:14.906410 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:14.906397    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlh6j\" (UniqueName: \"kubernetes.io/projected/1a854288-8bb1-4d20-8433-f7f14441e0fe-kube-api-access-mlh6j\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:54:15.754291 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:15.754259    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"
Jul 23 13:54:15.778427 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:15.778398    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"]
Jul 23 13:54:15.783095 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:15.783072    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/rate-test-model-5ddc60-kserve-7cf9c54499-gkbcq"]
Jul 23 13:54:16.104831 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.104767    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7241-139755629743536"]
Jul 23 13:54:16.105101 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.105090    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a854288-8bb1-4d20-8433-f7f14441e0fe" containerName="main"
Jul 23 13:54:16.105155 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.105103    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a854288-8bb1-4d20-8433-f7f14441e0fe" containerName="main"
Jul 23 13:54:16.105155 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.105112    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6f4f0ad-41ce-4f6d-8a34-344de7b6b523" containerName="test-curl-7241-139755629741952"
Jul 23 13:54:16.105155 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.105119    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6f4f0ad-41ce-4f6d-8a34-344de7b6b523" containerName="test-curl-7241-139755629741952"
Jul 23 13:54:16.105251 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.105181    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6f4f0ad-41ce-4f6d-8a34-344de7b6b523" containerName="test-curl-7241-139755629741952"
Jul 23 13:54:16.105251 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.105192    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a854288-8bb1-4d20-8433-f7f14441e0fe" containerName="main"
Jul 23 13:54:16.110119 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.109336    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755629743536"
Jul 23 13:54:16.113922 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.113898    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9rv6n\""
Jul 23 13:54:16.120502 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.120477    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7241-139755629743536"]
Jul 23 13:54:16.215916 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.215888    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rwn6\" (UniqueName: \"kubernetes.io/projected/22983be5-431a-4886-8868-d63e62da881a-kube-api-access-5rwn6\") pod \"test-curl-7241-139755629743536\" (UID: \"22983be5-431a-4886-8868-d63e62da881a\") " pod="opendatahub/test-curl-7241-139755629743536"
Jul 23 13:54:16.317235 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.317206    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rwn6\" (UniqueName: \"kubernetes.io/projected/22983be5-431a-4886-8868-d63e62da881a-kube-api-access-5rwn6\") pod \"test-curl-7241-139755629743536\" (UID: \"22983be5-431a-4886-8868-d63e62da881a\") " pod="opendatahub/test-curl-7241-139755629743536"
Jul 23 13:54:16.326973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.326948    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rwn6\" (UniqueName: \"kubernetes.io/projected/22983be5-431a-4886-8868-d63e62da881a-kube-api-access-5rwn6\") pod \"test-curl-7241-139755629743536\" (UID: \"22983be5-431a-4886-8868-d63e62da881a\") " pod="opendatahub/test-curl-7241-139755629743536"
Jul 23 13:54:16.357224 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.357161    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a854288-8bb1-4d20-8433-f7f14441e0fe" path="/var/lib/kubelet/pods/1a854288-8bb1-4d20-8433-f7f14441e0fe/volumes"
Jul 23 13:54:16.419116 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.419098    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755629743536"
Jul 23 13:54:16.550451 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.550427    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7241-139755629743536"]
Jul 23 13:54:16.552531 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:54:16.552499    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22983be5_431a_4886_8868_d63e62da881a.slice/crio-06d14b3b16cdfd56328d95899322245c48fd433f405c7a65d22f34267c3be267 WatchSource:0}: Error finding container 06d14b3b16cdfd56328d95899322245c48fd433f405c7a65d22f34267c3be267: Status 404 returned error can't find the container with id 06d14b3b16cdfd56328d95899322245c48fd433f405c7a65d22f34267c3be267
Jul 23 13:54:16.759826 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:16.759797    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7241-139755629743536" event={"ID":"22983be5-431a-4886-8868-d63e62da881a","Type":"ContainerStarted","Data":"06d14b3b16cdfd56328d95899322245c48fd433f405c7a65d22f34267c3be267"}
Jul 23 13:54:17.766159 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:17.766126    2570 generic.go:356] "Generic (PLEG): container finished" podID="22983be5-431a-4886-8868-d63e62da881a" containerID="49824f9c9d0b5b8753eca7760b70bd3b6ea7303ac5f7fc47c8fa7e89a8f4d5d6" exitCode=0
Jul 23 13:54:17.766511 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:17.766211    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7241-139755629743536" event={"ID":"22983be5-431a-4886-8868-d63e62da881a","Type":"ContainerDied","Data":"49824f9c9d0b5b8753eca7760b70bd3b6ea7303ac5f7fc47c8fa7e89a8f4d5d6"}
Jul 23 13:54:18.904022 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:18.903997    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755629743536"
Jul 23 13:54:18.927466 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:18.927441    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7241-139755629743536_22983be5-431a-4886-8868-d63e62da881a/test-curl-7241-139755629743536/0.log"
Jul 23 13:54:18.952728 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:18.952698    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7241-139755629743536"]
Jul 23 13:54:18.955073 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:18.955050    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7241-139755629743536"]
Jul 23 13:54:19.040508 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:19.040425    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rwn6\" (UniqueName: \"kubernetes.io/projected/22983be5-431a-4886-8868-d63e62da881a-kube-api-access-5rwn6\") pod \"22983be5-431a-4886-8868-d63e62da881a\" (UID: \"22983be5-431a-4886-8868-d63e62da881a\") "
Jul 23 13:54:19.042446 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:19.042421    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22983be5-431a-4886-8868-d63e62da881a-kube-api-access-5rwn6" (OuterVolumeSpecName: "kube-api-access-5rwn6") pod "22983be5-431a-4886-8868-d63e62da881a" (UID: "22983be5-431a-4886-8868-d63e62da881a"). InnerVolumeSpecName "kube-api-access-5rwn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:54:19.141266 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:19.141241    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rwn6\" (UniqueName: \"kubernetes.io/projected/22983be5-431a-4886-8868-d63e62da881a-kube-api-access-5rwn6\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 23 13:54:19.692871 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:19.692838    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:19.776644 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:19.776613    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06d14b3b16cdfd56328d95899322245c48fd433f405c7a65d22f34267c3be267"
Jul 23 13:54:19.776813 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:19.776651    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7241-139755629743536"
Jul 23 13:54:19.786507 ip-10-0-128-48 kubenswrapper[2570]: E0723 13:54:19.786479    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7241-139755629743536\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="22983be5-431a-4886-8868-d63e62da881a" pod="opendatahub/test-curl-7241-139755629743536"
Jul 23 13:54:19.792513 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:19.792492    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:20.358392 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:20.358358    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22983be5-431a-4886-8868-d63e62da881a" path="/var/lib/kubelet/pods/22983be5-431a-4886-8868-d63e62da881a/volumes"
Jul 23 13:54:27.482016 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:27.481972    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:29.643185 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:29.643148    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:34.273893 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:34.273859    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:34.700060 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:34.699963    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:40.719944 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:40.719903    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:40.818792 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:40.818764    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:41.034334 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:41.034246    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:41.242817 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:41.242785    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:42.100814 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:42.100779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:42.202255 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:42.202221    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:51.841037 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:51.840957    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:56.463191 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:56.463152    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:54:56.912337 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:54:56.912264    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:02.965800 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:02.965765    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:03.028123 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:03.028093    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:03.287124 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:03.287033    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:03.462332 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:03.462302    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:03.809052 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:03.809020    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86758f95b8-d7kfs_051e6815-95ed-4911-82ff-36324689c47a/authorino/0.log"
Jul 23 13:55:10.103514 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:10.103485    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779cfbfdf-2vc95_e31d9b36-d03f-4b52-b79b-16bd08bd4773/copy-manifests/0.log"
Jul 23 13:55:10.117019 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:10.116971    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779cfbfdf-2vc95_e31d9b36-d03f-4b52-b79b-16bd08bd4773/manager/0.log"
Jul 23 13:55:13.501232 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:13.501201    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86758f95b8-d7kfs_051e6815-95ed-4911-82ff-36324689c47a/authorino/0.log"
Jul 23 13:55:13.730522 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:13.730496    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7mzcq_356e3ed2-c8b1-42fc-96bd-7a6ba996ef02/manager/0.log"
Jul 23 13:55:13.839873 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:13.839812    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9cj94_acfa9d88-ff6a-49aa-abf1-eeff20285ab1/kuadrant-console-plugin/0.log"
Jul 23 13:55:14.092160 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:14.092093    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-slzv8_1737d305-2cd2-4ed8-8490-8c36eab9b0da/manager/0.log"
Jul 23 13:55:14.970911 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:14.970885    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69f7f7699f-rdtrp_4884757f-2975-4d5d-8f71-8afa241a7e2f/kube-auth-proxy/0.log"
Jul 23 13:55:16.176579 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:16.176553    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-sg8rr_35af5565-8ae7-46df-96f2-5bf98e84f55b/main/0.log"
Jul 23 13:55:16.296550 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:16.296525    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwgt5g_a435192b-dc19-4f24-ba11-e01d6713c810/main/0.log"
Jul 23 13:55:16.414237 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:16.414202    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-mtffs_f8480404-f40e-4024-a31f-2d7d6130d184/main/0.log"
Jul 23 13:55:21.925340 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:21.925307    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:22.003888 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:22.003852    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:25.354555 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:25.354527    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fjq2l_032fa58a-197e-4083-85ba-30d5df17374b/global-pull-secret-syncer/0.log"
Jul 23 13:55:25.487527 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:25.487498    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log"
Jul 23 13:55:25.584631 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:25.584607    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-48.ec2.internal_099b81222a3a57c11d9d757e4965a26f/haproxy/0.log"
Jul 23 13:55:30.108649 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:30.108567    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86758f95b8-d7kfs_051e6815-95ed-4911-82ff-36324689c47a/authorino/0.log"
Jul 23 13:55:30.171284 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:30.171262    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7mzcq_356e3ed2-c8b1-42fc-96bd-7a6ba996ef02/manager/0.log"
Jul 23 13:55:30.196962 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:30.196943    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9cj94_acfa9d88-ff6a-49aa-abf1-eeff20285ab1/kuadrant-console-plugin/0.log"
Jul 23 13:55:30.438794 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:30.438713    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-slzv8_1737d305-2cd2-4ed8-8490-8c36eab9b0da/manager/0.log"
Jul 23 13:55:31.603259 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:31.603228    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:31.657973 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:31.657946    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fm44c_ba4270bd-f86f-4627-a6f7-2826e3e68ee4/konnectivity-agent/0.log" limit=1024
Jul 23 13:55:32.511156 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:32.511125    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85f599cb85-6vgrh_3b056adf-1054-49ec-9e35-d9c23f57b09a/metrics-server/0.log"
Jul 23 13:55:32.703695 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:32.703667    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7n47_d1884e00-d728-431e-8a30-6c5881fdc038/node-exporter/0.log"
Jul 23 13:55:32.738824 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:32.738802    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7n47_d1884e00-d728-431e-8a30-6c5881fdc038/kube-rbac-proxy/0.log"
Jul 23 13:55:32.764622 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:32.764602    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7n47_d1884e00-d728-431e-8a30-6c5881fdc038/init-textfile/0.log"
Jul 23 13:55:32.907813 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:32.907790    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-hk9bv_e5096af1-c393-43a6-adf3-a92f937d6f53/kube-rbac-proxy-main/0.log"
Jul 23 13:55:32.936260 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:32.936239    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-hk9bv_e5096af1-c393-43a6-adf3-a92f937d6f53/kube-rbac-proxy-self/0.log"
Jul 23 13:55:32.966227 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:32.966211    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-hk9bv_e5096af1-c393-43a6-adf3-a92f937d6f53/openshift-state-metrics/0.log"
Jul 23 13:55:33.007783 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:33.007759    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c96ed730-7d3a-45e9-b09c-59a764487ad3/prometheus/0.log"
Jul 23 13:55:33.035695 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:33.035678    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c96ed730-7d3a-45e9-b09c-59a764487ad3/config-reloader/0.log"
Jul 23 13:55:33.060663 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:33.060639    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c96ed730-7d3a-45e9-b09c-59a764487ad3/thanos-sidecar/0.log"
Jul 23 13:55:33.082304 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:33.082289    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c96ed730-7d3a-45e9-b09c-59a764487ad3/kube-rbac-proxy-web/0.log"
Jul 23 13:55:33.105345 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:33.105328    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c96ed730-7d3a-45e9-b09c-59a764487ad3/kube-rbac-proxy/0.log"
Jul 23 13:55:33.130124 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:33.130108    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c96ed730-7d3a-45e9-b09c-59a764487ad3/kube-rbac-proxy-thanos/0.log"
Jul 23 13:55:33.151690 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:33.151671    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c96ed730-7d3a-45e9-b09c-59a764487ad3/init-config-reloader/0.log"
Jul 23 13:55:33.185861 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:33.185842    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-xckj6_fbe07adf-0bec-4300-83d6-f8967e0523cb/prometheus-operator/0.log"
Jul 23 13:55:33.214745 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:33.214721    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-xckj6_fbe07adf-0bec-4300-83d6-f8967e0523cb/kube-rbac-proxy/0.log"
Jul 23 13:55:33.236969 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:33.236913    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-tw5pp_e8b40e4b-147e-4adb-becb-a35657280c5a/prometheus-operator-admission-webhook/0.log"
Jul 23 13:55:35.809234 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.809202    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"]
Jul 23 13:55:35.809607 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.809525    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22983be5-431a-4886-8868-d63e62da881a" containerName="test-curl-7241-139755629743536"
Jul 23 13:55:35.809607 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.809537    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="22983be5-431a-4886-8868-d63e62da881a" containerName="test-curl-7241-139755629743536"
Jul 23 13:55:35.809607 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.809605    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="22983be5-431a-4886-8868-d63e62da881a" containerName="test-curl-7241-139755629743536"
Jul 23 13:55:35.812518 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.812499    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:35.815611 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.815594    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gps8k\"/\"default-dockercfg-6wd9n\""
Jul 23 13:55:35.816449 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.816433    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gps8k\"/\"kube-root-ca.crt\""
Jul 23 13:55:35.816506 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.816471    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gps8k\"/\"openshift-service-ca.crt\""
Jul 23 13:55:35.822225 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.822204    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"]
Jul 23 13:55:35.930579 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.930550    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95efe37e-6526-48df-8e59-75551860a160-proc\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:35.930715 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.930591    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95efe37e-6526-48df-8e59-75551860a160-lib-modules\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:35.930715 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.930618    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95efe37e-6526-48df-8e59-75551860a160-sys\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:35.930715 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.930677    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95efe37e-6526-48df-8e59-75551860a160-podres\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:35.930715 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:35.930708    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7vg2\" (UniqueName: \"kubernetes.io/projected/95efe37e-6526-48df-8e59-75551860a160-kube-api-access-f7vg2\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:36.029751 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:36.029724    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-7plkb_931cd0d5-9891-4d1b-ab11-2379dbaa26f6/download-server/0.log"
Jul 23 13:55:36.031936 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:36.031917    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95efe37e-6526-48df-8e59-75551860a160-proc\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:36.032055 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:36.031957    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95efe37e-6526-48df-8e59-75551860a160-lib-modules\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:36.032055 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:36.032007    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95efe37e-6526-48df-8e59-75551860a160-sys\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:36.032055 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:36.032039    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95efe37e-6526-48df-8e59-75551860a160-proc\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:36.032201 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:36.032053    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95efe37e-6526-48df-8e59-75551860a160-podres\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:36.032201 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:36.032087    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7vg2\" (UniqueName: \"kubernetes.io/projected/95efe37e-6526-48df-8e59-75551860a160-kube-api-access-f7vg2\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:36.032201 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:36.032105    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95efe37e-6526-48df-8e59-75551860a160-lib-modules\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:36.032201 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:36.032113    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95efe37e-6526-48df-8e59-75551860a160-sys\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:36.032201 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:36.032147    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95efe37e-6526-48df-8e59-75551860a160-podres\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:36.040026 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:36.039980    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7vg2\" (UniqueName: \"kubernetes.io/projected/95efe37e-6526-48df-8e59-75551860a160-kube-api-access-f7vg2\") pod \"perf-node-gather-daemonset-hksx2\" (UID: \"95efe37e-6526-48df-8e59-75551860a160\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:36.122218 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:36.122164    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:36.249219 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:36.249186    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"]
Jul 23 13:55:36.252162 ip-10-0-128-48 kubenswrapper[2570]: W0723 13:55:36.252132    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod95efe37e_6526_48df_8e59_75551860a160.slice/crio-ced39c0c699741e0f2d4b4cf6bd40e432cd7014e770ed54ec65e827aa789ab8c WatchSource:0}: Error finding container ced39c0c699741e0f2d4b4cf6bd40e432cd7014e770ed54ec65e827aa789ab8c: Status 404 returned error can't find the container with id ced39c0c699741e0f2d4b4cf6bd40e432cd7014e770ed54ec65e827aa789ab8c
Jul 23 13:55:37.123111 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:37.123070    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2" event={"ID":"95efe37e-6526-48df-8e59-75551860a160","Type":"ContainerStarted","Data":"fd1ea6f5cf64edf742eb6328a2908c2ce7dd900750e0fb638ea908644ac28606"}
Jul 23 13:55:37.123463 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:37.123119    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2" event={"ID":"95efe37e-6526-48df-8e59-75551860a160","Type":"ContainerStarted","Data":"ced39c0c699741e0f2d4b4cf6bd40e432cd7014e770ed54ec65e827aa789ab8c"}
Jul 23 13:55:37.123463 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:37.123149    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:37.144306 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:37.144260    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2" podStartSLOduration=2.144244795 podStartE2EDuration="2.144244795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:55:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:55:37.143063405 +0000 UTC m=+2879.396589285" watchObservedRunningTime="2026-07-23 13:55:37.144244795 +0000 UTC m=+2879.397770670"
Jul 23 13:55:37.868785 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:37.868760    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-smphx_4c0217f6-c0e4-4c77-955e-5999053d1993/dns/0.log"
Jul 23 13:55:37.889504 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:37.889480    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-smphx_4c0217f6-c0e4-4c77-955e-5999053d1993/kube-rbac-proxy/0.log"
Jul 23 13:55:37.912362 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:37.912342    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bkn4j_2a06b9d1-9a08-413b-b3f5-72975c91491b/dns-node-resolver/0.log"
Jul 23 13:55:38.528199 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:38.528169    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c9cjt_89cec7d4-3633-4cf4-bba6-b680f7f86825/node-ca/0.log"
Jul 23 13:55:39.783537 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:39.783508    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69f7f7699f-rdtrp_4884757f-2975-4d5d-8f71-8afa241a7e2f/kube-auth-proxy/0.log"
Jul 23 13:55:40.759551 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:40.759525    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4tt8_e4158b30-dd08-44a6-95e7-eafb86ff3904/serve-healthcheck-canary/0.log"
Jul 23 13:55:41.242031 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:41.242004    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6wr5w_625c8f25-814a-438f-bce0-31b507fccd87/kube-rbac-proxy/0.log"
Jul 23 13:55:41.264930 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:41.264906    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6wr5w_625c8f25-814a-438f-bce0-31b507fccd87/exporter/0.log"
Jul 23 13:55:41.287035 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:41.287017    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6wr5w_625c8f25-814a-438f-bce0-31b507fccd87/extractor/0.log"
Jul 23 13:55:43.136492 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:43.136463    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-hksx2"
Jul 23 13:55:44.061582 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:44.061555    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779cfbfdf-2vc95_e31d9b36-d03f-4b52-b79b-16bd08bd4773/manager/0.log"
Jul 23 13:55:44.078450 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:44.078427    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779cfbfdf-2vc95_e31d9b36-d03f-4b52-b79b-16bd08bd4773/copy-manifests/0.log"
Jul 23 13:55:45.724673 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:45.724633    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-789dbd6fbb-xj5kw_bd8aea5b-ba65-46dc-80d6-ae10b270f842/manager/0.log"
Jul 23 13:55:45.752613 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:45.752585    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xfclj_e9dbb4c9-63b0-42e6-90ed-53d4ef2c39db/openshift-lws-operator/0.log"
Jul 23 13:55:46.454759 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:46.454675    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69f7f7699f-rdtrp_4884757f-2975-4d5d-8f71-8afa241a7e2f/kube-auth-proxy/0.log"
Jul 23 13:55:48.060176 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:48.060151    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69f7f7699f-rdtrp_4884757f-2975-4d5d-8f71-8afa241a7e2f/kube-auth-proxy/0.log"
Jul 23 13:55:52.423163 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:52.423130    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hltqz_2c0e869b-7b51-49f4-83cf-a9843d65a9f3/kube-multus-additional-cni-plugins/0.log"
Jul 23 13:55:52.445894 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:52.445869    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hltqz_2c0e869b-7b51-49f4-83cf-a9843d65a9f3/egress-router-binary-copy/0.log"
Jul 23 13:55:52.465373 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:52.465354    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hltqz_2c0e869b-7b51-49f4-83cf-a9843d65a9f3/cni-plugins/0.log"
Jul 23 13:55:52.484417 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:52.484394    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hltqz_2c0e869b-7b51-49f4-83cf-a9843d65a9f3/bond-cni-plugin/0.log"
Jul 23 13:55:52.505543 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:52.505522    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hltqz_2c0e869b-7b51-49f4-83cf-a9843d65a9f3/routeoverride-cni/0.log"
Jul 23 13:55:52.525128 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:52.525112    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hltqz_2c0e869b-7b51-49f4-83cf-a9843d65a9f3/whereabouts-cni-bincopy/0.log"
Jul 23 13:55:52.544767 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:52.544752    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hltqz_2c0e869b-7b51-49f4-83cf-a9843d65a9f3/whereabouts-cni/0.log"
Jul 23 13:55:52.889356 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:52.889327    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ct624_bf348358-707c-4e2f-8f9d-4406bc5f3db0/kube-multus/0.log"
Jul 23 13:55:53.087774 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:53.087743    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-khpmp_1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b/network-metrics-daemon/0.log"
Jul 23 13:55:53.105549 ip-10-0-128-48 kubenswrapper[2570]: I0723 13:55:53.105528    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-khpmp_1d54b8c8-3505-47fb-8dc9-8fbe86fe5a0b/kube-rbac-proxy/0.log"