Jul 16 17:27:07.971804 ip-10-0-130-51 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 17:27:07.971814 ip-10-0-130-51 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 17:27:07.971821 ip-10-0-130-51 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 17:27:07.972105 ip-10-0-130-51 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 17:27:18.105720 ip-10-0-130-51 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 17:27:18.105739 ip-10-0-130-51 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0b860a463feb46cc98ba59648f9cc49f --
Jul 16 17:29:20.285701 ip-10-0-130-51 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 17:29:20.644472 ip-10-0-130-51 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:29:20.644472 ip-10-0-130-51 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 17:29:20.644472 ip-10-0-130-51 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:29:20.644472 ip-10-0-130-51 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 17:29:20.644472 ip-10-0-130-51 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:29:20.645313 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.645222    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 17:29:20.649372 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649340    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:29:20.649372 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649372    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649376    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649380    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649383    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649387    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649389    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649392    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649395    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649398    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649401    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649411    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649415    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649417    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649420    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649424    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649429    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649433    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649436    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649439    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:29:20.649447 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649442    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649445    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649448    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649451    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649454    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649457    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649460    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649463    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649466    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649468    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649471    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649474    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649476    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649479    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649482    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649484    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649487    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649490    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649492    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649495    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649498    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:29:20.649912 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649500    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649503    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649505    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649508    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649510    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649513    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649515    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649518    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649520    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649523    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649525    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649528    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649531    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649534    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649537    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649539    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649542    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649545    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649548    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649551    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:29:20.650416 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649553    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649555    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649558    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649561    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649564    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649566    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649568    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649571    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649573    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649576    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649579    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649582    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649584    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649587    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649590    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649592    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649595    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649597    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649602    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:29:20.650900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649607    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649609    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649612    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649614    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649617    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649620    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649624    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649627    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649630    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649632    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649635    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649638    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649641    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649643    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649646    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649648    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649651    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649654    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.649656    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650824    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:29:20.651365 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650831    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650834    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650837    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650840    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650847    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650850    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650854    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650856    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650859    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650862    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650865    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650867    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650871    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650874    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650876    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650879    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650881    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650884    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650887    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650890    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:29:20.651875 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650892    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650895    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650898    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650901    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650904    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650907    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650909    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650914    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650917    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650920    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650924    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650926    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650929    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650932    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650934    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650937    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650940    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650943    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650945    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:29:20.652373 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650948    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650952    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650956    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650958    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650961    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650963    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650966    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650968    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650970    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650973    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650976    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650979    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650982    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650984    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.650998    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651001    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651004    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651007    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651010    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:29:20.652873 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651014    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651017    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651020    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651023    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651026    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651028    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651031    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651034    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651036    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651038    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651041    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651044    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651047    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651049    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651052    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651054    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651057    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651059    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651061    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651064    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:29:20.653335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651066    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651069    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651072    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651075    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651078    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651081    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651084    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651086    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651089    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651092    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651096    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651099    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651101    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651104    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651106    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651109    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651112    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651115    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651117    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651120    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:29:20.653837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651519    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651524    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651527    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651530    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651533    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651536    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651539    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651541    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651544    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651547    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651549    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651552    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651554    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651557    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651560    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651562    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651565    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651568    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651571    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651573    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:29:20.654323 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651576    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651579    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651582    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651584    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651587    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651589    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651592    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651594    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651597    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651599    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651602    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651604    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651607    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651609    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651612    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651615    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651618    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651621    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651623    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651626    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:29:20.654818 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651628    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651631    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651633    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651636    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651639    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651641    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651643    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651646    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651649    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651651    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651656    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651660    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651663    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651666    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651669    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651672    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651674    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651677    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651679    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:29:20.655294 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651682    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651686    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651690    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651692    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651695    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651698    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651701    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651703    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651706    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651709    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651711    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651714    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651717    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651719    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651722    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651724    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651727    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651732    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651735    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:29:20.655758 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651737    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651740    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651742    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651745    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651748    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651751    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651754    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651756    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651759    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651761    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651764    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651767    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651769    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651772    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651775    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651778    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651780    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651782    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651785    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:29:20.656217 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651787    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.651790    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651864    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651872    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651879    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651884    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651888    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651892    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651897    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651902    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651906    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651910    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651913    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651916    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651919    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651922    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651925    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651928    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651930    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.651936    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652449    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652453    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652457    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652460    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 17:29:20.656687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652463    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652468    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652471    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652474    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652477    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652480    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652483    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652486    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652490    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652492    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652496    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652499    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652502    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652505    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652508    2580 flags.go:64] FLAG: --enable-server="true"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652512    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652517    2580 flags.go:64] FLAG: --event-burst="100"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652520    2580 flags.go:64] FLAG: --event-qps="50"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652523    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652526    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652529    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652533    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652536    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652539    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652542    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 16 17:29:20.657278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652546    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652548    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652553    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652556    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652559    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652562    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652565    2580 flags.go:64] FLAG: --feature-gates=""
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652568    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652571    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652574    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652578    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652581    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652584    2580 flags.go:64] FLAG: --help="false"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652587    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-130-51.ec2.internal"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652590    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652593    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652596    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652600    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652604    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652607    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652610    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652613    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652615    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 17:29:20.657881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652619    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652622    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652625    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652628    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652631    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652634    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652637    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652640    2580 flags.go:64] FLAG: --lock-file=""
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652642    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652645    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652648    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652655    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652658    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652661    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652663    2580 flags.go:64] FLAG: --logging-format="text"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652666    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652670    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652672    2580 flags.go:64] FLAG: --manifest-url=""
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652675    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652680    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652682    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652687    2580 flags.go:64] FLAG: --max-pods="110"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652690    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652693    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652695    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 17:29:20.658502 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652698    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652701    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652704    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652707    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652717    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652720    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652723    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652726    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652729    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652734    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652737    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652741    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652744    2580 flags.go:64] FLAG: --port="10250"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652747    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652749    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-066d8f07f8190eb78"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652752    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652755    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652758    2580 flags.go:64] FLAG: --register-node="true"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652763    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652766    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652769    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652771    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652774    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652778    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652781    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 17:29:20.659114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652784    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652786    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652789    2580 flags.go:64] FLAG: --runonce="false"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652792    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652795    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652798    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652801    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652804    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652807    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652810    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652813    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652816    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652819    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652822    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652825    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652828    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652831    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652834    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652841    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652844    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652848    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652852    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652855    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652858    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652861    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 17:29:20.659730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652865    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652869    2580 flags.go:64] FLAG: --v="2"
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652873    2580 flags.go:64] FLAG: --version="false"
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652877    2580 flags.go:64] FLAG: --vmodule=""
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652881    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.652884    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653006    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653010    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653014    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653016    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653020    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653023    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653026    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653029    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653031    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653034    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653037    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653040    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653042    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653045    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653047    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:29:20.660360 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653050    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653054    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653058    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653061    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653066    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653068    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653071    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653073    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653076    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653079    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653081    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653084    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653087    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653089    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653092    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653094    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653097    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653100    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653102    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653105    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:29:20.660900 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653107    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653110    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653112    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653115    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653117    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653120    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653122    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653125    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653127    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653130    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653132    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653135    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653137    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653141    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653145    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653148    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653153    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653156    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653159    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:29:20.661387 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653162    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653165    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653167    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653170    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653173    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653175    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653178    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653180    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653183    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653186    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653188    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653191    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653194    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653196    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653199    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653201    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653204    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653207    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653209    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653212    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:29:20.661883 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653214    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653217    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653220    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653222    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653225    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653228    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653230    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653233    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653235    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653239    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653242    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653245    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653248    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653250    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653253    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653255    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653258    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653260    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653264    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:29:20.662369 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653267    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653270    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653273    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653275    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653278    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.653281    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.653812    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.661881    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.661899    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.661921    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.661927    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.661984    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.661990    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.661993    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:29:20.662825 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.661996    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.661999    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662003    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662006    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662009    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662011    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662014    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662016    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662019    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662022    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662024    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662027    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662029    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662032    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662036    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662039    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662042    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662045    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662048    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:29:20.663181 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662051    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662054    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662057    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662059    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662062    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662065    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662068    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662074    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662077    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662079    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662082    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662085    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662088    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662090    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662093    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662095    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662098    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662101    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662103    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662106    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:29:20.663675 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662109    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662111    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662114    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662117    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662119    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662122    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662124    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662128    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662132    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662135    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662138    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662140    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662144    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662148    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662151    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662154    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662156    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662160    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662163    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:29:20.664164 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662167    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662170    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662173    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662176    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662179    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662181    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662184    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662187    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662189    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662192    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662194    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662197    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662200    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662202    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662205    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662207    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662210    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662213    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662216    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:29:20.664742 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662218    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662221    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662223    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662226    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662228    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662231    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662233    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662236    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662239    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662242    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662244    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662247    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662250    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662252    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662255    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662258    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662261    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662279    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:29:20.665335 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662283    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.662288    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662424    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662429    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662433    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662436    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662438    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662441    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662444    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662446    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662449    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662452    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662454    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662457    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:29:20.666034 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662460    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662464    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662467    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662470    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662473    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662476    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662479    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662482    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662484    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662488    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662491    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662493    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662496    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662498    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662501    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662504    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662507    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662509    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662512    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662514    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:29:20.666525 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662517    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662519    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662521    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662524    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662526    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662529    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662531    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662534    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662536    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662539    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662541    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662544    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662547    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662549    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662552    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662554    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662557    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662559    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662562    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:29:20.667030 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662564    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662567    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662570    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662573    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662575    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662579    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662582    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662585    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662588    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662591    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662594    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662597    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662600    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662602    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662606    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662609    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662612    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662615    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662617    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:29:20.667499 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662620    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662622    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662624    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662627    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662630    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662632    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662635    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662637    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662640    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662642    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662645    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662647    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662649    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662652    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662655    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662657    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662660    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662662    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662665    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662668    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:29:20.667956 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662670    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662673    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662675    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662677    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662681    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662685    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662688    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662690    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:20.662693    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.662698    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.662826    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.664893    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.667667    2580 server.go:1019] "Starting client certificate rotation"
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.667778    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 17:29:20.668566 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.667814    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 17:29:20.670101 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.670083    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 17:29:20.671317 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:20.671297    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 17:29:21.732288 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.732266    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 16 17:29:21.735757 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.735738    2580 log.go:25] "Validated CRI v1 image API"
Jul 16 17:29:21.736558 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.736541    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 17:29:21.738920 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.738897    2580 fs.go:135] Filesystem UUIDs: map[077b4f39-5f64-44d5-8422-5b88f24429a8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bcc6c79b-d347-4f2a-8314-715823097676:/dev/nvme0n1p3]
Jul 16 17:29:21.738984 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.738918    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 17:29:21.745191 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.745076    2580 manager.go:216] Machine: {Timestamp:2026-07-16 17:29:21.743902583 +0000 UTC m=+0.298960011 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3066965 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fcc3f84b7f16df5e18aa7bfd21570 SystemUUID:ec2fcc3f-84b7-f16d-f5e1-8aa7bfd21570 BootID:0b860a46-3feb-46cc-98ba-59648f9cc49f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:89:91:e5:7e:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:89:91:e5:7e:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:26:9d:49:b0:dc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 17:29:21.745191 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.745183    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 17:29:21.745291 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.745269    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 17:29:21.748103 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.748075    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 17:29:21.748249 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.748104    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-51.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 17:29:21.748854 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.748844    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 17:29:21.748890 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.748856    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 17:29:21.748890 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.748863    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 17:29:21.749458 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.749448    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 17:29:21.750237 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.750227    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 17:29:21.750646 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.750632    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 17:29:21.753043 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.753021    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 17:29:21.753171 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.753162    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 17:29:21.753205 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.753191    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 17:29:21.753205 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.753201    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 17:29:21.753284 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.753218    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 17:29:21.753284 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.753241    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 16 17:29:21.753284 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.753260    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 17:29:21.754344 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.754324    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 17:29:21.754414 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.754357    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 17:29:21.757674 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.757647    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 17:29:21.759407 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.759392    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 17:29:21.759471 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.759422    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 17:29:21.759954 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.759943    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 17:29:21.760007 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.759958    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 17:29:21.760007 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.759964    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 17:29:21.760007 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.759970    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 17:29:21.760007 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.759979    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 17:29:21.760007 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.759985    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 17:29:21.760007 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.759993    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 17:29:21.760007 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.759999    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 17:29:21.760007 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.760005    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 17:29:21.760007 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.760011    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 17:29:21.760246 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.760019    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 17:29:21.760246 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.760025    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 17:29:21.760612 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.760603    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 17:29:21.760612 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.760612    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 17:29:21.763121 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:21.763090    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-51.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 17:29:21.763121 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.763108    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-51.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 17:29:21.763265 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:21.763090    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 17:29:21.763840 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.763810    2580 server.go:1268] "Started kubelet"
Jul 16 17:29:21.763956 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.763877    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 17:29:21.763956 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.763885    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 17:29:21.764070 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.764000    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 17:29:21.764663 ip-10-0-130-51 systemd[1]: Started Kubernetes Kubelet.
Jul 16 17:29:21.765745 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.765528    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 17:29:21.766386 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.766372    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 17:29:21.769391 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:21.768460    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-51.ec2.internal.18c2d5549c068c39  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-51.ec2.internal,UID:ip-10-0-130-51.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-51.ec2.internal,},FirstTimestamp:2026-07-16 17:29:21.763781689 +0000 UTC m=+0.318839117,LastTimestamp:2026-07-16 17:29:21.763781689 +0000 UTC m=+0.318839117,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-51.ec2.internal,}"
Jul 16 17:29:21.769633 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:21.769619    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 17:29:21.770815 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.770797    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 17:29:21.770815 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.770811    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 17:29:21.770985 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:21.770964    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-51.ec2.internal\" not found"
Jul 16 17:29:21.771392 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.771373    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 17:29:21.771930 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.771377    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 17:29:21.772019 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.771933    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 17:29:21.772084 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.772051    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 17:29:21.772084 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.772063    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 17:29:21.773447 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.773392    2580 factory.go:153] Registering CRI-O factory
Jul 16 17:29:21.773447 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.773409    2580 factory.go:223] Registration of the crio container factory successfully
Jul 16 17:29:21.773577 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.773474    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 17:29:21.773577 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.773483    2580 factory.go:55] Registering systemd factory
Jul 16 17:29:21.773577 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.773491    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 16 17:29:21.773577 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.773515    2580 factory.go:103] Registering Raw factory
Jul 16 17:29:21.773577 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.773528    2580 manager.go:1196] Started watching for new ooms in manager
Jul 16 17:29:21.773931 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:21.773909    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-51.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 17:29:21.774007 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:21.773922    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 17:29:21.774007 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.773958    2580 manager.go:349] Starting recovery of all containers
Jul 16 17:29:21.780663 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.780639    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-22qbj"
Jul 16 17:29:21.785124 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.785105    2580 manager.go:354] Recovery completed
Jul 16 17:29:21.790544 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.790526    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:29:21.792343 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.792326    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:29:21.792406 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.792356    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:29:21.792406 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.792367    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:29:21.792700 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.792678    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-22qbj"
Jul 16 17:29:21.792967 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.792951    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 17:29:21.792967 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.792964    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 17:29:21.793095 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.792980    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 17:29:21.793095 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.792965    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:29:21.793734 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.793717    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:29:21.793824 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.793747    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:29:21.793824 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.793761    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:29:21.794683 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.794668    2580 policy_none.go:49] "None policy: Start"
Jul 16 17:29:21.794741 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.794693    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 17:29:21.794741 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.794708    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 17:29:21.794741 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:21.794677    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-51.ec2.internal.18c2d5549dba5b16  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-51.ec2.internal,UID:ip-10-0-130-51.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-51.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-51.ec2.internal,},FirstTimestamp:2026-07-16 17:29:21.792342806 +0000 UTC m=+0.347400233,LastTimestamp:2026-07-16 17:29:21.792342806 +0000 UTC m=+0.347400233,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-51.ec2.internal,}"
Jul 16 17:29:21.795613 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.795602    2580 policy_none.go:47] "Start"
Jul 16 17:29:21.829808 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.829667    2580 manager.go:337] "Starting Device Plugin manager"
Jul 16 17:29:21.829938 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:21.829830    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 17:29:21.829938 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.829844    2580 server.go:87] "Starting device plugin registration server"
Jul 16 17:29:21.830160 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.830147    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 17:29:21.830226 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.830163    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 17:29:21.830300 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.830279    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 17:29:21.830383 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.830371    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 17:29:21.830383 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.830383    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 17:29:21.830924 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:21.830903    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 17:29:21.831055 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:21.830955    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-51.ec2.internal\" not found"
Jul 16 17:29:21.931280 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.931243    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:29:21.932363 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.932233    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:29:21.932363 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.932262    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:29:21.932363 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.932273    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:29:21.932363 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.932300    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-51.ec2.internal"
Jul 16 17:29:21.946329 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.946304    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-51.ec2.internal"
Jul 16 17:29:21.946388 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:21.946332    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-51.ec2.internal\": node \"ip-10-0-130-51.ec2.internal\" not found"
Jul 16 17:29:21.958117 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.958090    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 17:29:21.959509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.959484    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 17:29:21.959617 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.959528    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 17:29:21.959617 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.959553    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 17:29:21.959617 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:21.959597    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 17:29:21.963833 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:21.963817    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:29:22.017123 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.017096    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-51.ec2.internal\" not found"
Jul 16 17:29:22.060017 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.059970    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-51.ec2.internal"]
Jul 16 17:29:22.060165 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.060093    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:29:22.061602 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.061588    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:29:22.061667 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.061616    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:29:22.061667 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.061627    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:29:22.062869 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.062857    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:29:22.062978 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.062965    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.063009 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.062996    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:29:22.063587 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.063572    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:29:22.063587 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.063583    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:29:22.063706 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.063596    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:29:22.063706 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.063603    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:29:22.063706 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.063610    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:29:22.063706 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.063618    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:29:22.064847 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.064830    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.064949 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.064853    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:29:22.065465 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.065453    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:29:22.065532 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.065477    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:29:22.065532 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.065489    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:29:22.073924 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.073909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a92c4ce52ed7765e7ae333a1d470a752-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal\" (UID: \"a92c4ce52ed7765e7ae333a1d470a752\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.073976 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.073934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a92c4ce52ed7765e7ae333a1d470a752-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal\" (UID: \"a92c4ce52ed7765e7ae333a1d470a752\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.073976 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.073951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd686faea4db8ace4f851a7d64c4f3c7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-51.ec2.internal\" (UID: \"cd686faea4db8ace4f851a7d64c4f3c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.087823 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.087799    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-51.ec2.internal\" not found" node="ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.092285 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.092269    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-51.ec2.internal\" not found" node="ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.117704 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.117682    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-51.ec2.internal\" not found"
Jul 16 17:29:22.175054 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.175009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a92c4ce52ed7765e7ae333a1d470a752-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal\" (UID: \"a92c4ce52ed7765e7ae333a1d470a752\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.175190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.175066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a92c4ce52ed7765e7ae333a1d470a752-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal\" (UID: \"a92c4ce52ed7765e7ae333a1d470a752\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.175190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.175070    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a92c4ce52ed7765e7ae333a1d470a752-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal\" (UID: \"a92c4ce52ed7765e7ae333a1d470a752\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.175190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.175086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd686faea4db8ace4f851a7d64c4f3c7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-51.ec2.internal\" (UID: \"cd686faea4db8ace4f851a7d64c4f3c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.175190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.175114    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a92c4ce52ed7765e7ae333a1d470a752-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal\" (UID: \"a92c4ce52ed7765e7ae333a1d470a752\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.175190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.175119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd686faea4db8ace4f851a7d64c4f3c7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-51.ec2.internal\" (UID: \"cd686faea4db8ace4f851a7d64c4f3c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.218816 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.218733    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-51.ec2.internal\" not found"
Jul 16 17:29:22.319359 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.319307    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-51.ec2.internal\" not found"
Jul 16 17:29:22.389905 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.389871    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.394919 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.394899    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.419795 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.419747    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-51.ec2.internal\" not found"
Jul 16 17:29:22.520339 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.520246    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-51.ec2.internal\" not found"
Jul 16 17:29:22.620811 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.620781    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-51.ec2.internal\" not found"
Jul 16 17:29:22.714785 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.714755    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:29:22.719644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.719624    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 17:29:22.719762 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.719748    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 17:29:22.719799 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.719769    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 17:29:22.754109 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.754074    2580 apiserver.go:52] "Watching apiserver"
Jul 16 17:29:22.771259 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.771177    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 17:29:22.771389 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.771191    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.776649 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.776632    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 17:29:22.776935 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.776917    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-ssthj","openshift-multus/network-metrics-daemon-m68mv","openshift-ovn-kubernetes/ovnkube-node-4vp5p","kube-system/konnectivity-agent-ct2x7","openshift-image-registry/node-ca-nmm97","openshift-multus/multus-additional-cni-plugins-p2jnp","openshift-multus/multus-fsvpp","openshift-network-diagnostics/network-check-target-7lq4t","openshift-network-operator/iptables-alerter-qs75j","kube-system/global-pull-secret-syncer-c87pm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k","openshift-cluster-node-tuning-operator/tuned-7ztnp"]
Jul 16 17:29:22.778400 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.778385    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ssthj"
Jul 16 17:29:22.780963 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.780167    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nmm97"
Jul 16 17:29:22.781596 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.781566    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2g76n\""
Jul 16 17:29:22.781722 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.781705    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 17:29:22.781776 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.781737    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 17:29:22.781831 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.781792    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:22.781891 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.781869    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:22.783001 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.782984    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 17:29:22.783136 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.783000    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6qwfs\""
Jul 16 17:29:22.783136 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.782984    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 17:29:22.783136 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.783129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.783314 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.783273    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 17:29:22.784505 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.784489    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ct2x7"
Jul 16 17:29:22.785644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.785622    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 17:29:22.785644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.785643    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.785801 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.785726    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 17:29:22.785941 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.785916    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 17:29:22.786023 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.785988    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 17:29:22.786104 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.786053    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 17:29:22.786243 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.786228    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b527r\""
Jul 16 17:29:22.786433 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.786400    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 17:29:22.786519 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.786503    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 17:29:22.786583 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.786522    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zrrdn\""
Jul 16 17:29:22.786784 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.786771    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 17:29:22.786969 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.786957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.787029 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.787014    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 17:29:22.788002 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.787987    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 17:29:22.788249 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.788235    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 17:29:22.788329 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.788235    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hgbkp\""
Jul 16 17:29:22.788402 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.788354    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:22.788463 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.788408    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 17:29:22.788463 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.788413    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:22.788678 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.788665    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 17:29:22.788723 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.788675    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 17:29:22.789321 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.789309    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 17:29:22.789384 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.789326    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6rwrk\""
Jul 16 17:29:22.789384 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.789357    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 17:29:22.789493 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.789421    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-51.ec2.internal"
Jul 16 17:29:22.789541 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.789507    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qs75j"
Jul 16 17:29:22.790839 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.790821    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:22.790921 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.790877    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:22.791849 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.791833    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:29:22.791950 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.791895    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 17:29:22.792076 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.792061    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.792187 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.792155    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 17:29:22.792187 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.792181    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-psw84\""
Jul 16 17:29:22.793317 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.793300    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal"]
Jul 16 17:29:22.793395 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.793369    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.794678 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.794660    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 17:29:22.794786 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.794775    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xf92h\""
Jul 16 17:29:22.795227 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.795210    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 17:29:22.795659 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.795645    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 17:29:22.795750 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.795715    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 17:29:22.795895 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.795881    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:29:22.796115 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.796103    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2khlh\""
Jul 16 17:29:22.796229 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.796208    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 17:24:21 +0000 UTC" deadline="2028-03-14 04:37:16.840782578 +0000 UTC"
Jul 16 17:29:22.796267 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.796229    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14555h7m54.04455615s"
Jul 16 17:29:22.801217 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.801202    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-51.ec2.internal"]
Jul 16 17:29:22.801302 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.801244    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 17:29:22.824234 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.824210    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j46zx"
Jul 16 17:29:22.842958 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.842893    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j46zx"
Jul 16 17:29:22.872690 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.872663    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 17:29:22.879192 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879168    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-sys-fs\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.879192 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-run\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.879380 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7cqg\" (UniqueName: \"kubernetes.io/projected/3c2da323-e68f-47d8-9f40-606c77ad9f39-kube-api-access-n7cqg\") pod \"node-ca-nmm97\" (UID: \"3c2da323-e68f-47d8-9f40-606c77ad9f39\") " pod="openshift-image-registry/node-ca-nmm97"
Jul 16 17:29:22.879380 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5e39da5-fd84-4344-9e96-4403eab6cd5a-konnectivity-ca\") pod \"konnectivity-agent-ct2x7\" (UID: \"d5e39da5-fd84-4344-9e96-4403eab6cd5a\") " pod="kube-system/konnectivity-agent-ct2x7"
Jul 16 17:29:22.879380 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879258    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-run-netns\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.879380 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-var-lib-cni-multus\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.879525 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-device-dir\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.879525 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-tuned\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.879525 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d988eda-40b2-4fbe-88e1-75a7b51aa3f5-hosts-file\") pod \"node-resolver-ssthj\" (UID: \"6d988eda-40b2-4fbe-88e1-75a7b51aa3f5\") " pod="openshift-dns/node-resolver-ssthj"
Jul 16 17:29:22.879525 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-slash\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.879525 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbpcs\" (UniqueName: \"kubernetes.io/projected/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-kube-api-access-xbpcs\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.879525 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-etc-kubernetes\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879538    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-sys\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-host\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3c2da323-e68f-47d8-9f40-606c77ad9f39-serviceca\") pod \"node-ca-nmm97\" (UID: \"3c2da323-e68f-47d8-9f40-606c77ad9f39\") " pod="openshift-image-registry/node-ca-nmm97"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-run-ovn-kubernetes\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-cni-bin\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp9vf\" (UniqueName: \"kubernetes.io/projected/a062b146-a0ad-447c-a839-9f44cb8d4c42-kube-api-access-cp9vf\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-system-cni-dir\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-systemd-units\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-cni-binary-copy\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879746    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879772    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-cnibin\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-os-release\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.879838 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-multus-socket-dir-parent\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-run-multus-certs\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79ed6504-6c40-4552-b7f1-02fe4544b52b-iptables-alerter-script\") pod \"iptables-alerter-qs75j\" (UID: \"79ed6504-6c40-4552-b7f1-02fe4544b52b\") " pod="openshift-network-operator/iptables-alerter-qs75j"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-var-lib-kubelet\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a062b146-a0ad-447c-a839-9f44cb8d4c42-env-overrides\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.879998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bdz2\" (UniqueName: \"kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2\") pod \"network-check-target-7lq4t\" (UID: \"78a41699-1953-423f-89aa-efc3afe5fecc\") " pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880027    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5pzp\" (UniqueName: \"kubernetes.io/projected/a95f3d94-c001-46c0-98bd-230b10ccfab9-kube-api-access-r5pzp\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fe11265-43f6-459e-aff1-bb0618552ec3-tmp\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a062b146-a0ad-447c-a839-9f44cb8d4c42-ovn-node-metrics-cert\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880115    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-os-release\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbvhs\" (UniqueName: \"kubernetes.io/projected/79ed6504-6c40-4552-b7f1-02fe4544b52b-kube-api-access-jbvhs\") pod \"iptables-alerter-qs75j\" (UID: \"79ed6504-6c40-4552-b7f1-02fe4544b52b\") " pod="openshift-network-operator/iptables-alerter-qs75j"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880168    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880236    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a062b146-a0ad-447c-a839-9f44cb8d4c42-ovnkube-config\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe08b052-aad8-4578-a744-1fe793b72104-kubelet-config\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-sysctl-d\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.880501 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880311    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-etc-openvswitch\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-var-lib-cni-bin\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs\") pod \"network-metrics-daemon-m68mv\" (UID: \"5b310a15-65a4-4607-a273-ed5910798e1a\") " pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-run-ovn\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880406    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-cnibin\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880429    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79ed6504-6c40-4552-b7f1-02fe4544b52b-host-slash\") pod \"iptables-alerter-qs75j\" (UID: \"79ed6504-6c40-4552-b7f1-02fe4544b52b\") " pod="openshift-network-operator/iptables-alerter-qs75j"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-sysconfig\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rzd8\" (UniqueName: \"kubernetes.io/projected/5b310a15-65a4-4607-a273-ed5910798e1a-kube-api-access-2rzd8\") pod \"network-metrics-daemon-m68mv\" (UID: \"5b310a15-65a4-4607-a273-ed5910798e1a\") " pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c88e12e4-6808-4591-9fab-99e1f9d3c284-cni-binary-copy\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-run-k8s-cni-cncf-io\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880556    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-hostroot\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-modprobe-d\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880595    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-run-systemd\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-run-openvswitch\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a062b146-a0ad-447c-a839-9f44cb8d4c42-ovnkube-script-lib\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.881138 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880655    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c88e12e4-6808-4591-9fab-99e1f9d3c284-multus-daemon-config\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-socket-dir\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880711    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-etc-selinux\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-systemd\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d988eda-40b2-4fbe-88e1-75a7b51aa3f5-tmp-dir\") pod \"node-resolver-ssthj\" (UID: \"6d988eda-40b2-4fbe-88e1-75a7b51aa3f5\") " pod="openshift-dns/node-resolver-ssthj"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880787    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-kubelet\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880819    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5e39da5-fd84-4344-9e96-4403eab6cd5a-agent-certs\") pod \"konnectivity-agent-ct2x7\" (UID: \"d5e39da5-fd84-4344-9e96-4403eab6cd5a\") " pod="kube-system/konnectivity-agent-ct2x7"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-multus-conf-dir\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-registration-dir\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-sysctl-conf\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880921    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txrfs\" (UniqueName: \"kubernetes.io/projected/2fe11265-43f6-459e-aff1-bb0618552ec3-kube-api-access-txrfs\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c2da323-e68f-47d8-9f40-606c77ad9f39-host\") pod \"node-ca-nmm97\" (UID: \"3c2da323-e68f-47d8-9f40-606c77ad9f39\") " pod="openshift-image-registry/node-ca-nmm97"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-var-lib-openvswitch\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.880983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-log-socket\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.881004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-cni-netd\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.881025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-kubernetes\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.881644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.881071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bmlz\" (UniqueName: \"kubernetes.io/projected/6d988eda-40b2-4fbe-88e1-75a7b51aa3f5-kube-api-access-7bmlz\") pod \"node-resolver-ssthj\" (UID: \"6d988eda-40b2-4fbe-88e1-75a7b51aa3f5\") " pod="openshift-dns/node-resolver-ssthj"
Jul 16 17:29:22.882440 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.881090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-node-log\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.882440 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.881105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-system-cni-dir\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.882440 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.881123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-var-lib-kubelet\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.882440 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.881145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5pwf\" (UniqueName: \"kubernetes.io/projected/c88e12e4-6808-4591-9fab-99e1f9d3c284-kube-api-access-m5pwf\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.882440 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.881161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe08b052-aad8-4578-a744-1fe793b72104-dbus\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:22.882440 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.881175    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.882440 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.881239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-lib-modules\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.882440 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.881264    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-run-netns\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.882440 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.881280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-multus-cni-dir\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.941146 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:22.941101    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd686faea4db8ace4f851a7d64c4f3c7.slice/crio-c39f5ea33ecd9da73ab95077948584f3e6bcd771127683cdec734116db3c277d WatchSource:0}: Error finding container c39f5ea33ecd9da73ab95077948584f3e6bcd771127683cdec734116db3c277d: Status 404 returned error can't find the container with id c39f5ea33ecd9da73ab95077948584f3e6bcd771127683cdec734116db3c277d
Jul 16 17:29:22.941475 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:22.941455    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda92c4ce52ed7765e7ae333a1d470a752.slice/crio-ea8d6a3fcda30e564225bf0b6d0f4d9c3ab60aef8a76069311d2ee145ce23c47 WatchSource:0}: Error finding container ea8d6a3fcda30e564225bf0b6d0f4d9c3ab60aef8a76069311d2ee145ce23c47: Status 404 returned error can't find the container with id ea8d6a3fcda30e564225bf0b6d0f4d9c3ab60aef8a76069311d2ee145ce23c47
Jul 16 17:29:22.947902 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.947884    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:29:22.963360 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.963315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-51.ec2.internal" event={"ID":"cd686faea4db8ace4f851a7d64c4f3c7","Type":"ContainerStarted","Data":"c39f5ea33ecd9da73ab95077948584f3e6bcd771127683cdec734116db3c277d"}
Jul 16 17:29:22.964300 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.964276    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal" event={"ID":"a92c4ce52ed7765e7ae333a1d470a752","Type":"ContainerStarted","Data":"ea8d6a3fcda30e564225bf0b6d0f4d9c3ab60aef8a76069311d2ee145ce23c47"}
Jul 16 17:29:22.981777 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.981749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bdz2\" (UniqueName: \"kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2\") pod \"network-check-target-7lq4t\" (UID: \"78a41699-1953-423f-89aa-efc3afe5fecc\") " pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:22.981777 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.981780    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5pzp\" (UniqueName: \"kubernetes.io/projected/a95f3d94-c001-46c0-98bd-230b10ccfab9-kube-api-access-r5pzp\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.981966 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.981795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fe11265-43f6-459e-aff1-bb0618552ec3-tmp\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.981966 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.981817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a062b146-a0ad-447c-a839-9f44cb8d4c42-ovn-node-metrics-cert\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.981966 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.981836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-os-release\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.981966 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.981860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbvhs\" (UniqueName: \"kubernetes.io/projected/79ed6504-6c40-4552-b7f1-02fe4544b52b-kube-api-access-jbvhs\") pod \"iptables-alerter-qs75j\" (UID: \"79ed6504-6c40-4552-b7f1-02fe4544b52b\") " pod="openshift-network-operator/iptables-alerter-qs75j"
Jul 16 17:29:22.981966 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.981876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:22.981966 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.981897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.981966 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.981922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a062b146-a0ad-447c-a839-9f44cb8d4c42-ovnkube-config\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.981966 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.981931    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-os-release\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.982347 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.981975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe08b052-aad8-4578-a744-1fe793b72104-kubelet-config\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:22.982347 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.982005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-sysctl-d\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.982347 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.982050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-etc-openvswitch\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.982347 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.982048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.982347 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.982139    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe08b052-aad8-4578-a744-1fe793b72104-kubelet-config\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:22.982347 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.982239    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 17:29:22.982347 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.982250    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-sysctl-d\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.982636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.982420    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-etc-openvswitch\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.982636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.982412    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-var-lib-cni-bin\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.982636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.982505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-var-lib-cni-bin\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.982636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.982522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs\") pod \"network-metrics-daemon-m68mv\" (UID: \"5b310a15-65a4-4607-a273-ed5910798e1a\") " pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:22.983739 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.983429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-run-ovn\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.983739 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.983509    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:22.983739 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.983544    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-cnibin\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.983739 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.983577    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79ed6504-6c40-4552-b7f1-02fe4544b52b-host-slash\") pod \"iptables-alerter-qs75j\" (UID: \"79ed6504-6c40-4552-b7f1-02fe4544b52b\") " pod="openshift-network-operator/iptables-alerter-qs75j"
Jul 16 17:29:22.983739 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.983575    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a062b146-a0ad-447c-a839-9f44cb8d4c42-ovnkube-config\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.983739 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.983598    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret podName:fe08b052-aad8-4578-a744-1fe793b72104 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:23.483577721 +0000 UTC m=+2.038635144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret") pod "global-pull-secret-syncer-c87pm" (UID: "fe08b052-aad8-4578-a744-1fe793b72104") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:22.983739 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.983645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-cnibin\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.983739 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.983657    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79ed6504-6c40-4552-b7f1-02fe4544b52b-host-slash\") pod \"iptables-alerter-qs75j\" (UID: \"79ed6504-6c40-4552-b7f1-02fe4544b52b\") " pod="openshift-network-operator/iptables-alerter-qs75j"
Jul 16 17:29:22.983739 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.983708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-run-ovn\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.983739 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.983684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-sysconfig\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.984275 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.983776    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rzd8\" (UniqueName: \"kubernetes.io/projected/5b310a15-65a4-4607-a273-ed5910798e1a-kube-api-access-2rzd8\") pod \"network-metrics-daemon-m68mv\" (UID: \"5b310a15-65a4-4607-a273-ed5910798e1a\") " pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:22.984275 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.983806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c88e12e4-6808-4591-9fab-99e1f9d3c284-cni-binary-copy\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.984275 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.983842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-run-k8s-cni-cncf-io\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.984275 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.983872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-hostroot\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.984275 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.983902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-modprobe-d\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.984275 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.984002    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:22.984275 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.984088    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs podName:5b310a15-65a4-4607-a273-ed5910798e1a nodeName:}" failed. No retries permitted until 2026-07-16 17:29:23.484068349 +0000 UTC m=+2.039125769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs") pod "network-metrics-daemon-m68mv" (UID: "5b310a15-65a4-4607-a273-ed5910798e1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:22.984275 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.984128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-run-systemd\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.984275 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.984167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-run-openvswitch\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.984275 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.984224    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-run-systemd\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.984711 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.984261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-run-k8s-cni-cncf-io\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.984711 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.984435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-hostroot\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.984711 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.984548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c88e12e4-6808-4591-9fab-99e1f9d3c284-cni-binary-copy\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.986273 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.986242    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a062b146-a0ad-447c-a839-9f44cb8d4c42-ovn-node-metrics-cert\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.987024 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.986996    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-sysconfig\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.987139 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.987139 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987113    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fe11265-43f6-459e-aff1-bb0618552ec3-tmp\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.987214 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.987441 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-modprobe-d\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.987483 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-run-openvswitch\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.987483 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a062b146-a0ad-447c-a839-9f44cb8d4c42-ovnkube-script-lib\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.987565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c88e12e4-6808-4591-9fab-99e1f9d3c284-multus-daemon-config\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.987565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-socket-dir\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.987565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-etc-selinux\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.987565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987538    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-systemd\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.987565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d988eda-40b2-4fbe-88e1-75a7b51aa3f5-tmp-dir\") pod \"node-resolver-ssthj\" (UID: \"6d988eda-40b2-4fbe-88e1-75a7b51aa3f5\") " pod="openshift-dns/node-resolver-ssthj"
Jul 16 17:29:22.987792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987571    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-kubelet\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.987792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987586    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5e39da5-fd84-4344-9e96-4403eab6cd5a-agent-certs\") pod \"konnectivity-agent-ct2x7\" (UID: \"d5e39da5-fd84-4344-9e96-4403eab6cd5a\") " pod="kube-system/konnectivity-agent-ct2x7"
Jul 16 17:29:22.987792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-multus-conf-dir\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.987792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987611    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-socket-dir\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.987792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-systemd\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.987792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-multus-conf-dir\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.987792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-etc-selinux\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.987792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-kubelet\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.987792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-registration-dir\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.987792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-sysctl-conf\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.987792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txrfs\" (UniqueName: \"kubernetes.io/projected/2fe11265-43f6-459e-aff1-bb0618552ec3-kube-api-access-txrfs\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c2da323-e68f-47d8-9f40-606c77ad9f39-host\") pod \"node-ca-nmm97\" (UID: \"3c2da323-e68f-47d8-9f40-606c77ad9f39\") " pod="openshift-image-registry/node-ca-nmm97"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987826    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-registration-dir\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c2da323-e68f-47d8-9f40-606c77ad9f39-host\") pod \"node-ca-nmm97\" (UID: \"3c2da323-e68f-47d8-9f40-606c77ad9f39\") " pod="openshift-image-registry/node-ca-nmm97"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-var-lib-openvswitch\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987880    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-var-lib-openvswitch\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-log-socket\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-sysctl-conf\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-cni-netd\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d988eda-40b2-4fbe-88e1-75a7b51aa3f5-tmp-dir\") pod \"node-resolver-ssthj\" (UID: \"6d988eda-40b2-4fbe-88e1-75a7b51aa3f5\") " pod="openshift-dns/node-resolver-ssthj"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987972    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-log-socket\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-kubernetes\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-cni-netd\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.987967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c88e12e4-6808-4591-9fab-99e1f9d3c284-multus-daemon-config\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988024    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-kubernetes\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bmlz\" (UniqueName: \"kubernetes.io/projected/6d988eda-40b2-4fbe-88e1-75a7b51aa3f5-kube-api-access-7bmlz\") pod \"node-resolver-ssthj\" (UID: \"6d988eda-40b2-4fbe-88e1-75a7b51aa3f5\") " pod="openshift-dns/node-resolver-ssthj"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-node-log\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-system-cni-dir\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.988257 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-var-lib-kubelet\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5pwf\" (UniqueName: \"kubernetes.io/projected/c88e12e4-6808-4591-9fab-99e1f9d3c284-kube-api-access-m5pwf\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe08b052-aad8-4578-a744-1fe793b72104-dbus\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-system-cni-dir\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988165    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-var-lib-kubelet\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-node-log\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-lib-modules\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-run-netns\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-multus-cni-dir\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988308    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe08b052-aad8-4578-a744-1fe793b72104-dbus\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-sys-fs\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-run\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988359    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-run-netns\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-multus-cni-dir\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7cqg\" (UniqueName: \"kubernetes.io/projected/3c2da323-e68f-47d8-9f40-606c77ad9f39-kube-api-access-n7cqg\") pod \"node-ca-nmm97\" (UID: \"3c2da323-e68f-47d8-9f40-606c77ad9f39\") " pod="openshift-image-registry/node-ca-nmm97"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-lib-modules\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-sys-fs\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.989071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5e39da5-fd84-4344-9e96-4403eab6cd5a-konnectivity-ca\") pod \"konnectivity-agent-ct2x7\" (UID: \"d5e39da5-fd84-4344-9e96-4403eab6cd5a\") " pod="kube-system/konnectivity-agent-ct2x7"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988431    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-run\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988460    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-run-netns\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-var-lib-cni-multus\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988517    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-device-dir\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988522    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-run-netns\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-tuned\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d988eda-40b2-4fbe-88e1-75a7b51aa3f5-hosts-file\") pod \"node-resolver-ssthj\" (UID: \"6d988eda-40b2-4fbe-88e1-75a7b51aa3f5\") " pod="openshift-dns/node-resolver-ssthj"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988579    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-var-lib-cni-multus\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-slash\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988602    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a062b146-a0ad-447c-a839-9f44cb8d4c42-ovnkube-script-lib\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-slash\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988643    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a95f3d94-c001-46c0-98bd-230b10ccfab9-device-dir\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d988eda-40b2-4fbe-88e1-75a7b51aa3f5-hosts-file\") pod \"node-resolver-ssthj\" (UID: \"6d988eda-40b2-4fbe-88e1-75a7b51aa3f5\") " pod="openshift-dns/node-resolver-ssthj"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbpcs\" (UniqueName: \"kubernetes.io/projected/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-kube-api-access-xbpcs\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-etc-kubernetes\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-sys\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988758    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-etc-kubernetes\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.989885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-host\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988729    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3c2da323-e68f-47d8-9f40-606c77ad9f39-serviceca\") pod \"node-ca-nmm97\" (UID: \"3c2da323-e68f-47d8-9f40-606c77ad9f39\") " pod="openshift-image-registry/node-ca-nmm97"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-sys\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988839    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-host\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-run-ovn-kubernetes\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988952    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5e39da5-fd84-4344-9e96-4403eab6cd5a-konnectivity-ca\") pod \"konnectivity-agent-ct2x7\" (UID: \"d5e39da5-fd84-4344-9e96-4403eab6cd5a\") " pod="kube-system/konnectivity-agent-ct2x7"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-run-ovn-kubernetes\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.988995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-cni-bin\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp9vf\" (UniqueName: \"kubernetes.io/projected/a062b146-a0ad-447c-a839-9f44cb8d4c42-kube-api-access-cp9vf\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-system-cni-dir\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989082    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-host-cni-bin\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-systemd-units\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-cni-binary-copy\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a062b146-a0ad-447c-a839-9f44cb8d4c42-systemd-units\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.990508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-cnibin\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-os-release\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3c2da323-e68f-47d8-9f40-606c77ad9f39-serviceca\") pod \"node-ca-nmm97\" (UID: \"3c2da323-e68f-47d8-9f40-606c77ad9f39\") " pod="openshift-image-registry/node-ca-nmm97"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-multus-socket-dir-parent\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-run-multus-certs\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989305    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-multus-socket-dir-parent\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989305    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79ed6504-6c40-4552-b7f1-02fe4544b52b-iptables-alerter-script\") pod \"iptables-alerter-qs75j\" (UID: \"79ed6504-6c40-4552-b7f1-02fe4544b52b\") " pod="openshift-network-operator/iptables-alerter-qs75j"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989351    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-cnibin\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-var-lib-kubelet\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-os-release\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-system-cni-dir\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989396    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fe11265-43f6-459e-aff1-bb0618552ec3-var-lib-kubelet\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a062b146-a0ad-447c-a839-9f44cb8d4c42-env-overrides\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989431    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c88e12e4-6808-4591-9fab-99e1f9d3c284-host-run-multus-certs\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989629    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-cni-binary-copy\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989766    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a062b146-a0ad-447c-a839-9f44cb8d4c42-env-overrides\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:22.991057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:22.991616 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.989889    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79ed6504-6c40-4552-b7f1-02fe4544b52b-iptables-alerter-script\") pod \"iptables-alerter-qs75j\" (UID: \"79ed6504-6c40-4552-b7f1-02fe4544b52b\") " pod="openshift-network-operator/iptables-alerter-qs75j"
Jul 16 17:29:22.991616 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.990228    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5e39da5-fd84-4344-9e96-4403eab6cd5a-agent-certs\") pod \"konnectivity-agent-ct2x7\" (UID: \"d5e39da5-fd84-4344-9e96-4403eab6cd5a\") " pod="kube-system/konnectivity-agent-ct2x7"
Jul 16 17:29:22.991616 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.990756    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fe11265-43f6-459e-aff1-bb0618552ec3-etc-tuned\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:22.993228 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.993206    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbvhs\" (UniqueName: \"kubernetes.io/projected/79ed6504-6c40-4552-b7f1-02fe4544b52b-kube-api-access-jbvhs\") pod \"iptables-alerter-qs75j\" (UID: \"79ed6504-6c40-4552-b7f1-02fe4544b52b\") " pod="openshift-network-operator/iptables-alerter-qs75j"
Jul 16 17:29:22.993805 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.993785    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5pzp\" (UniqueName: \"kubernetes.io/projected/a95f3d94-c001-46c0-98bd-230b10ccfab9-kube-api-access-r5pzp\") pod \"aws-ebs-csi-driver-node-nmb8k\" (UID: \"a95f3d94-c001-46c0-98bd-230b10ccfab9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:22.997946 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.997927    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:29:22.997946 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.997947    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:29:22.998062 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.997957    2580 projected.go:196] Error preparing data for projected volume kube-api-access-4bdz2 for pod openshift-network-diagnostics/network-check-target-7lq4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:22.998062 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:22.998008    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2 podName:78a41699-1953-423f-89aa-efc3afe5fecc nodeName:}" failed. No retries permitted until 2026-07-16 17:29:23.497991635 +0000 UTC m=+2.053049063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4bdz2" (UniqueName: "kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2") pod "network-check-target-7lq4t" (UID: "78a41699-1953-423f-89aa-efc3afe5fecc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:22.999252 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:22.999233    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rzd8\" (UniqueName: \"kubernetes.io/projected/5b310a15-65a4-4607-a273-ed5910798e1a-kube-api-access-2rzd8\") pod \"network-metrics-daemon-m68mv\" (UID: \"5b310a15-65a4-4607-a273-ed5910798e1a\") " pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:23.002401 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.002373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbpcs\" (UniqueName: \"kubernetes.io/projected/e88c6874-4c5b-4eb2-b48f-bacbec4ce47c-kube-api-access-xbpcs\") pod \"multus-additional-cni-plugins-p2jnp\" (UID: \"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c\") " pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:23.003246 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.003227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp9vf\" (UniqueName: \"kubernetes.io/projected/a062b146-a0ad-447c-a839-9f44cb8d4c42-kube-api-access-cp9vf\") pod \"ovnkube-node-4vp5p\" (UID: \"a062b146-a0ad-447c-a839-9f44cb8d4c42\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:23.003364 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.003347    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bmlz\" (UniqueName: \"kubernetes.io/projected/6d988eda-40b2-4fbe-88e1-75a7b51aa3f5-kube-api-access-7bmlz\") pod \"node-resolver-ssthj\" (UID: \"6d988eda-40b2-4fbe-88e1-75a7b51aa3f5\") " pod="openshift-dns/node-resolver-ssthj"
Jul 16 17:29:23.004608 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.004587    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txrfs\" (UniqueName: \"kubernetes.io/projected/2fe11265-43f6-459e-aff1-bb0618552ec3-kube-api-access-txrfs\") pod \"tuned-7ztnp\" (UID: \"2fe11265-43f6-459e-aff1-bb0618552ec3\") " pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:23.004978 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.004960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5pwf\" (UniqueName: \"kubernetes.io/projected/c88e12e4-6808-4591-9fab-99e1f9d3c284-kube-api-access-m5pwf\") pod \"multus-fsvpp\" (UID: \"c88e12e4-6808-4591-9fab-99e1f9d3c284\") " pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:23.006028 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.006013    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7cqg\" (UniqueName: \"kubernetes.io/projected/3c2da323-e68f-47d8-9f40-606c77ad9f39-kube-api-access-n7cqg\") pod \"node-ca-nmm97\" (UID: \"3c2da323-e68f-47d8-9f40-606c77ad9f39\") " pod="openshift-image-registry/node-ca-nmm97"
Jul 16 17:29:23.101449 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.101339    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ssthj"
Jul 16 17:29:23.110621 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:23.110593    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d988eda_40b2_4fbe_88e1_75a7b51aa3f5.slice/crio-5bc684a7b84478d36e607ca41fd21ce0d13da564ac16d1f461ee9d173f0cb0ae WatchSource:0}: Error finding container 5bc684a7b84478d36e607ca41fd21ce0d13da564ac16d1f461ee9d173f0cb0ae: Status 404 returned error can't find the container with id 5bc684a7b84478d36e607ca41fd21ce0d13da564ac16d1f461ee9d173f0cb0ae
Jul 16 17:29:23.121822 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.121796    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nmm97"
Jul 16 17:29:23.129511 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:23.129483    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2da323_e68f_47d8_9f40_606c77ad9f39.slice/crio-c34a72dc0ff373cb685a2be4bf1cb687c65bbf5880e3e5357298bc26f967687b WatchSource:0}: Error finding container c34a72dc0ff373cb685a2be4bf1cb687c65bbf5880e3e5357298bc26f967687b: Status 404 returned error can't find the container with id c34a72dc0ff373cb685a2be4bf1cb687c65bbf5880e3e5357298bc26f967687b
Jul 16 17:29:23.140573 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.140554    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:23.148245 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:23.148216    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda062b146_a0ad_447c_a839_9f44cb8d4c42.slice/crio-c5fc8b0443ec5c0a2a641c11f6b6c1204eeac3da7ca0c6e256531cd32305c9ca WatchSource:0}: Error finding container c5fc8b0443ec5c0a2a641c11f6b6c1204eeac3da7ca0c6e256531cd32305c9ca: Status 404 returned error can't find the container with id c5fc8b0443ec5c0a2a641c11f6b6c1204eeac3da7ca0c6e256531cd32305c9ca
Jul 16 17:29:23.157539 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.157523    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ct2x7"
Jul 16 17:29:23.164342 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:23.164319    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e39da5_fd84_4344_9e96_4403eab6cd5a.slice/crio-06b0f9d2a61ce763644e89530fa235993f4f4eae074e465a2b5a3b9e7913ec39 WatchSource:0}: Error finding container 06b0f9d2a61ce763644e89530fa235993f4f4eae074e465a2b5a3b9e7913ec39: Status 404 returned error can't find the container with id 06b0f9d2a61ce763644e89530fa235993f4f4eae074e465a2b5a3b9e7913ec39
Jul 16 17:29:23.177684 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.177663    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p2jnp"
Jul 16 17:29:23.183824 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.183801    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fsvpp"
Jul 16 17:29:23.185289 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:23.185260    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88c6874_4c5b_4eb2_b48f_bacbec4ce47c.slice/crio-aa73f66bc8fdcec55a50b329aeb55154af2d0f11df381edd922504c204ec7455 WatchSource:0}: Error finding container aa73f66bc8fdcec55a50b329aeb55154af2d0f11df381edd922504c204ec7455: Status 404 returned error can't find the container with id aa73f66bc8fdcec55a50b329aeb55154af2d0f11df381edd922504c204ec7455
Jul 16 17:29:23.191265 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:23.191244    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc88e12e4_6808_4591_9fab_99e1f9d3c284.slice/crio-8bb7400804f2e1e98b6b9975a5054f2b64e9e9d0732b6c25bd197d06b68beca6 WatchSource:0}: Error finding container 8bb7400804f2e1e98b6b9975a5054f2b64e9e9d0732b6c25bd197d06b68beca6: Status 404 returned error can't find the container with id 8bb7400804f2e1e98b6b9975a5054f2b64e9e9d0732b6c25bd197d06b68beca6
Jul 16 17:29:23.209767 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.209743    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qs75j"
Jul 16 17:29:23.216171 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.216148    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k"
Jul 16 17:29:23.217529 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:23.217506    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ed6504_6c40_4552_b7f1_02fe4544b52b.slice/crio-5b32a6e060fa110199f753e3879a528f7f96101eb599955fe6382ed528a79015 WatchSource:0}: Error finding container 5b32a6e060fa110199f753e3879a528f7f96101eb599955fe6382ed528a79015: Status 404 returned error can't find the container with id 5b32a6e060fa110199f753e3879a528f7f96101eb599955fe6382ed528a79015
Jul 16 17:29:23.219689 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.219662    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7ztnp"
Jul 16 17:29:23.227374 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:23.227341    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda95f3d94_c001_46c0_98bd_230b10ccfab9.slice/crio-52c7f8f9c7edd037036cc002eb0ca89dfa9cdb2e66fbc85742d6c5b063a773f7 WatchSource:0}: Error finding container 52c7f8f9c7edd037036cc002eb0ca89dfa9cdb2e66fbc85742d6c5b063a773f7: Status 404 returned error can't find the container with id 52c7f8f9c7edd037036cc002eb0ca89dfa9cdb2e66fbc85742d6c5b063a773f7
Jul 16 17:29:23.227923 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:29:23.227901    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe11265_43f6_459e_aff1_bb0618552ec3.slice/crio-b68a941fffc68d76b4d494c303d786e93122990eeedaaca018a397afd4caff5f WatchSource:0}: Error finding container b68a941fffc68d76b4d494c303d786e93122990eeedaaca018a397afd4caff5f: Status 404 returned error can't find the container with id b68a941fffc68d76b4d494c303d786e93122990eeedaaca018a397afd4caff5f
Jul 16 17:29:23.291606 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.291578    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:29:23.366571 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.366495    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:29:23.493877 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.493825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:23.494084 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.493887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs\") pod \"network-metrics-daemon-m68mv\" (UID: \"5b310a15-65a4-4607-a273-ed5910798e1a\") " pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:23.494084 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:23.494063    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:23.494224 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:23.494152    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs podName:5b310a15-65a4-4607-a273-ed5910798e1a nodeName:}" failed. No retries permitted until 2026-07-16 17:29:24.494133111 +0000 UTC m=+3.049190545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs") pod "network-metrics-daemon-m68mv" (UID: "5b310a15-65a4-4607-a273-ed5910798e1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:23.494803 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:23.494566    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:23.494803 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:23.494612    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret podName:fe08b052-aad8-4578-a744-1fe793b72104 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:24.494598767 +0000 UTC m=+3.049656198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret") pod "global-pull-secret-syncer-c87pm" (UID: "fe08b052-aad8-4578-a744-1fe793b72104") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:23.595152 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.595110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bdz2\" (UniqueName: \"kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2\") pod \"network-check-target-7lq4t\" (UID: \"78a41699-1953-423f-89aa-efc3afe5fecc\") " pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:23.595338 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:23.595328    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:29:23.595396 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:23.595351    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:29:23.595396 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:23.595364    2580 projected.go:196] Error preparing data for projected volume kube-api-access-4bdz2 for pod openshift-network-diagnostics/network-check-target-7lq4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:23.595491 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:23.595426    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2 podName:78a41699-1953-423f-89aa-efc3afe5fecc nodeName:}" failed. No retries permitted until 2026-07-16 17:29:24.595406676 +0000 UTC m=+3.150464111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4bdz2" (UniqueName: "kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2") pod "network-check-target-7lq4t" (UID: "78a41699-1953-423f-89aa-efc3afe5fecc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:23.845554 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.845487    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:24:22 +0000 UTC" deadline="2028-03-11 06:31:03.3452315 +0000 UTC"
Jul 16 17:29:23.845554 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:23.845551    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14485h1m39.499684917s"
Jul 16 17:29:24.001583 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.001547    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p" event={"ID":"a062b146-a0ad-447c-a839-9f44cb8d4c42","Type":"ContainerStarted","Data":"c5fc8b0443ec5c0a2a641c11f6b6c1204eeac3da7ca0c6e256531cd32305c9ca"}
Jul 16 17:29:24.026080 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.024440    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ssthj" event={"ID":"6d988eda-40b2-4fbe-88e1-75a7b51aa3f5","Type":"ContainerStarted","Data":"5bc684a7b84478d36e607ca41fd21ce0d13da564ac16d1f461ee9d173f0cb0ae"}
Jul 16 17:29:24.042921 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.042799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qs75j" event={"ID":"79ed6504-6c40-4552-b7f1-02fe4544b52b","Type":"ContainerStarted","Data":"5b32a6e060fa110199f753e3879a528f7f96101eb599955fe6382ed528a79015"}
Jul 16 17:29:24.064487 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.064446    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2jnp" event={"ID":"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c","Type":"ContainerStarted","Data":"aa73f66bc8fdcec55a50b329aeb55154af2d0f11df381edd922504c204ec7455"}
Jul 16 17:29:24.086110 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.086066    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nmm97" event={"ID":"3c2da323-e68f-47d8-9f40-606c77ad9f39","Type":"ContainerStarted","Data":"c34a72dc0ff373cb685a2be4bf1cb687c65bbf5880e3e5357298bc26f967687b"}
Jul 16 17:29:24.089132 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.089106    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:29:24.106298 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.106108    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7ztnp" event={"ID":"2fe11265-43f6-459e-aff1-bb0618552ec3","Type":"ContainerStarted","Data":"b68a941fffc68d76b4d494c303d786e93122990eeedaaca018a397afd4caff5f"}
Jul 16 17:29:24.121359 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.121228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k" event={"ID":"a95f3d94-c001-46c0-98bd-230b10ccfab9","Type":"ContainerStarted","Data":"52c7f8f9c7edd037036cc002eb0ca89dfa9cdb2e66fbc85742d6c5b063a773f7"}
Jul 16 17:29:24.144808 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.144718    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fsvpp" event={"ID":"c88e12e4-6808-4591-9fab-99e1f9d3c284","Type":"ContainerStarted","Data":"8bb7400804f2e1e98b6b9975a5054f2b64e9e9d0732b6c25bd197d06b68beca6"}
Jul 16 17:29:24.167800 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.167761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ct2x7" event={"ID":"d5e39da5-fd84-4344-9e96-4403eab6cd5a","Type":"ContainerStarted","Data":"06b0f9d2a61ce763644e89530fa235993f4f4eae074e465a2b5a3b9e7913ec39"}
Jul 16 17:29:24.502438 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.502404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:24.502636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.502453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs\") pod \"network-metrics-daemon-m68mv\" (UID: \"5b310a15-65a4-4607-a273-ed5910798e1a\") " pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:24.502636 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:24.502615    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:24.502748 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:24.502680    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs podName:5b310a15-65a4-4607-a273-ed5910798e1a nodeName:}" failed. No retries permitted until 2026-07-16 17:29:26.502659921 +0000 UTC m=+5.057717354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs") pod "network-metrics-daemon-m68mv" (UID: "5b310a15-65a4-4607-a273-ed5910798e1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:24.502748 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:24.502741    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:24.502858 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:24.502829    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret podName:fe08b052-aad8-4578-a744-1fe793b72104 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:26.502814175 +0000 UTC m=+5.057871591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret") pod "global-pull-secret-syncer-c87pm" (UID: "fe08b052-aad8-4578-a744-1fe793b72104") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:24.603200 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.603150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bdz2\" (UniqueName: \"kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2\") pod \"network-check-target-7lq4t\" (UID: \"78a41699-1953-423f-89aa-efc3afe5fecc\") " pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:24.603390 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:24.603368    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:29:24.603390 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:24.603385    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:29:24.603503 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:24.603397    2580 projected.go:196] Error preparing data for projected volume kube-api-access-4bdz2 for pod openshift-network-diagnostics/network-check-target-7lq4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:24.603503 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:24.603454    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2 podName:78a41699-1953-423f-89aa-efc3afe5fecc nodeName:}" failed. No retries permitted until 2026-07-16 17:29:26.603435331 +0000 UTC m=+5.158492752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4bdz2" (UniqueName: "kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2") pod "network-check-target-7lq4t" (UID: "78a41699-1953-423f-89aa-efc3afe5fecc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:24.643237 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.643203    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:29:24.846167 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.846043    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:24:22 +0000 UTC" deadline="2027-12-24 02:49:48.415781438 +0000 UTC"
Jul 16 17:29:24.846167 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.846126    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12609h20m23.569661697s"
Jul 16 17:29:24.960511 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.960447    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:24.960695 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.960452    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:24.960695 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:24.960659    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:24.960822 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:24.960754    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:24.960822 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:24.960467    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:24.960918 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:24.960879    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:26.526760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:26.525968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:26.526760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:26.526023    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs\") pod \"network-metrics-daemon-m68mv\" (UID: \"5b310a15-65a4-4607-a273-ed5910798e1a\") " pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:26.526760 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:26.526162    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:26.526760 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:26.526222    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs podName:5b310a15-65a4-4607-a273-ed5910798e1a nodeName:}" failed. No retries permitted until 2026-07-16 17:29:30.526204013 +0000 UTC m=+9.081261431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs") pod "network-metrics-daemon-m68mv" (UID: "5b310a15-65a4-4607-a273-ed5910798e1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:26.526760 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:26.526635    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:26.526760 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:26.526681    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret podName:fe08b052-aad8-4578-a744-1fe793b72104 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:30.52666656 +0000 UTC m=+9.081723978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret") pod "global-pull-secret-syncer-c87pm" (UID: "fe08b052-aad8-4578-a744-1fe793b72104") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:26.628273 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:26.627339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bdz2\" (UniqueName: \"kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2\") pod \"network-check-target-7lq4t\" (UID: \"78a41699-1953-423f-89aa-efc3afe5fecc\") " pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:26.628273 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:26.627541    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:29:26.628273 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:26.627563    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:29:26.628273 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:26.627574    2580 projected.go:196] Error preparing data for projected volume kube-api-access-4bdz2 for pod openshift-network-diagnostics/network-check-target-7lq4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:26.628273 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:26.627629    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2 podName:78a41699-1953-423f-89aa-efc3afe5fecc nodeName:}" failed. No retries permitted until 2026-07-16 17:29:30.627610611 +0000 UTC m=+9.182668027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4bdz2" (UniqueName: "kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2") pod "network-check-target-7lq4t" (UID: "78a41699-1953-423f-89aa-efc3afe5fecc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:26.960268 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:26.960236    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:26.960441 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:26.960283    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:26.960441 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:26.960380    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:26.960545 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:26.960494    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:26.960545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:26.960540    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:26.960663 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:26.960606    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:28.960958 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:28.960398    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:28.960958 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:28.960548    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:28.960958 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:28.960888    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:28.961558 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:28.961000    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:28.961558 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:28.961074    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:28.961558 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:28.961143    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:30.563847 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:30.563805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:30.564337 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:30.563858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs\") pod \"network-metrics-daemon-m68mv\" (UID: \"5b310a15-65a4-4607-a273-ed5910798e1a\") " pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:30.564337 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:30.563976    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:30.564337 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:30.564009    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:30.564337 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:30.564071    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret podName:fe08b052-aad8-4578-a744-1fe793b72104 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:38.564050055 +0000 UTC m=+17.119107484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret") pod "global-pull-secret-syncer-c87pm" (UID: "fe08b052-aad8-4578-a744-1fe793b72104") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:30.564337 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:30.564093    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs podName:5b310a15-65a4-4607-a273-ed5910798e1a nodeName:}" failed. No retries permitted until 2026-07-16 17:29:38.564083465 +0000 UTC m=+17.119140881 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs") pod "network-metrics-daemon-m68mv" (UID: "5b310a15-65a4-4607-a273-ed5910798e1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:30.664719 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:30.664618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bdz2\" (UniqueName: \"kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2\") pod \"network-check-target-7lq4t\" (UID: \"78a41699-1953-423f-89aa-efc3afe5fecc\") " pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:30.664894 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:30.664825    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:29:30.664894 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:30.664853    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:29:30.664894 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:30.664866    2580 projected.go:196] Error preparing data for projected volume kube-api-access-4bdz2 for pod openshift-network-diagnostics/network-check-target-7lq4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:30.665078 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:30.664925    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2 podName:78a41699-1953-423f-89aa-efc3afe5fecc nodeName:}" failed. No retries permitted until 2026-07-16 17:29:38.66490349 +0000 UTC m=+17.219960909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4bdz2" (UniqueName: "kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2") pod "network-check-target-7lq4t" (UID: "78a41699-1953-423f-89aa-efc3afe5fecc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:30.959960 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:30.959923    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:30.960139 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:30.960084    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:30.960139 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:30.959940    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:30.960273 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:30.960206    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:30.960273 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:30.959940    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:30.960381 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:30.960283    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:32.959938 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:32.959891    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:32.959938 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:32.959933    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:32.960461 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:32.959891    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:32.960461 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:32.960016    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:32.960461 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:32.960145    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:32.960461 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:32.960251    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:34.960372 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:34.960342    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:34.960770 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:34.960390    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:34.960770 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:34.960390    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:34.960770 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:34.960486    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:34.960770 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:34.960583    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:34.960943 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:34.960763    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:36.959817 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:36.959778    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:36.960310 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:36.959782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:36.960310 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:36.959916    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:36.960310 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:36.959782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:36.960310 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:36.959994    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:36.960310 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:36.960088    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:38.627811 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:38.627773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:38.627811 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:38.627815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs\") pod \"network-metrics-daemon-m68mv\" (UID: \"5b310a15-65a4-4607-a273-ed5910798e1a\") " pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:38.628247 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:38.627915    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:38.628247 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:38.627918    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:38.628247 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:38.627966    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs podName:5b310a15-65a4-4607-a273-ed5910798e1a nodeName:}" failed. No retries permitted until 2026-07-16 17:29:54.627952078 +0000 UTC m=+33.183009493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs") pod "network-metrics-daemon-m68mv" (UID: "5b310a15-65a4-4607-a273-ed5910798e1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:38.628247 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:38.627978    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret podName:fe08b052-aad8-4578-a744-1fe793b72104 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:54.627972584 +0000 UTC m=+33.183029999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret") pod "global-pull-secret-syncer-c87pm" (UID: "fe08b052-aad8-4578-a744-1fe793b72104") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:38.728297 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:38.728261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bdz2\" (UniqueName: \"kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2\") pod \"network-check-target-7lq4t\" (UID: \"78a41699-1953-423f-89aa-efc3afe5fecc\") " pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:38.728452 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:38.728430    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:29:38.728490 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:38.728455    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:29:38.728490 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:38.728469    2580 projected.go:196] Error preparing data for projected volume kube-api-access-4bdz2 for pod openshift-network-diagnostics/network-check-target-7lq4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:38.728550 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:38.728520    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2 podName:78a41699-1953-423f-89aa-efc3afe5fecc nodeName:}" failed. No retries permitted until 2026-07-16 17:29:54.728506831 +0000 UTC m=+33.283564247 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4bdz2" (UniqueName: "kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2") pod "network-check-target-7lq4t" (UID: "78a41699-1953-423f-89aa-efc3afe5fecc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:38.960238 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:38.960212    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:38.960504 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:38.960322    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:38.960504 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:38.960328    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:38.960504 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:38.960330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:38.960637 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:38.960452    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:38.960637 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:38.960549    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:40.960765 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:40.960727    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:40.960765 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:40.960768    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:40.961255 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:40.960739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:40.961255 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:40.960872    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:40.961255 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:40.960950    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:40.961255 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:40.961019    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:42.959756 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:42.959720    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:42.960127 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:42.959726    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:42.960127 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:42.959831    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:42.960127 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:42.959734    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:42.960127 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:42.959894    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:42.960127 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:42.959967    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:44.213588 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.213215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nmm97" event={"ID":"3c2da323-e68f-47d8-9f40-606c77ad9f39","Type":"ContainerStarted","Data":"946c6ffd70c181945f2f509af48cd070578d6a4c9a91c315072a82ac613c9d58"}
Jul 16 17:29:44.214758 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.214729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7ztnp" event={"ID":"2fe11265-43f6-459e-aff1-bb0618552ec3","Type":"ContainerStarted","Data":"2b4918ca33ae30d738bb03334d580484e28caab013adc5c063e72ff865c78699"}
Jul 16 17:29:44.216057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.216022    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k" event={"ID":"a95f3d94-c001-46c0-98bd-230b10ccfab9","Type":"ContainerStarted","Data":"c5753b14ee8d19d854ff9c3ebca21374367536b4021bf4a294183fd3de259839"}
Jul 16 17:29:44.217399 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.217383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fsvpp" event={"ID":"c88e12e4-6808-4591-9fab-99e1f9d3c284","Type":"ContainerStarted","Data":"ca9efe895b22e38f2c2c91050e918fa086269641e8a89295a00abb7a5f9f6c7d"}
Jul 16 17:29:44.218733 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.218712    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ct2x7" event={"ID":"d5e39da5-fd84-4344-9e96-4403eab6cd5a","Type":"ContainerStarted","Data":"54cc07f1f62730587ff80dc2c3a0de529d567ce8e7f7bcf95806b07f0ab977ad"}
Jul 16 17:29:44.221109 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.221092    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:29:44.221396 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.221380    2580 generic.go:356] "Generic (PLEG): container finished" podID="a062b146-a0ad-447c-a839-9f44cb8d4c42" containerID="0a435b08a80f499e15ce84eb578ed4a710a60020851526036e681818e10b4aec" exitCode=1
Jul 16 17:29:44.221465 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.221435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p" event={"ID":"a062b146-a0ad-447c-a839-9f44cb8d4c42","Type":"ContainerStarted","Data":"eba70e51fb2982376b8f775443f97cb4bbb379ef7c66dbee592e7dbeec31ef48"}
Jul 16 17:29:44.221506 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.221488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p" event={"ID":"a062b146-a0ad-447c-a839-9f44cb8d4c42","Type":"ContainerStarted","Data":"cb23ededf84539630af5de820e59346e94db86a8e3fbb1026b1f756d75d4fed9"}
Jul 16 17:29:44.221545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.221526    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p" event={"ID":"a062b146-a0ad-447c-a839-9f44cb8d4c42","Type":"ContainerStarted","Data":"496a026c5294ede499721a03fbacee10f8f0924945bc5f44a56c73baaa8e45a2"}
Jul 16 17:29:44.221582 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.221570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p" event={"ID":"a062b146-a0ad-447c-a839-9f44cb8d4c42","Type":"ContainerStarted","Data":"45d5c303e79ade9cb7b132f7947ed0a8259bc2ea728b21297b7b670901a68879"}
Jul 16 17:29:44.221633 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.221602    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p" event={"ID":"a062b146-a0ad-447c-a839-9f44cb8d4c42","Type":"ContainerDied","Data":"0a435b08a80f499e15ce84eb578ed4a710a60020851526036e681818e10b4aec"}
Jul 16 17:29:44.221682 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.221646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p" event={"ID":"a062b146-a0ad-447c-a839-9f44cb8d4c42","Type":"ContainerStarted","Data":"1e29f43ee6c9603647a8f7d7e2b3670ed5770a2e072ed0343fe8e7b6d9449960"}
Jul 16 17:29:44.222652 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.222635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ssthj" event={"ID":"6d988eda-40b2-4fbe-88e1-75a7b51aa3f5","Type":"ContainerStarted","Data":"3951883e737cb77b5c6b099069c0d960cf8651f7dd6858f10dc19ed982d2c917"}
Jul 16 17:29:44.223913 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.223894    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-51.ec2.internal" event={"ID":"cd686faea4db8ace4f851a7d64c4f3c7","Type":"ContainerStarted","Data":"a87abb9b8a95d948c1d76400f2c4ec9bb774aee54024e0d5d18e2916711f7dcb"}
Jul 16 17:29:44.225228 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.225209    2580 generic.go:356] "Generic (PLEG): container finished" podID="a92c4ce52ed7765e7ae333a1d470a752" containerID="e8b6defdd45a636cf5b1790da622632d1b202631f42e8cbe549f46c492464ae7" exitCode=0
Jul 16 17:29:44.225303 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.225270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal" event={"ID":"a92c4ce52ed7765e7ae333a1d470a752","Type":"ContainerDied","Data":"e8b6defdd45a636cf5b1790da622632d1b202631f42e8cbe549f46c492464ae7"}
Jul 16 17:29:44.226666 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.226647    2580 generic.go:356] "Generic (PLEG): container finished" podID="e88c6874-4c5b-4eb2-b48f-bacbec4ce47c" containerID="bed32e5096c76bf6f9bff0e838eca04fe8b6b7c0e2e845f1b2b0fd94f08aec11" exitCode=0
Jul 16 17:29:44.226740 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.226674    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2jnp" event={"ID":"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c","Type":"ContainerDied","Data":"bed32e5096c76bf6f9bff0e838eca04fe8b6b7c0e2e845f1b2b0fd94f08aec11"}
Jul 16 17:29:44.234710 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.234670    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nmm97" podStartSLOduration=3.294699677 podStartE2EDuration="23.234654292s" totalImagesPullingTime="19.939954615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:29:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:44.234175828 +0000 UTC m=+22.789233265" watchObservedRunningTime="2026-07-16 17:29:44.234654292 +0000 UTC m=+22.789711732"
Jul 16 17:29:44.259058 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.258877    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7ztnp" podStartSLOduration=2.414949968 podStartE2EDuration="22.258857682s" totalImagesPullingTime="19.843907714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:44.258287899 +0000 UTC m=+22.813345336" watchObservedRunningTime="2026-07-16 17:29:44.258857682 +0000 UTC m=+22.813915120"
Jul 16 17:29:44.316359 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.316304    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ssthj" podStartSLOduration=3.35524085 podStartE2EDuration="23.316283323s" totalImagesPullingTime="19.961042473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:29:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:44.312283202 +0000 UTC m=+22.867340638" watchObservedRunningTime="2026-07-16 17:29:44.316283323 +0000 UTC m=+22.871340761"
Jul 16 17:29:44.370522 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.370256    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ct2x7" podStartSLOduration=2.497597739 podStartE2EDuration="22.370240638s" totalImagesPullingTime="19.872642899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:44.338981908 +0000 UTC m=+22.894039392" watchObservedRunningTime="2026-07-16 17:29:44.370240638 +0000 UTC m=+22.925298142"
Jul 16 17:29:44.390709 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.390627    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fsvpp" podStartSLOduration=1.9786677780000002 podStartE2EDuration="22.390610877s" totalImagesPullingTime="20.411943099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:44.390534415 +0000 UTC m=+22.945591851" watchObservedRunningTime="2026-07-16 17:29:44.390610877 +0000 UTC m=+22.945668314"
Jul 16 17:29:44.411823 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.411777    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-51.ec2.internal" podStartSLOduration=22.411759263 podStartE2EDuration="22.411759263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:29:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:44.411366478 +0000 UTC m=+22.966423916" watchObservedRunningTime="2026-07-16 17:29:44.411759263 +0000 UTC m=+22.966816708"
Jul 16 17:29:44.421160 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.421129    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:44.498199 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.498155    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:44.602177 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.602141    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:44.700884 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.700855    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:44.959995 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.959970    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:44.960231 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.960080    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:44.960231 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:44.960101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:44.960231 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:44.960183    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:44.960231 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:44.960083    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:44.960374 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:44.960275    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:45.132548 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:45.132523    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 17:29:45.230938 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:45.230853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal" event={"ID":"a92c4ce52ed7765e7ae333a1d470a752","Type":"ContainerStarted","Data":"97489e3c5e0e44f80dea9e11ef873ed5c5042fa96659132ca53e51d3ffe42ad5"}
Jul 16 17:29:45.232433 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:45.232406    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qs75j" event={"ID":"79ed6504-6c40-4552-b7f1-02fe4544b52b","Type":"ContainerStarted","Data":"67b0a890ce007534429ec43aeaa1b0ae90133a7bc024ac8fb7d0b052f613b40b"}
Jul 16 17:29:45.234095 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:45.234069    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k" event={"ID":"a95f3d94-c001-46c0-98bd-230b10ccfab9","Type":"ContainerStarted","Data":"70be682c32502024b60d588b66ecc7048b4786f424a80aef50d7f282cd311566"}
Jul 16 17:29:45.268165 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:45.268123    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-51.ec2.internal" podStartSLOduration=23.268109759 podStartE2EDuration="23.268109759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:29:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:45.267966951 +0000 UTC m=+23.823024388" watchObservedRunningTime="2026-07-16 17:29:45.268109759 +0000 UTC m=+23.823167195"
Jul 16 17:29:45.307474 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:45.307420    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qs75j" podStartSLOduration=3.455846773 podStartE2EDuration="23.307405024s" totalImagesPullingTime="19.851558251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:45.307257688 +0000 UTC m=+23.862315149" watchObservedRunningTime="2026-07-16 17:29:45.307405024 +0000 UTC m=+23.862462461"
Jul 16 17:29:45.481961 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:45.481877    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:45.577197 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:45.577162    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:45.843966 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:45.843824    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T17:29:45.132538468Z","UUID":"a5233f68-04e4-4475-a33a-c1b96c00c0a9","Handler":null,"Name":"","Endpoint":""}
Jul 16 17:29:45.845652 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:45.845627    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 17:29:45.845789 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:45.845672    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 17:29:46.086402 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:46.086365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:46.202240 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:46.202210    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:46.240093 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:46.240069    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:29:46.240509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:46.240464    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p" event={"ID":"a062b146-a0ad-447c-a839-9f44cb8d4c42","Type":"ContainerStarted","Data":"89d37b629063a9d688ac507caa30ea5b9667079d6c7357f2251d21f16dd066b8"}
Jul 16 17:29:46.329616 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:46.329550    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:46.514103 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:46.514027    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:46.615941 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:46.615850    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:46.960030 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:46.959996    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:46.960030 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:46.960030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:46.960283 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:46.960030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:46.960283 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:46.960132    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:46.960283 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:46.960215    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:46.960444 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:46.960292    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:47.244666 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:47.244577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k" event={"ID":"a95f3d94-c001-46c0-98bd-230b10ccfab9","Type":"ContainerStarted","Data":"8767d6a5db994821fd3155fe3df8cb8986d9f791f1b75d22f6b1168d72d8b5b3"}
Jul 16 17:29:47.247509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:47.247475    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:47.347271 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:47.347228    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:47.708850 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:47.708813    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:47.807500 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:47.807460    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:48.297760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:48.297602    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ssthj_6d988eda-40b2-4fbe-88e1-75a7b51aa3f5/dns-node-resolver/0.log"
Jul 16 17:29:48.434545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:48.434506    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:48.528503 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:48.528418    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:48.613597 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:48.613568    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ct2x7"
Jul 16 17:29:48.614304 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:48.614284    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ct2x7"
Jul 16 17:29:48.633528 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:48.633475    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmb8k" podStartSLOduration=4.453459571 podStartE2EDuration="26.633452527s" totalImagesPullingTime="22.179992956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:29:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:47.273117586 +0000 UTC m=+25.828175026" watchObservedRunningTime="2026-07-16 17:29:48.633452527 +0000 UTC m=+27.188509947"
Jul 16 17:29:48.960394 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:48.960355    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:48.960570 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:48.960400    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:48.960570 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:48.960400    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:48.960570 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:48.960482    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:48.960736 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:48.960620    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:48.960736 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:48.960693    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:49.095624 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:49.095593    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nmm97_3c2da323-e68f-47d8-9f40-606c77ad9f39/node-ca/0.log"
Jul 16 17:29:49.249417 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:49.249331    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ct2x7"
Jul 16 17:29:49.249840 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:49.249819    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ct2x7"
Jul 16 17:29:49.345076 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:49.345025    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:50.089308 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.089248    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:50.199772 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.199573    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:50.252716 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.252689    2580 generic.go:356] "Generic (PLEG): container finished" podID="e88c6874-4c5b-4eb2-b48f-bacbec4ce47c" containerID="c47f12700ceaa60d510b12c60a3c8a3baa74032aab90ccae834941e40b9d95ac" exitCode=0
Jul 16 17:29:50.252826 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.252731    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2jnp" event={"ID":"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c","Type":"ContainerDied","Data":"c47f12700ceaa60d510b12c60a3c8a3baa74032aab90ccae834941e40b9d95ac"}
Jul 16 17:29:50.256168 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.256155    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:29:50.256546 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.256527    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p" event={"ID":"a062b146-a0ad-447c-a839-9f44cb8d4c42","Type":"ContainerStarted","Data":"3f23f0f513070ca10a728e30c3d647910a95dfe35428e2f00a17d3212d4fa453"}
Jul 16 17:29:50.256815 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.256780    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:50.256929 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.256850    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:50.256929 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.256912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:50.257029 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.256942    2580 scope.go:117] "RemoveContainer" containerID="0a435b08a80f499e15ce84eb578ed4a710a60020851526036e681818e10b4aec"
Jul 16 17:29:50.271985 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.271962    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:50.272562 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.272546    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:29:50.960357 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.960328    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:50.961064 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.960328    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:50.961064 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:50.960436    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:50.961064 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:50.960328    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:50.961064 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:50.960503    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:50.961064 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:50.960555    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:51.262791 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:51.262703    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:29:51.263128 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:51.263104    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p" event={"ID":"a062b146-a0ad-447c-a839-9f44cb8d4c42","Type":"ContainerStarted","Data":"586618c4b8d772ff205024b50f800aae7d1e8c022d265adb30aa96dc4fb3d037"}
Jul 16 17:29:51.300092 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:51.300059    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:51.307250 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:51.307201    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p" podStartSLOduration=9.118450413 podStartE2EDuration="29.307187411s" totalImagesPullingTime="20.188736998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:51.305822535 +0000 UTC m=+29.860879972" watchObservedRunningTime="2026-07-16 17:29:51.307187411 +0000 UTC m=+29.862244847"
Jul 16 17:29:52.167559 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:52.167530    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7lq4t"]
Jul 16 17:29:52.167998 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:52.167628    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:52.167998 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:52.167720    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:52.169882 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:52.169856    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m68mv"]
Jul 16 17:29:52.170008 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:52.169957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:52.170092 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:52.170062    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:52.182816 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:52.182782    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c87pm"]
Jul 16 17:29:52.182942 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:52.182869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:52.182990 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:52.182946    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:53.403190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:53.403160    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:53.960345 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:53.960167    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:53.960524 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:53.960173    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:53.960524 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:53.960419    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:53.960524 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:53.960173    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:53.960683 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:53.960483    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:53.960683 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:53.960554    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:54.271481 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:54.271451    2580 generic.go:356] "Generic (PLEG): container finished" podID="e88c6874-4c5b-4eb2-b48f-bacbec4ce47c" containerID="c3ee64fa473620a2aee5d6bfae428466cd43db3f608b952251923a8cbe65680d" exitCode=0
Jul 16 17:29:54.271655 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:54.271512    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2jnp" event={"ID":"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c","Type":"ContainerDied","Data":"c3ee64fa473620a2aee5d6bfae428466cd43db3f608b952251923a8cbe65680d"}
Jul 16 17:29:54.644128 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:54.644092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs\") pod \"network-metrics-daemon-m68mv\" (UID: \"5b310a15-65a4-4607-a273-ed5910798e1a\") " pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:54.644551 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:54.644160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:54.644551 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:54.644236    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:54.644551 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:54.644257    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:54.644551 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:54.644298    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs podName:5b310a15-65a4-4607-a273-ed5910798e1a nodeName:}" failed. No retries permitted until 2026-07-16 17:30:26.644282105 +0000 UTC m=+65.199339524 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs") pod "network-metrics-daemon-m68mv" (UID: "5b310a15-65a4-4607-a273-ed5910798e1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:54.644551 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:54.644313    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret podName:fe08b052-aad8-4578-a744-1fe793b72104 nodeName:}" failed. No retries permitted until 2026-07-16 17:30:26.644306624 +0000 UTC m=+65.199364039 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret") pod "global-pull-secret-syncer-c87pm" (UID: "fe08b052-aad8-4578-a744-1fe793b72104") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:54.745022 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:54.744984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bdz2\" (UniqueName: \"kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2\") pod \"network-check-target-7lq4t\" (UID: \"78a41699-1953-423f-89aa-efc3afe5fecc\") " pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:54.745220 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:54.745163    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:29:54.745220 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:54.745182    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:29:54.745220 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:54.745192    2580 projected.go:196] Error preparing data for projected volume kube-api-access-4bdz2 for pod openshift-network-diagnostics/network-check-target-7lq4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:54.745322 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:54.745254    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2 podName:78a41699-1953-423f-89aa-efc3afe5fecc nodeName:}" failed. No retries permitted until 2026-07-16 17:30:26.745238991 +0000 UTC m=+65.300296406 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4bdz2" (UniqueName: "kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2") pod "network-check-target-7lq4t" (UID: "78a41699-1953-423f-89aa-efc3afe5fecc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:55.960808 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:55.960783    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:55.961293 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:55.960904    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:55.961293 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:55.960792    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:55.961293 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:55.960787    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:55.961293 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:55.960989    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:55.961293 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:55.961073    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:56.239783 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:56.239750    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:56.277707 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:56.277675    2580 generic.go:356] "Generic (PLEG): container finished" podID="e88c6874-4c5b-4eb2-b48f-bacbec4ce47c" containerID="b68b8af41962179b16b897befb694be90666ac8e998418b43f1c986528e90276" exitCode=0
Jul 16 17:29:56.277915 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:56.277730    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2jnp" event={"ID":"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c","Type":"ContainerDied","Data":"b68b8af41962179b16b897befb694be90666ac8e998418b43f1c986528e90276"}
Jul 16 17:29:56.455000 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:56.454968    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:56.667340 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:56.667240    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:57.061946 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:57.061902    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:57.251543 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:57.251511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:57.638210 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:57.638170    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:57.842858 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:57.842816    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:57.960307 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:57.960278    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:57.960486 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:57.960285    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:57.960486 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:57.960410    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:57.960486 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:57.960294    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:57.960647 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:57.960501    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:57.960647 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:57.960554    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:58.440785 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:58.440692    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:58.661637 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:58.661600    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:58.924873 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:58.924841    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:59.090455 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:59.090417    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:59.272709 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:59.272672    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:59.373400 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:59.373362    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:59.471330 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:59.471288    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:59.856479 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:59.856429    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:59.960776 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:59.960746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:29:59.960776 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:59.960774    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:29:59.961020 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:59.960746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:29:59.961020 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:59.960886    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:29:59.961154 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:59.961068    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:29:59.961154 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:29:59.961138    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:29:59.975894 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:29:59.975855    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:00.442445 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:00.442418    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:00.647562 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:00.647474    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:00.820479 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:00.820444    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:00.897111 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:00.897079    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:01.260089 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:01.260059    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:01.292071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:01.292018    2580 generic.go:356] "Generic (PLEG): container finished" podID="e88c6874-4c5b-4eb2-b48f-bacbec4ce47c" containerID="40c0a3c8f26c0af692a83d46f82b6576e934cb37183a0617bfeb62bc70b579bd" exitCode=0
Jul 16 17:30:01.292071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:01.292069    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2jnp" event={"ID":"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c","Type":"ContainerDied","Data":"40c0a3c8f26c0af692a83d46f82b6576e934cb37183a0617bfeb62bc70b579bd"}
Jul 16 17:30:01.520419 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:01.520342    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:01.835694 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:01.835574    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:01.963632 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:01.963598    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:30:01.963795 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:01.963632    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:30:01.963795 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:01.963598    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:30:01.963795 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:01.963718    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:30:01.963795 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:01.963768    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:30:01.963925 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:01.963837    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:30:02.253432 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:02.253381    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:02.297505 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:02.297466    2580 generic.go:356] "Generic (PLEG): container finished" podID="e88c6874-4c5b-4eb2-b48f-bacbec4ce47c" containerID="558ef9ae8fd52ed4a5c41337557d9cca302c994ad6f428b34a7ee3ee3b3fc1bc" exitCode=0
Jul 16 17:30:02.297663 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:02.297512    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2jnp" event={"ID":"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c","Type":"ContainerDied","Data":"558ef9ae8fd52ed4a5c41337557d9cca302c994ad6f428b34a7ee3ee3b3fc1bc"}
Jul 16 17:30:02.335374 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:02.335339    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:02.650557 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:02.650463    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:02.847030 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:02.846981    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:03.249546 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:03.249513    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:03.303442 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:03.303406    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2jnp" event={"ID":"e88c6874-4c5b-4eb2-b48f-bacbec4ce47c","Type":"ContainerStarted","Data":"783484d72926ddb0f7697c117f6b1c7944233a10dfb12c425b0d9c1bc5c9a53f"}
Jul 16 17:30:03.347165 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:03.347120    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p2jnp" podStartSLOduration=6.966038739 podStartE2EDuration="41.347104242s" totalImagesPullingTime="34.381065503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:29:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:03.346110302 +0000 UTC m=+41.901167739" watchObservedRunningTime="2026-07-16 17:30:03.347104242 +0000 UTC m=+41.902161678"
Jul 16 17:30:03.634779 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:03.634676    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:03.965679 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:03.965653    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:30:03.966084 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:03.965653    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:30:03.966084 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:03.965759    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:30:03.966084 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:03.965653    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:30:03.966084 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:03.965823    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:30:03.966084 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:03.965890    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:30:04.282577 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:04.282470    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:04.701865 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:04.701775    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:05.080500 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:05.080465    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:05.461940 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:05.461912    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:05.696817 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:05.696785    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:05.959806 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:05.959780    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:30:05.960071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:05.959816    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:30:05.960315 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:05.960087    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:30:05.960315 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:05.959828    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:30:05.960315 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:05.960152    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:30:05.960315 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:05.960263    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:30:05.960558 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:05.960426    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:06.192961 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:06.192925    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:06.365596 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:06.365517    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:06.504619 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:06.504586    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:06.633712 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:06.633629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:06.759160 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:06.759131    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:06.859568 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:06.859541    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:07.226592 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:07.226563    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:07.960148 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:07.960114    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:30:07.960340 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:07.960114    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:30:07.960340 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:07.960236    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:30:07.960340 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:07.960287    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:30:07.960340 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:07.960304    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:30:07.960557 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:07.960373    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:30:08.016305 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:08.013893    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:08.222626 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:08.222547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:08.912001 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:08.911954    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:09.960096 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:09.960064    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:30:09.960096 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:09.960097    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:30:09.960612 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:09.960072    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:30:09.960612 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:09.960191    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m68mv" podUID="5b310a15-65a4-4607-a273-ed5910798e1a"
Jul 16 17:30:09.960612 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:09.960279    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lq4t" podUID="78a41699-1953-423f-89aa-efc3afe5fecc"
Jul 16 17:30:09.960612 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:09.960373    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c87pm" podUID="fe08b052-aad8-4578-a744-1fe793b72104"
Jul 16 17:30:11.086002 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.085971    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:11.271102 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.271013    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-51.ec2.internal" event="NodeReady"
Jul 16 17:30:11.271247 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.271152    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 17:30:11.345078 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.345044    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zbhdt"]
Jul 16 17:30:11.366307 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.366283    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gpqtb"]
Jul 16 17:30:11.366451 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.366412    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zbhdt"
Jul 16 17:30:11.369959 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.369914    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 17:30:11.370244 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.370227    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4zxvh\""
Jul 16 17:30:11.370378 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.370361    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 17:30:11.371100 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.371083    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 17:30:11.382457 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.382430    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zbhdt"]
Jul 16 17:30:11.382581 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.382470    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gpqtb"]
Jul 16 17:30:11.382581 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.382491    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.385187 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.385165    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 17:30:11.385339 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.385320    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-27n67\""
Jul 16 17:30:11.385385 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.385359    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 17:30:11.441937 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.441900    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4wmm7"]
Jul 16 17:30:11.465380 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.465351    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4wmm7"]
Jul 16 17:30:11.465531 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.465452    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.466101 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.466073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3b34739-58e1-4762-b3ed-794390a3eba5-cert\") pod \"ingress-canary-zbhdt\" (UID: \"f3b34739-58e1-4762-b3ed-794390a3eba5\") " pod="openshift-ingress-canary/ingress-canary-zbhdt"
Jul 16 17:30:11.466220 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.466120    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxnvb\" (UniqueName: \"kubernetes.io/projected/f3b34739-58e1-4762-b3ed-794390a3eba5-kube-api-access-sxnvb\") pod \"ingress-canary-zbhdt\" (UID: \"f3b34739-58e1-4762-b3ed-794390a3eba5\") " pod="openshift-ingress-canary/ingress-canary-zbhdt"
Jul 16 17:30:11.468043 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.468012    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9mkk5\""
Jul 16 17:30:11.468152 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.468101    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 17:30:11.468242 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.468228    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 17:30:11.468413 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.468398    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 17:30:11.468484 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.468423    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 17:30:11.566680 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.566589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.566680 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.566631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3743d9af-ba0c-486a-bde9-99913d98760a-config-volume\") pod \"dns-default-gpqtb\" (UID: \"3743d9af-ba0c-486a-bde9-99913d98760a\") " pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.566680 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.566664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxnvb\" (UniqueName: \"kubernetes.io/projected/f3b34739-58e1-4762-b3ed-794390a3eba5-kube-api-access-sxnvb\") pod \"ingress-canary-zbhdt\" (UID: \"f3b34739-58e1-4762-b3ed-794390a3eba5\") " pod="openshift-ingress-canary/ingress-canary-zbhdt"
Jul 16 17:30:11.566968 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.566689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3743d9af-ba0c-486a-bde9-99913d98760a-metrics-tls\") pod \"dns-default-gpqtb\" (UID: \"3743d9af-ba0c-486a-bde9-99913d98760a\") " pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.566968 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.566713    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.566968 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.566738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22xzt\" (UniqueName: \"kubernetes.io/projected/3743d9af-ba0c-486a-bde9-99913d98760a-kube-api-access-22xzt\") pod \"dns-default-gpqtb\" (UID: \"3743d9af-ba0c-486a-bde9-99913d98760a\") " pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.566968 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.566828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3743d9af-ba0c-486a-bde9-99913d98760a-tmp-dir\") pod \"dns-default-gpqtb\" (UID: \"3743d9af-ba0c-486a-bde9-99913d98760a\") " pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.566968 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.566865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-data-volume\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.566968 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.566898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3b34739-58e1-4762-b3ed-794390a3eba5-cert\") pod \"ingress-canary-zbhdt\" (UID: \"f3b34739-58e1-4762-b3ed-794390a3eba5\") " pod="openshift-ingress-canary/ingress-canary-zbhdt"
Jul 16 17:30:11.566968 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.566924    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-crio-socket\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.566968 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.566956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5knhd\" (UniqueName: \"kubernetes.io/projected/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-kube-api-access-5knhd\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.571057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.571010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3b34739-58e1-4762-b3ed-794390a3eba5-cert\") pod \"ingress-canary-zbhdt\" (UID: \"f3b34739-58e1-4762-b3ed-794390a3eba5\") " pod="openshift-ingress-canary/ingress-canary-zbhdt"
Jul 16 17:30:11.572684 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.572655    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:11.577580 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.577558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxnvb\" (UniqueName: \"kubernetes.io/projected/f3b34739-58e1-4762-b3ed-794390a3eba5-kube-api-access-sxnvb\") pod \"ingress-canary-zbhdt\" (UID: \"f3b34739-58e1-4762-b3ed-794390a3eba5\") " pod="openshift-ingress-canary/ingress-canary-zbhdt"
Jul 16 17:30:11.668050 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3743d9af-ba0c-486a-bde9-99913d98760a-config-volume\") pod \"dns-default-gpqtb\" (UID: \"3743d9af-ba0c-486a-bde9-99913d98760a\") " pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.668238 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3743d9af-ba0c-486a-bde9-99913d98760a-metrics-tls\") pod \"dns-default-gpqtb\" (UID: \"3743d9af-ba0c-486a-bde9-99913d98760a\") " pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.668238 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.668238 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22xzt\" (UniqueName: \"kubernetes.io/projected/3743d9af-ba0c-486a-bde9-99913d98760a-kube-api-access-22xzt\") pod \"dns-default-gpqtb\" (UID: \"3743d9af-ba0c-486a-bde9-99913d98760a\") " pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.668238 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3743d9af-ba0c-486a-bde9-99913d98760a-tmp-dir\") pod \"dns-default-gpqtb\" (UID: \"3743d9af-ba0c-486a-bde9-99913d98760a\") " pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.668238 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-data-volume\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.668238 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-crio-socket\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.668238 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668207    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5knhd\" (UniqueName: \"kubernetes.io/projected/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-kube-api-access-5knhd\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.668573 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-crio-socket\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.668573 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.668573 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3743d9af-ba0c-486a-bde9-99913d98760a-tmp-dir\") pod \"dns-default-gpqtb\" (UID: \"3743d9af-ba0c-486a-bde9-99913d98760a\") " pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.668689 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668597    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-data-volume\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.668725 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668712    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3743d9af-ba0c-486a-bde9-99913d98760a-config-volume\") pod \"dns-default-gpqtb\" (UID: \"3743d9af-ba0c-486a-bde9-99913d98760a\") " pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.668805 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.668781    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.670637 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.670617    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3743d9af-ba0c-486a-bde9-99913d98760a-metrics-tls\") pod \"dns-default-gpqtb\" (UID: \"3743d9af-ba0c-486a-bde9-99913d98760a\") " pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.670761 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.670742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.674792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.674740    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:11.674792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.674775    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zbhdt"
Jul 16 17:30:11.677917 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.677891    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5knhd\" (UniqueName: \"kubernetes.io/projected/134df64e-da7d-4ca5-90f6-d1bd61d5b70c-kube-api-access-5knhd\") pod \"insights-runtime-extractor-4wmm7\" (UID: \"134df64e-da7d-4ca5-90f6-d1bd61d5b70c\") " pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.677917 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.677916    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22xzt\" (UniqueName: \"kubernetes.io/projected/3743d9af-ba0c-486a-bde9-99913d98760a-kube-api-access-22xzt\") pod \"dns-default-gpqtb\" (UID: \"3743d9af-ba0c-486a-bde9-99913d98760a\") " pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.690717 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.690700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:11.773955 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.773716    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4wmm7"
Jul 16 17:30:11.855420 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.855395    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gpqtb"]
Jul 16 17:30:11.859411 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:11.859381    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3743d9af_ba0c_486a_bde9_99913d98760a.slice/crio-a8595980474c71d4eceb85f38f94374000acbba749b3f197c23b059c112369a7 WatchSource:0}: Error finding container a8595980474c71d4eceb85f38f94374000acbba749b3f197c23b059c112369a7: Status 404 returned error can't find the container with id a8595980474c71d4eceb85f38f94374000acbba749b3f197c23b059c112369a7
Jul 16 17:30:11.874891 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.874863    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zbhdt"]
Jul 16 17:30:11.877678 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:11.877643    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b34739_58e1_4762_b3ed_794390a3eba5.slice/crio-8459174f2b25921b3b243ce8b5306139d1ba43684076b92280ba996581bf7854 WatchSource:0}: Error finding container 8459174f2b25921b3b243ce8b5306139d1ba43684076b92280ba996581bf7854: Status 404 returned error can't find the container with id 8459174f2b25921b3b243ce8b5306139d1ba43684076b92280ba996581bf7854
Jul 16 17:30:11.925321 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.925289    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4wmm7"]
Jul 16 17:30:11.929015 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:11.928984    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod134df64e_da7d_4ca5_90f6_d1bd61d5b70c.slice/crio-d534b7cb9565a88de55649d3975ce6c79a85f55b2212b72cfff15cdf4cedb472 WatchSource:0}: Error finding container d534b7cb9565a88de55649d3975ce6c79a85f55b2212b72cfff15cdf4cedb472: Status 404 returned error can't find the container with id d534b7cb9565a88de55649d3975ce6c79a85f55b2212b72cfff15cdf4cedb472
Jul 16 17:30:11.961344 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.961316    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:30:11.961495 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.961431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:30:11.961543 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.961535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:30:11.964457 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.964437    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 17:30:11.964597 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.964550    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vscvt\""
Jul 16 17:30:11.964597 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.964564    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 17:30:11.964597 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.964565    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 17:30:11.964760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.964626    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4lggz\""
Jul 16 17:30:11.964760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:11.964660    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 17:30:12.324674 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:12.324640    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gpqtb" event={"ID":"3743d9af-ba0c-486a-bde9-99913d98760a","Type":"ContainerStarted","Data":"a8595980474c71d4eceb85f38f94374000acbba749b3f197c23b059c112369a7"}
Jul 16 17:30:12.325651 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:12.325628    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4wmm7" event={"ID":"134df64e-da7d-4ca5-90f6-d1bd61d5b70c","Type":"ContainerStarted","Data":"d534b7cb9565a88de55649d3975ce6c79a85f55b2212b72cfff15cdf4cedb472"}
Jul 16 17:30:12.327117 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:12.327097    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zbhdt" event={"ID":"f3b34739-58e1-4762-b3ed-794390a3eba5","Type":"ContainerStarted","Data":"8459174f2b25921b3b243ce8b5306139d1ba43684076b92280ba996581bf7854"}
Jul 16 17:30:13.574635 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:13.574584    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:13.662494 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:13.662457    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:16.551295 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:16.551238    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:16.637356 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:16.637317    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:16.824399 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:16.824294    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:16.838505 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:16.838474    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pqw6z"]
Jul 16 17:30:16.860307 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:16.860273    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pqw6z"]
Jul 16 17:30:16.860489 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:16.860395    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pqw6z"
Jul 16 17:30:16.863358 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:16.863334    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 16 17:30:16.863492 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:16.863383    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8lbtv\""
Jul 16 17:30:16.914380 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:16.914336    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2aabc54-4085-422c-80d6-a2d4766e7e6c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-pqw6z\" (UID: \"f2aabc54-4085-422c-80d6-a2d4766e7e6c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pqw6z"
Jul 16 17:30:16.971820 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:16.971783    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:17.014662 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:17.014629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2aabc54-4085-422c-80d6-a2d4766e7e6c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-pqw6z\" (UID: \"f2aabc54-4085-422c-80d6-a2d4766e7e6c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pqw6z"
Jul 16 17:30:17.017285 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:17.017256    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2aabc54-4085-422c-80d6-a2d4766e7e6c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-pqw6z\" (UID: \"f2aabc54-4085-422c-80d6-a2d4766e7e6c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pqw6z"
Jul 16 17:30:17.171804 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:17.171728    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pqw6z"
Jul 16 17:30:17.466326 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:17.466289    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:17.553271 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:17.553236    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:17.995948 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:17.995866    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pqw6z"]
Jul 16 17:30:18.003683 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:18.003641    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2aabc54_4085_422c_80d6_a2d4766e7e6c.slice/crio-adea8a740306ce5a5288772459c36404b2b4afb62b604ce5d3818e4104c674dc WatchSource:0}: Error finding container adea8a740306ce5a5288772459c36404b2b4afb62b604ce5d3818e4104c674dc: Status 404 returned error can't find the container with id adea8a740306ce5a5288772459c36404b2b4afb62b604ce5d3818e4104c674dc
Jul 16 17:30:18.346761 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:18.346725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zbhdt" event={"ID":"f3b34739-58e1-4762-b3ed-794390a3eba5","Type":"ContainerStarted","Data":"0af87102f9e6d19ac991102d46aaa55fd0d9f84b13ac57c637362bba2e5600da"}
Jul 16 17:30:18.348437 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:18.348411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gpqtb" event={"ID":"3743d9af-ba0c-486a-bde9-99913d98760a","Type":"ContainerStarted","Data":"1e81365d9f479a21081ed04b154f221283abb049ecda3152442c23f30bd9f3b0"}
Jul 16 17:30:18.348574 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:18.348457    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gpqtb" event={"ID":"3743d9af-ba0c-486a-bde9-99913d98760a","Type":"ContainerStarted","Data":"5069436000ad2e4423271d8a6c48e069a0da98b0bbcf2e2e2ac0b7767b79d23d"}
Jul 16 17:30:18.348574 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:18.348484    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:18.349462 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:18.349441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pqw6z" event={"ID":"f2aabc54-4085-422c-80d6-a2d4766e7e6c","Type":"ContainerStarted","Data":"adea8a740306ce5a5288772459c36404b2b4afb62b604ce5d3818e4104c674dc"}
Jul 16 17:30:18.350666 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:18.350646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4wmm7" event={"ID":"134df64e-da7d-4ca5-90f6-d1bd61d5b70c","Type":"ContainerStarted","Data":"e3e586452f105df3863e591714c701f473afa19b78c7066cdc98db00adc6fa1f"}
Jul 16 17:30:18.376554 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:18.376505    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zbhdt" podStartSLOduration=1.435971437 podStartE2EDuration="7.376490023s" totalImagesPullingTime="5.940518586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:18.376204954 +0000 UTC m=+56.931262412" watchObservedRunningTime="2026-07-16 17:30:18.376490023 +0000 UTC m=+56.931547461"
Jul 16 17:30:18.398105 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:18.398056    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gpqtb" podStartSLOduration=1.439267815 podStartE2EDuration="7.397996469s" totalImagesPullingTime="5.958728654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:18.396916601 +0000 UTC m=+56.951974051" watchObservedRunningTime="2026-07-16 17:30:18.397996469 +0000 UTC m=+56.953053967"
Jul 16 17:30:19.355668 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:19.355626    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pqw6z" event={"ID":"f2aabc54-4085-422c-80d6-a2d4766e7e6c","Type":"ContainerStarted","Data":"5b75082e3d3740ff0e8dbf3ba0aada56346df09f515639888229ba8d50a60a2d"}
Jul 16 17:30:19.378907 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:19.378855    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pqw6z" podStartSLOduration=2.182047577 podStartE2EDuration="3.378835544s" totalImagesPullingTime="1.196787967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:19.377402751 +0000 UTC m=+57.932460192" watchObservedRunningTime="2026-07-16 17:30:19.378835544 +0000 UTC m=+57.933892993"
Jul 16 17:30:20.359906 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:20.359872    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pqw6z"
Jul 16 17:30:20.365935 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:20.365907    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-pqw6z"
Jul 16 17:30:20.918798 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:20.918759    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:20.969517 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:20.969476    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-85ds8"]
Jul 16 17:30:20.985301 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:20.985267    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:20.992989 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:20.992345    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 17:30:20.992989 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:20.992467    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 16 17:30:20.992989 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:20.992553    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-z2wb7\""
Jul 16 17:30:20.992989 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:20.992669    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 16 17:30:20.992989 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:20.992694    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 17:30:20.992989 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:20.992708    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 17:30:20.994872 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:20.994845    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-85ds8"]
Jul 16 17:30:21.046575 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.046433    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/842057ff-84b5-463b-b822-50ca75005195-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-85ds8\" (UID: \"842057ff-84b5-463b-b822-50ca75005195\") " pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:21.046575 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.046484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/842057ff-84b5-463b-b822-50ca75005195-metrics-client-ca\") pod \"prometheus-operator-64785b6675-85ds8\" (UID: \"842057ff-84b5-463b-b822-50ca75005195\") " pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:21.046575 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.046571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/842057ff-84b5-463b-b822-50ca75005195-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-85ds8\" (UID: \"842057ff-84b5-463b-b822-50ca75005195\") " pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:21.046896 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.046667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpcxg\" (UniqueName: \"kubernetes.io/projected/842057ff-84b5-463b-b822-50ca75005195-kube-api-access-mpcxg\") pod \"prometheus-operator-64785b6675-85ds8\" (UID: \"842057ff-84b5-463b-b822-50ca75005195\") " pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:21.065648 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.065616    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:21.147349 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.147310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpcxg\" (UniqueName: \"kubernetes.io/projected/842057ff-84b5-463b-b822-50ca75005195-kube-api-access-mpcxg\") pod \"prometheus-operator-64785b6675-85ds8\" (UID: \"842057ff-84b5-463b-b822-50ca75005195\") " pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:21.147543 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.147406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/842057ff-84b5-463b-b822-50ca75005195-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-85ds8\" (UID: \"842057ff-84b5-463b-b822-50ca75005195\") " pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:21.147543 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.147434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/842057ff-84b5-463b-b822-50ca75005195-metrics-client-ca\") pod \"prometheus-operator-64785b6675-85ds8\" (UID: \"842057ff-84b5-463b-b822-50ca75005195\") " pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:21.147543 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.147481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/842057ff-84b5-463b-b822-50ca75005195-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-85ds8\" (UID: \"842057ff-84b5-463b-b822-50ca75005195\") " pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:21.147714 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:21.147586    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 16 17:30:21.147714 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:21.147666    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842057ff-84b5-463b-b822-50ca75005195-prometheus-operator-tls podName:842057ff-84b5-463b-b822-50ca75005195 nodeName:}" failed. No retries permitted until 2026-07-16 17:30:21.647644734 +0000 UTC m=+60.202702152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/842057ff-84b5-463b-b822-50ca75005195-prometheus-operator-tls") pod "prometheus-operator-64785b6675-85ds8" (UID: "842057ff-84b5-463b-b822-50ca75005195") : secret "prometheus-operator-tls" not found
Jul 16 17:30:21.148162 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.148140    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/842057ff-84b5-463b-b822-50ca75005195-metrics-client-ca\") pod \"prometheus-operator-64785b6675-85ds8\" (UID: \"842057ff-84b5-463b-b822-50ca75005195\") " pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:21.150024 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.149997    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/842057ff-84b5-463b-b822-50ca75005195-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-85ds8\" (UID: \"842057ff-84b5-463b-b822-50ca75005195\") " pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:21.162539 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.162122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpcxg\" (UniqueName: \"kubernetes.io/projected/842057ff-84b5-463b-b822-50ca75005195-kube-api-access-mpcxg\") pod \"prometheus-operator-64785b6675-85ds8\" (UID: \"842057ff-84b5-463b-b822-50ca75005195\") " pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:21.342356 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.342322    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:21.652235 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.652137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/842057ff-84b5-463b-b822-50ca75005195-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-85ds8\" (UID: \"842057ff-84b5-463b-b822-50ca75005195\") " pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:21.654704 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.654673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/842057ff-84b5-463b-b822-50ca75005195-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-85ds8\" (UID: \"842057ff-84b5-463b-b822-50ca75005195\") " pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:21.899984 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.899958    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-z2wb7\""
Jul 16 17:30:21.907544 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:21.907477    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8"
Jul 16 17:30:22.058754 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.058724    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77657ffcc5-x5fkp"]
Jul 16 17:30:22.098735 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.098695    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77657ffcc5-x5fkp"]
Jul 16 17:30:22.098910 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.098839    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.104615 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.104358    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 17:30:22.104615 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.104404    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 17:30:22.104615 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.104474    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 17:30:22.104615 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.104483    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 17:30:22.104615 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.104499    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tzz28\""
Jul 16 17:30:22.104615 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.104556    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 17:30:22.105030 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.104793    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 17:30:22.105030 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.104815    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 17:30:22.157173 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.157134    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24857346-526d-467b-858e-dda2cbab4615-console-serving-cert\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.157173 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.157193    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-console-config\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.157448 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.157230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24857346-526d-467b-858e-dda2cbab4615-console-oauth-config\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.157448 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.157249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h7d2\" (UniqueName: \"kubernetes.io/projected/24857346-526d-467b-858e-dda2cbab4615-kube-api-access-7h7d2\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.157448 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.157294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-service-ca\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.157448 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.157325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-oauth-serving-cert\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.258199 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.258154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24857346-526d-467b-858e-dda2cbab4615-console-serving-cert\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.258357 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.258229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-console-config\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.258357 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.258272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24857346-526d-467b-858e-dda2cbab4615-console-oauth-config\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.258357 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.258297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h7d2\" (UniqueName: \"kubernetes.io/projected/24857346-526d-467b-858e-dda2cbab4615-kube-api-access-7h7d2\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.258357 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.258326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-service-ca\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.258357 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.258350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-oauth-serving-cert\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.259015 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.258989    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-console-config\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.259406 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.259378    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-service-ca\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.259929 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.259907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-oauth-serving-cert\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.260980 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.260955    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24857346-526d-467b-858e-dda2cbab4615-console-oauth-config\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.261211 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.261193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24857346-526d-467b-858e-dda2cbab4615-console-serving-cert\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.269231 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.269207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h7d2\" (UniqueName: \"kubernetes.io/projected/24857346-526d-467b-858e-dda2cbab4615-kube-api-access-7h7d2\") pod \"console-77657ffcc5-x5fkp\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") " pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.287000 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.286975    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vp5p"
Jul 16 17:30:22.412247 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.412209    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:22.438794 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.438763    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:22.543147 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:22.543058    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:23.334328 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:23.334294    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77657ffcc5-x5fkp"]
Jul 16 17:30:23.337461 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:23.337419    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24857346_526d_467b_858e_dda2cbab4615.slice/crio-1458303bf8cb2e4584cafa10512d77dfacf449a3a2bfa7ecdf616240d80195d4 WatchSource:0}: Error finding container 1458303bf8cb2e4584cafa10512d77dfacf449a3a2bfa7ecdf616240d80195d4: Status 404 returned error can't find the container with id 1458303bf8cb2e4584cafa10512d77dfacf449a3a2bfa7ecdf616240d80195d4
Jul 16 17:30:23.352341 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:23.352317    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-85ds8"]
Jul 16 17:30:23.355781 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:23.355752    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842057ff_84b5_463b_b822_50ca75005195.slice/crio-9d0fb6221de0a9c5d6c4c0918df3226d4605e07d7ad7cd43739fc34b287b5d2c WatchSource:0}: Error finding container 9d0fb6221de0a9c5d6c4c0918df3226d4605e07d7ad7cd43739fc34b287b5d2c: Status 404 returned error can't find the container with id 9d0fb6221de0a9c5d6c4c0918df3226d4605e07d7ad7cd43739fc34b287b5d2c
Jul 16 17:30:23.371723 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:23.371688    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8" event={"ID":"842057ff-84b5-463b-b822-50ca75005195","Type":"ContainerStarted","Data":"9d0fb6221de0a9c5d6c4c0918df3226d4605e07d7ad7cd43739fc34b287b5d2c"}
Jul 16 17:30:23.373254 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:23.373230    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4wmm7" event={"ID":"134df64e-da7d-4ca5-90f6-d1bd61d5b70c","Type":"ContainerStarted","Data":"e902fa829c484bdee37aa8a52beba48fab69cd8c1669b7fbdd7918a627edd740"}
Jul 16 17:30:23.374300 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:23.374280    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77657ffcc5-x5fkp" event={"ID":"24857346-526d-467b-858e-dda2cbab4615","Type":"ContainerStarted","Data":"1458303bf8cb2e4584cafa10512d77dfacf449a3a2bfa7ecdf616240d80195d4"}
Jul 16 17:30:25.669792 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:25.669753    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:25.777370 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:25.777335    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:26.697827 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.697786    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:30:26.698343 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.697841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs\") pod \"network-metrics-daemon-m68mv\" (UID: \"5b310a15-65a4-4607-a273-ed5910798e1a\") " pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:30:26.702302 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.702272    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 17:30:26.702846 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.702823    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 17:30:26.711363 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.711336    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b310a15-65a4-4607-a273-ed5910798e1a-metrics-certs\") pod \"network-metrics-daemon-m68mv\" (UID: \"5b310a15-65a4-4607-a273-ed5910798e1a\") " pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:30:26.711481 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.711342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe08b052-aad8-4578-a744-1fe793b72104-original-pull-secret\") pod \"global-pull-secret-syncer-c87pm\" (UID: \"fe08b052-aad8-4578-a744-1fe793b72104\") " pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:30:26.798947 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.798912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bdz2\" (UniqueName: \"kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2\") pod \"network-check-target-7lq4t\" (UID: \"78a41699-1953-423f-89aa-efc3afe5fecc\") " pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:30:26.802356 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.802327    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 17:30:26.812948 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.812917    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 17:30:26.823235 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.823204    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bdz2\" (UniqueName: \"kubernetes.io/projected/78a41699-1953-423f-89aa-efc3afe5fecc-kube-api-access-4bdz2\") pod \"network-check-target-7lq4t\" (UID: \"78a41699-1953-423f-89aa-efc3afe5fecc\") " pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:30:26.971983 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.971945    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c87pm"
Jul 16 17:30:26.982929 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.982897    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4lggz\""
Jul 16 17:30:26.985524 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.985481    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vscvt\""
Jul 16 17:30:26.987077 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.987056    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m68mv"
Jul 16 17:30:26.992724 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:26.992704    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:30:28.358120 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:28.358082    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gpqtb"
Jul 16 17:30:28.625669 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:28.625639    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7lq4t"]
Jul 16 17:30:28.659339 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:28.659311    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c87pm"]
Jul 16 17:30:28.664709 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:28.664069    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m68mv"]
Jul 16 17:30:28.667293 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:28.667265    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe08b052_aad8_4578_a744_1fe793b72104.slice/crio-78407455aac3b85c392dcc12e6bc296d7177d11f25b97e496b70b12ab726e0c3 WatchSource:0}: Error finding container 78407455aac3b85c392dcc12e6bc296d7177d11f25b97e496b70b12ab726e0c3: Status 404 returned error can't find the container with id 78407455aac3b85c392dcc12e6bc296d7177d11f25b97e496b70b12ab726e0c3
Jul 16 17:30:28.667560 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:28.667540    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b310a15_65a4_4607_a273_ed5910798e1a.slice/crio-dd5a17a995c3ba1e951abba4ff5b21927b80c89ca856858be2b69be2d61c2a54 WatchSource:0}: Error finding container dd5a17a995c3ba1e951abba4ff5b21927b80c89ca856858be2b69be2d61c2a54: Status 404 returned error can't find the container with id dd5a17a995c3ba1e951abba4ff5b21927b80c89ca856858be2b69be2d61c2a54
Jul 16 17:30:28.694109 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:28.694075    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:28.850962 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:28.850866    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:28.950709 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:28.950673    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:29.402075 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.401965    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m68mv" event={"ID":"5b310a15-65a4-4607-a273-ed5910798e1a","Type":"ContainerStarted","Data":"dd5a17a995c3ba1e951abba4ff5b21927b80c89ca856858be2b69be2d61c2a54"}
Jul 16 17:30:29.403735 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.403660    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c87pm" event={"ID":"fe08b052-aad8-4578-a744-1fe793b72104","Type":"ContainerStarted","Data":"78407455aac3b85c392dcc12e6bc296d7177d11f25b97e496b70b12ab726e0c3"}
Jul 16 17:30:29.408163 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.407309    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8" event={"ID":"842057ff-84b5-463b-b822-50ca75005195","Type":"ContainerStarted","Data":"98db1b6199461a18be27edf94f0bc68bf25b306a6b793e329cb55578db12cbc5"}
Jul 16 17:30:29.408163 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.407366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8" event={"ID":"842057ff-84b5-463b-b822-50ca75005195","Type":"ContainerStarted","Data":"1f7cb90a78ba408556c20b16270d0934a87a62bfdba19ba6ba6382df9b5fccab"}
Jul 16 17:30:29.411929 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.411304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4wmm7" event={"ID":"134df64e-da7d-4ca5-90f6-d1bd61d5b70c","Type":"ContainerStarted","Data":"bd63f21146df2baf0449088b77104690b5570a94d69d597967b1ed181112f6df"}
Jul 16 17:30:29.414313 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.414252    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77657ffcc5-x5fkp" event={"ID":"24857346-526d-467b-858e-dda2cbab4615","Type":"ContainerStarted","Data":"179f0d9f4f0ae9c56d013e93aec2c833cd70fd08d74fa47ece3f040df5432926"}
Jul 16 17:30:29.415807 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.415780    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7lq4t" event={"ID":"78a41699-1953-423f-89aa-efc3afe5fecc","Type":"ContainerStarted","Data":"9a75461d389a4b86854df9587d6b45758368d22e0ef8c39606f6767ce639e71f"}
Jul 16 17:30:29.429843 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.429570    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-85ds8" podStartSLOduration=4.269769864 podStartE2EDuration="9.429550315s" totalImagesPullingTime="5.159780451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:29.428841344 +0000 UTC m=+67.983898782" watchObservedRunningTime="2026-07-16 17:30:29.429550315 +0000 UTC m=+67.984607752"
Jul 16 17:30:29.450359 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.450146    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4wmm7" podStartSLOduration=2.008572003 podStartE2EDuration="18.450124161s" totalImagesPullingTime="16.441552158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:30:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:29.448966867 +0000 UTC m=+68.004024303" watchObservedRunningTime="2026-07-16 17:30:29.450124161 +0000 UTC m=+68.005181581"
Jul 16 17:30:29.470156 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.470086    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77657ffcc5-x5fkp" podStartSLOduration=2.348638218 podStartE2EDuration="7.470063477s" totalImagesPullingTime="5.121425259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:29.469297725 +0000 UTC m=+68.024355163" watchObservedRunningTime="2026-07-16 17:30:29.470063477 +0000 UTC m=+68.025120915"
Jul 16 17:30:29.637983 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.637739    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f996c8655-vj8km"]
Jul 16 17:30:29.642336 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.642226    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.650261 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.650231    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 16 17:30:29.655295 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.654788    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f996c8655-vj8km"]
Jul 16 17:30:29.724096 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.723982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-service-ca\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.724096 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.724051    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjwgs\" (UniqueName: \"kubernetes.io/projected/3d68c657-a237-47d4-9154-d0577f9e002e-kube-api-access-gjwgs\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.724096 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.724089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-trusted-ca-bundle\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.724516 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.724117    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-console-config\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.724516 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.724163    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d68c657-a237-47d4-9154-d0577f9e002e-console-serving-cert\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.724516 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.724188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d68c657-a237-47d4-9154-d0577f9e002e-console-oauth-config\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.724516 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.724212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-oauth-serving-cert\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.827509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.825256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjwgs\" (UniqueName: \"kubernetes.io/projected/3d68c657-a237-47d4-9154-d0577f9e002e-kube-api-access-gjwgs\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.827509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.825307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-trusted-ca-bundle\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.827509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.825337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-console-config\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.827509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.825394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d68c657-a237-47d4-9154-d0577f9e002e-console-serving-cert\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.827509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.825419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d68c657-a237-47d4-9154-d0577f9e002e-console-oauth-config\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.827509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.825440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-oauth-serving-cert\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.827509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.825486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-service-ca\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.827509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.826244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-service-ca\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.827509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.826826    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-oauth-serving-cert\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.827509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.827283    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-trusted-ca-bundle\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.827509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.827464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-console-config\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.829301 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.829269    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d68c657-a237-47d4-9154-d0577f9e002e-console-oauth-config\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.829776 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.829730    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d68c657-a237-47d4-9154-d0577f9e002e-console-serving-cert\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.837392 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.837340    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjwgs\" (UniqueName: \"kubernetes.io/projected/3d68c657-a237-47d4-9154-d0577f9e002e-kube-api-access-gjwgs\") pod \"console-f996c8655-vj8km\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") " pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:29.958788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:29.958469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:30.128504 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:30.128465    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f996c8655-vj8km"]
Jul 16 17:30:30.132409 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:30.132377    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d68c657_a237_47d4_9154_d0577f9e002e.slice/crio-1892d5beee425002d718f2c86efd19d7fea832f7de611719f37c7df44be965f6 WatchSource:0}: Error finding container 1892d5beee425002d718f2c86efd19d7fea832f7de611719f37c7df44be965f6: Status 404 returned error can't find the container with id 1892d5beee425002d718f2c86efd19d7fea832f7de611719f37c7df44be965f6
Jul 16 17:30:30.186983 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:30.186947    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:30.423207 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:30.423164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m68mv" event={"ID":"5b310a15-65a4-4607-a273-ed5910798e1a","Type":"ContainerStarted","Data":"655007fe796c265a5b8cb62ebf572458d132e6215a27cb846ac4c3bab4f1c4e9"}
Jul 16 17:30:30.423640 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:30.423234    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m68mv" event={"ID":"5b310a15-65a4-4607-a273-ed5910798e1a","Type":"ContainerStarted","Data":"4f696c1c2dd2cbf3bc077f148a39342b28903e0a9aab9e7276b73d36325932f9"}
Jul 16 17:30:30.426220 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:30.425740    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f996c8655-vj8km" event={"ID":"3d68c657-a237-47d4-9154-d0577f9e002e","Type":"ContainerStarted","Data":"20353943eb137aa598557f50021e40106a10c357eeb769782ec8df462c7192b8"}
Jul 16 17:30:30.426220 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:30.425784    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f996c8655-vj8km" event={"ID":"3d68c657-a237-47d4-9154-d0577f9e002e","Type":"ContainerStarted","Data":"1892d5beee425002d718f2c86efd19d7fea832f7de611719f37c7df44be965f6"}
Jul 16 17:30:30.444161 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:30.444105    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m68mv" podStartSLOduration=67.358862045 podStartE2EDuration="1m8.444088446s" totalImagesPullingTime="1.085226401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:30.443120812 +0000 UTC m=+68.998178252" watchObservedRunningTime="2026-07-16 17:30:30.444088446 +0000 UTC m=+68.999145861"
Jul 16 17:30:30.464280 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:30.464222    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f996c8655-vj8km" podStartSLOduration=1.464206828 podStartE2EDuration="1.464206828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:30.463448742 +0000 UTC m=+69.018506204" watchObservedRunningTime="2026-07-16 17:30:30.464206828 +0000 UTC m=+69.019264268"
Jul 16 17:30:30.573590 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:30.573552    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:31.234288 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.234203    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:31.347319 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.347240    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:31.471483 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.471445    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:31.516251 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.516168    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"]
Jul 16 17:30:31.521645 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.521611    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.525227 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.525153    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 16 17:30:31.525227 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.525192    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2c56h\""
Jul 16 17:30:31.525449 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.525194    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 16 17:30:31.525744 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.525723    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"]
Jul 16 17:30:31.529875 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.529848    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.542796 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.542296    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 16 17:30:31.542796 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.542494    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 16 17:30:31.542796 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.542587    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cb75t\""
Jul 16 17:30:31.542796 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.542744    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 16 17:30:31.543673 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.543586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"]
Jul 16 17:30:31.553075 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.553025    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"]
Jul 16 17:30:31.579542 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.579503    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5kk8c"]
Jul 16 17:30:31.583190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.583165    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.588263 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.588236    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 17:30:31.588398 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.588263    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nmknv\""
Jul 16 17:30:31.588398 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.588351    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 17:30:31.589607 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.589255    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 17:30:31.644938 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.644896    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73efadef-775a-473c-a521-ba10783dbdc6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-nrtn6\" (UID: \"73efadef-775a-473c-a521-ba10783dbdc6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.644938 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.644943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-sys\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.645189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.644964    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8lrj\" (UniqueName: \"kubernetes.io/projected/390538f6-fe92-4a30-b1e2-d818ff7884d0-kube-api-access-t8lrj\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.645189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.644994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/390538f6-fe92-4a30-b1e2-d818ff7884d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.645189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73efadef-775a-473c-a521-ba10783dbdc6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-nrtn6\" (UID: \"73efadef-775a-473c-a521-ba10783dbdc6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.645189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645136    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.645189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645178    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73efadef-775a-473c-a521-ba10783dbdc6-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-nrtn6\" (UID: \"73efadef-775a-473c-a521-ba10783dbdc6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.645483 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645248    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/390538f6-fe92-4a30-b1e2-d818ff7884d0-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.645483 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-wtmp\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.645483 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645324    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq895\" (UniqueName: \"kubernetes.io/projected/73efadef-775a-473c-a521-ba10783dbdc6-kube-api-access-zq895\") pod \"openshift-state-metrics-84bd68b896-nrtn6\" (UID: \"73efadef-775a-473c-a521-ba10783dbdc6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.645483 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/390538f6-fe92-4a30-b1e2-d818ff7884d0-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.645483 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-metrics-client-ca\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.645483 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645415    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.645483 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdcjw\" (UniqueName: \"kubernetes.io/projected/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-kube-api-access-zdcjw\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.645814 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-tls\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.645814 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/390538f6-fe92-4a30-b1e2-d818ff7884d0-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.645814 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-root\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.645814 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-textfile\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.645814 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.645653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/390538f6-fe92-4a30-b1e2-d818ff7884d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.748621 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.746690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/390538f6-fe92-4a30-b1e2-d818ff7884d0-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.748621 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.746768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-root\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.748621 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.746824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-textfile\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.748621 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.746863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/390538f6-fe92-4a30-b1e2-d818ff7884d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.748621 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.746900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73efadef-775a-473c-a521-ba10783dbdc6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-nrtn6\" (UID: \"73efadef-775a-473c-a521-ba10783dbdc6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.748621 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.746939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-sys\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.748621 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.746969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8lrj\" (UniqueName: \"kubernetes.io/projected/390538f6-fe92-4a30-b1e2-d818ff7884d0-kube-api-access-t8lrj\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.748621 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.747010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/390538f6-fe92-4a30-b1e2-d818ff7884d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.748621 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.747810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/390538f6-fe92-4a30-b1e2-d818ff7884d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.749234 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.748825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-root\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.750075 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.749963    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-textfile\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.750075 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.750072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-sys\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.750259 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.750120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73efadef-775a-473c-a521-ba10783dbdc6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-nrtn6\" (UID: \"73efadef-775a-473c-a521-ba10783dbdc6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.750259 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.750164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.750259 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.750196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73efadef-775a-473c-a521-ba10783dbdc6-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-nrtn6\" (UID: \"73efadef-775a-473c-a521-ba10783dbdc6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.750259 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.750236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/390538f6-fe92-4a30-b1e2-d818ff7884d0-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.750462 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.750265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-wtmp\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.750462 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.750297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq895\" (UniqueName: \"kubernetes.io/projected/73efadef-775a-473c-a521-ba10783dbdc6-kube-api-access-zq895\") pod \"openshift-state-metrics-84bd68b896-nrtn6\" (UID: \"73efadef-775a-473c-a521-ba10783dbdc6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.750462 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.750336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/390538f6-fe92-4a30-b1e2-d818ff7884d0-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.750462 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.750364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-metrics-client-ca\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.750462 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.750392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.750462 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.750432    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdcjw\" (UniqueName: \"kubernetes.io/projected/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-kube-api-access-zdcjw\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.750462 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.750461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-tls\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.750803 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.750483    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/390538f6-fe92-4a30-b1e2-d818ff7884d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.751304 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.751276    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-metrics-client-ca\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.752083 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.752019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.752241 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.752220    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-wtmp\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.752310 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.752267    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73efadef-775a-473c-a521-ba10783dbdc6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-nrtn6\" (UID: \"73efadef-775a-473c-a521-ba10783dbdc6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.752607 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.752582    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/390538f6-fe92-4a30-b1e2-d818ff7884d0-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.753217 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.753127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/390538f6-fe92-4a30-b1e2-d818ff7884d0-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.753767 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.753720    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-tls\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.753867 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.753773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73efadef-775a-473c-a521-ba10783dbdc6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-nrtn6\" (UID: \"73efadef-775a-473c-a521-ba10783dbdc6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.754443 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.754390    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73efadef-775a-473c-a521-ba10783dbdc6-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-nrtn6\" (UID: \"73efadef-775a-473c-a521-ba10783dbdc6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.755167 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.755126    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/390538f6-fe92-4a30-b1e2-d818ff7884d0-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.755418 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.755383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.779025 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.778949    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdcjw\" (UniqueName: \"kubernetes.io/projected/ea4e2002-477a-48b0-849b-dc3e5ae44c5d-kube-api-access-zdcjw\") pod \"node-exporter-5kk8c\" (UID: \"ea4e2002-477a-48b0-849b-dc3e5ae44c5d\") " pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:31.779025 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.778952    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq895\" (UniqueName: \"kubernetes.io/projected/73efadef-775a-473c-a521-ba10783dbdc6-kube-api-access-zq895\") pod \"openshift-state-metrics-84bd68b896-nrtn6\" (UID: \"73efadef-775a-473c-a521-ba10783dbdc6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.784116 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.784082    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8lrj\" (UniqueName: \"kubernetes.io/projected/390538f6-fe92-4a30-b1e2-d818ff7884d0-kube-api-access-t8lrj\") pod \"kube-state-metrics-785778ff74-lz5vb\" (UID: \"390538f6-fe92-4a30-b1e2-d818ff7884d0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.798086 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.798010    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:31.835636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.835592    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"
Jul 16 17:30:31.847893 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.847865    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"
Jul 16 17:30:31.895384 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:31.895342    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5kk8c"
Jul 16 17:30:32.011471 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.011445    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6"]
Jul 16 17:30:32.039298 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.039172    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-lz5vb"]
Jul 16 17:30:32.413153 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.413057    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:32.413153 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.413135    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:32.419577 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.419547    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:32.439938 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.439904    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:30:32.677100 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.677007    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 17:30:32.682015 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.681986    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.686487 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.686383    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 16 17:30:32.686487 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.686472    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 16 17:30:32.686693 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.686488    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 16 17:30:32.686693 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.686550    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 16 17:30:32.686803 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.686698    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 16 17:30:32.686803 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.686727    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 16 17:30:32.686803 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.686756    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 16 17:30:32.686922 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.686872    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 16 17:30:32.687168 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.686988    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 16 17:30:32.687168 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.687080    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d6tnq\""
Jul 16 17:30:32.701471 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.701436    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 17:30:32.760151 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.760079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.760151 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.760141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-config-volume\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.760369 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.760179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/19a4230c-9880-4431-85d1-ef15e541ca84-config-out\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.760369 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.760205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/19a4230c-9880-4431-85d1-ef15e541ca84-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.760369 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.760239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.760369 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.760273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19a4230c-9880-4431-85d1-ef15e541ca84-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.760369 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.760296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8rks\" (UniqueName: \"kubernetes.io/projected/19a4230c-9880-4431-85d1-ef15e541ca84-kube-api-access-s8rks\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.760369 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.760325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.760699 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.760401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.760699 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.760447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/19a4230c-9880-4431-85d1-ef15e541ca84-tls-assets\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.760699 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.760483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.760699 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.760520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-web-config\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.760699 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.760594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19a4230c-9880-4431-85d1-ef15e541ca84-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.862060 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.861995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.862272 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.862193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-web-config\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.862272 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.862243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19a4230c-9880-4431-85d1-ef15e541ca84-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.862392 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.862288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.862392 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.862314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-config-volume\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.862392 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.862348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/19a4230c-9880-4431-85d1-ef15e541ca84-config-out\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.862392 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.862363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/19a4230c-9880-4431-85d1-ef15e541ca84-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.862588 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.862392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.862588 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.862426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19a4230c-9880-4431-85d1-ef15e541ca84-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.862588 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.862448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8rks\" (UniqueName: \"kubernetes.io/projected/19a4230c-9880-4431-85d1-ef15e541ca84-kube-api-access-s8rks\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.862588 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.862478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.863004 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.862977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.863134 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.863066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/19a4230c-9880-4431-85d1-ef15e541ca84-tls-assets\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.863896 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.863868    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19a4230c-9880-4431-85d1-ef15e541ca84-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.869132 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.869102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/19a4230c-9880-4431-85d1-ef15e541ca84-config-out\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.871407 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.869356    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.871407 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.869545    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-config-volume\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.871407 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.869685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19a4230c-9880-4431-85d1-ef15e541ca84-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.871407 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.870248    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.871716 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.871631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/19a4230c-9880-4431-85d1-ef15e541ca84-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.871778 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.871743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.872489 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.872464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-web-config\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.872586 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.872508    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/19a4230c-9880-4431-85d1-ef15e541ca84-tls-assets\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.872649 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.872607    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.872739 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.872718    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.876581 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.876562    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8rks\" (UniqueName: \"kubernetes.io/projected/19a4230c-9880-4431-85d1-ef15e541ca84-kube-api-access-s8rks\") pod \"alertmanager-main-0\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:32.994836 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:32.994805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:30:33.344766 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:33.344664    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod390538f6_fe92_4a30_b1e2_d818ff7884d0.slice/crio-864f2b71bd8a83ba620f7cddeaad119be6088a985028fc89250f019fb4f69cac WatchSource:0}: Error finding container 864f2b71bd8a83ba620f7cddeaad119be6088a985028fc89250f019fb4f69cac: Status 404 returned error can't find the container with id 864f2b71bd8a83ba620f7cddeaad119be6088a985028fc89250f019fb4f69cac
Jul 16 17:30:33.360549 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:33.360520    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4e2002_477a_48b0_849b_dc3e5ae44c5d.slice/crio-af61fa9e7ab149724f15486da7c67cd0e76f8a1818203f96f9b1870aa2399a74 WatchSource:0}: Error finding container af61fa9e7ab149724f15486da7c67cd0e76f8a1818203f96f9b1870aa2399a74: Status 404 returned error can't find the container with id af61fa9e7ab149724f15486da7c67cd0e76f8a1818203f96f9b1870aa2399a74
Jul 16 17:30:33.451539 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:33.448729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb" event={"ID":"390538f6-fe92-4a30-b1e2-d818ff7884d0","Type":"ContainerStarted","Data":"864f2b71bd8a83ba620f7cddeaad119be6088a985028fc89250f019fb4f69cac"}
Jul 16 17:30:33.461754 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:33.461644    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7lq4t" event={"ID":"78a41699-1953-423f-89aa-efc3afe5fecc","Type":"ContainerStarted","Data":"80de0e0ac3442b9385441febae9f34c792c85de920165982fa70d6be2ad9c293"}
Jul 16 17:30:33.469062 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:33.468990    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kk8c" event={"ID":"ea4e2002-477a-48b0-849b-dc3e5ae44c5d","Type":"ContainerStarted","Data":"af61fa9e7ab149724f15486da7c67cd0e76f8a1818203f96f9b1870aa2399a74"}
Jul 16 17:30:33.472255 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:33.472145    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6" event={"ID":"73efadef-775a-473c-a521-ba10783dbdc6","Type":"ContainerStarted","Data":"0be25b40061a8408bcc727ef853881d2c36d62fa5d778414987d74134e4da202"}
Jul 16 17:30:33.472255 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:33.472198    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6" event={"ID":"73efadef-775a-473c-a521-ba10783dbdc6","Type":"ContainerStarted","Data":"cee8bccfae3d51dc90b199fb5d55580098ec9cf83801e4c33da6310f67e0c1a0"}
Jul 16 17:30:33.495824 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:33.495782    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:33.539090 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:33.539064    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 17:30:33.539915 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:33.539886    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a4230c_9880_4431_85d1_ef15e541ca84.slice/crio-dd429a60856334da081555ab342662263b9cb152c2816dbf000859be9fa7974c WatchSource:0}: Error finding container dd429a60856334da081555ab342662263b9cb152c2816dbf000859be9fa7974c: Status 404 returned error can't find the container with id dd429a60856334da081555ab342662263b9cb152c2816dbf000859be9fa7974c
Jul 16 17:30:33.597671 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:33.597590    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:34.477982 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.477933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6" event={"ID":"73efadef-775a-473c-a521-ba10783dbdc6","Type":"ContainerStarted","Data":"7b5a1d71e5e7e44a40929dfbde06df2ca05609806b3b7d1d60a0b1ddba91484c"}
Jul 16 17:30:34.479794 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.479763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c87pm" event={"ID":"fe08b052-aad8-4578-a744-1fe793b72104","Type":"ContainerStarted","Data":"43039fd50719bd369262bbc68c0abf9bde10f222b278efd462bd970008e299f4"}
Jul 16 17:30:34.481107 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.480984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerStarted","Data":"dd429a60856334da081555ab342662263b9cb152c2816dbf000859be9fa7974c"}
Jul 16 17:30:34.481248 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.481129    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:30:34.507059 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.506693    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c87pm" podStartSLOduration=67.609906301 podStartE2EDuration="1m12.506673116s" totalImagesPullingTime="4.896766815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:34.504673834 +0000 UTC m=+73.059731272" watchObservedRunningTime="2026-07-16 17:30:34.506673116 +0000 UTC m=+73.061730554"
Jul 16 17:30:34.516695 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.516666    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"]
Jul 16 17:30:34.528790 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.528760    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.532433 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.532384    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 16 17:30:34.533211 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.533185    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 16 17:30:34.535944 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.535744    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 16 17:30:34.536142 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.536125    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 16 17:30:34.536330 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.536315    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pt89c\""
Jul 16 17:30:34.536715 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.536606    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 16 17:30:34.536715 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.536606    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a7kiluifdoaba\""
Jul 16 17:30:34.551552 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.551318    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7lq4t" podStartSLOduration=67.834692728 podStartE2EDuration="1m12.551298316s" totalImagesPullingTime="4.716605588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:34.549567723 +0000 UTC m=+73.104625161" watchObservedRunningTime="2026-07-16 17:30:34.551298316 +0000 UTC m=+73.106355738"
Jul 16 17:30:34.553196 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.553173    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"]
Jul 16 17:30:34.678467 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.678431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plh2s\" (UniqueName: \"kubernetes.io/projected/6ed32354-7dda-4ac3-8624-6a316ef32b79-kube-api-access-plh2s\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.678636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.678498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.678636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.678539    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-grpc-tls\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.678636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.678575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.678636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.678600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ed32354-7dda-4ac3-8624-6a316ef32b79-metrics-client-ca\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.678636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.678629    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.678899 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.678657    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-tls\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.678899 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.678688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.708540 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.708506    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:34.779360 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.779277    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.779360 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.779325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-grpc-tls\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.779588 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.779360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.779588 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.779389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ed32354-7dda-4ac3-8624-6a316ef32b79-metrics-client-ca\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.779588 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.779421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.779910 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.779875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-tls\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.780005 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.779931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.780082 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.780008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plh2s\" (UniqueName: \"kubernetes.io/projected/6ed32354-7dda-4ac3-8624-6a316ef32b79-kube-api-access-plh2s\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.780318 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.780254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ed32354-7dda-4ac3-8624-6a316ef32b79-metrics-client-ca\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.782579 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.782551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-grpc-tls\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.782698 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.782608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.782943 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.782918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.783146 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.783122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.783565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.783529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.784048 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.784015    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6ed32354-7dda-4ac3-8624-6a316ef32b79-secret-thanos-querier-tls\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.799639 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.799599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plh2s\" (UniqueName: \"kubernetes.io/projected/6ed32354-7dda-4ac3-8624-6a316ef32b79-kube-api-access-plh2s\") pod \"thanos-querier-7dcbd4c656-jx5f6\" (UID: \"6ed32354-7dda-4ac3-8624-6a316ef32b79\") " pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.842997 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.842957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:34.957209 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:34.957118    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:35.094944 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:35.094820    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:35.631186 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:35.631062    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"]
Jul 16 17:30:35.643657 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:35.643578    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed32354_7dda_4ac3_8624_6a316ef32b79.slice/crio-699a031ef5bca3991bf793533709fad3ba3e3bd6dfe1ecbee20f306c88a0093a WatchSource:0}: Error finding container 699a031ef5bca3991bf793533709fad3ba3e3bd6dfe1ecbee20f306c88a0093a: Status 404 returned error can't find the container with id 699a031ef5bca3991bf793533709fad3ba3e3bd6dfe1ecbee20f306c88a0093a
Jul 16 17:30:36.128234 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.128192    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-fcd8445f5-w945z"]
Jul 16 17:30:36.130919 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.130893    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.134064 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.134026    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 16 17:30:36.134268 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.134247    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 17:30:36.135310 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.135288    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 16 17:30:36.135592 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.135314    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 16 17:30:36.135592 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.135577    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bq1vrr2t540sh\""
Jul 16 17:30:36.135865 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.135841    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9gd8x\""
Jul 16 17:30:36.156824 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.156793    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fcd8445f5-w945z"]
Jul 16 17:30:36.190620 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.190584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-secret-metrics-server-client-certs\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.190813 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.190659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-secret-metrics-server-tls\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.190813 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.190728    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.190813 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.190778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-metrics-server-audit-profiles\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.190813 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.190805    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfscc\" (UniqueName: \"kubernetes.io/projected/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-kube-api-access-zfscc\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.191008 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.190834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-client-ca-bundle\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.191008 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.190894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-audit-log\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.263437 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.263390    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:36.272171 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.272140    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"]
Jul 16 17:30:36.274677 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.274613    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"
Jul 16 17:30:36.288722 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:36.288683    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"monitoring-plugin-5f68df7f58-fd2v9\" is forbidden: User \"system:node:ip-10-0-130-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-51.ec2.internal' and this object" podUID="a5f3c3f9-27b1-47b6-b10d-f5e0712993e3" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"
Jul 16 17:30:36.291686 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.291593    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-secret-metrics-server-tls\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.291686 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.291648    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.291686 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.291682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-metrics-server-audit-profiles\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.291943 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.291708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfscc\" (UniqueName: \"kubernetes.io/projected/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-kube-api-access-zfscc\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.291943 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.291765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-client-ca-bundle\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.291943 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.291852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-audit-log\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.292118 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.291951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-secret-metrics-server-client-certs\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.293388 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.292435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-audit-log\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.293388 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.293064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-metrics-server-audit-profiles\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.293388 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.293064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.294979 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.294932    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-client-ca-bundle\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.295331 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.295288    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-secret-metrics-server-client-certs\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.295665 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.295634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-secret-metrics-server-tls\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.300297 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:36.300251    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"monitoring-plugin-cert\" is forbidden: User \"system:node:ip-10-0-130-51.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-51.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" type="*v1.Secret"
Jul 16 17:30:36.300297 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:36.300256    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"monitoring-plugin-dockercfg-qgvcj\" is forbidden: User \"system:node:ip-10-0-130-51.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-51.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qgvcj\"" type="*v1.Secret"
Jul 16 17:30:36.301762 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.301698    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"]
Jul 16 17:30:36.314633 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.314605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfscc\" (UniqueName: \"kubernetes.io/projected/c93d6fdd-8adb-46f7-a131-92deb2f5e01b-kube-api-access-zfscc\") pod \"metrics-server-fcd8445f5-w945z\" (UID: \"c93d6fdd-8adb-46f7-a131-92deb2f5e01b\") " pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.393120 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.393084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5f3c3f9-27b1-47b6-b10d-f5e0712993e3-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-fd2v9\" (UID: \"a5f3c3f9-27b1-47b6-b10d-f5e0712993e3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"
Jul 16 17:30:36.393274 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.393149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lskfc\" (UniqueName: \"kubernetes.io/projected/a5f3c3f9-27b1-47b6-b10d-f5e0712993e3-kube-api-access-lskfc\") pod \"monitoring-plugin-5f68df7f58-fd2v9\" (UID: \"a5f3c3f9-27b1-47b6-b10d-f5e0712993e3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"
Jul 16 17:30:36.442604 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.442576    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:36.474303 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.474266    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:36.493482 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.493437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kk8c" event={"ID":"ea4e2002-477a-48b0-849b-dc3e5ae44c5d","Type":"ContainerStarted","Data":"de29cda6ded81a657c366d02b3c0f2967eb43d9e6caed322f2970737ea536a16"}
Jul 16 17:30:36.494355 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.494020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5f3c3f9-27b1-47b6-b10d-f5e0712993e3-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-fd2v9\" (UID: \"a5f3c3f9-27b1-47b6-b10d-f5e0712993e3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"
Jul 16 17:30:36.494355 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.494110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lskfc\" (UniqueName: \"kubernetes.io/projected/a5f3c3f9-27b1-47b6-b10d-f5e0712993e3-kube-api-access-lskfc\") pod \"monitoring-plugin-5f68df7f58-fd2v9\" (UID: \"a5f3c3f9-27b1-47b6-b10d-f5e0712993e3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"
Jul 16 17:30:36.496545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.496508    2580 generic.go:356] "Generic (PLEG): container finished" podID="19a4230c-9880-4431-85d1-ef15e541ca84" containerID="00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500" exitCode=0
Jul 16 17:30:36.496674 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.496590    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerDied","Data":"00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500"}
Jul 16 17:30:36.499480 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.499451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6" event={"ID":"6ed32354-7dda-4ac3-8624-6a316ef32b79","Type":"ContainerStarted","Data":"699a031ef5bca3991bf793533709fad3ba3e3bd6dfe1ecbee20f306c88a0093a"}
Jul 16 17:30:36.503277 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.503204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6" event={"ID":"73efadef-775a-473c-a521-ba10783dbdc6","Type":"ContainerStarted","Data":"c197250da5ebb801b90609235489f4fed55b227e8f3d2f5cef68adf64a8e0f05"}
Jul 16 17:30:36.507277 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.507252    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lskfc\" (UniqueName: \"kubernetes.io/projected/a5f3c3f9-27b1-47b6-b10d-f5e0712993e3-kube-api-access-lskfc\") pod \"monitoring-plugin-5f68df7f58-fd2v9\" (UID: \"a5f3c3f9-27b1-47b6-b10d-f5e0712993e3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"
Jul 16 17:30:36.508014 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.507581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb" event={"ID":"390538f6-fe92-4a30-b1e2-d818ff7884d0","Type":"ContainerStarted","Data":"c2c33e16a5348d702507151fcaf57c11c1e274e34833e43221f2d54813cfd74d"}
Jul 16 17:30:36.508014 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.507638    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb" event={"ID":"390538f6-fe92-4a30-b1e2-d818ff7884d0","Type":"ContainerStarted","Data":"76a9775651ca0502487f2a079eb05a12404dbdb802e1a2fa41f5e40248a98423"}
Jul 16 17:30:36.508014 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.507667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb" event={"ID":"390538f6-fe92-4a30-b1e2-d818ff7884d0","Type":"ContainerStarted","Data":"f65ddfac1d03f8ffc8672c0e6c63a41cc443d1317ef4a307c299993dfe09a861"}
Jul 16 17:30:36.584975 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.584934    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:36.616482 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.616419    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nrtn6" podStartSLOduration=3.840612477 podStartE2EDuration="5.616394585s" totalImagesPullingTime="1.775782108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:36.57583678 +0000 UTC m=+75.130894242" watchObservedRunningTime="2026-07-16 17:30:36.616394585 +0000 UTC m=+75.171452023"
Jul 16 17:30:36.617355 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.617325    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fcd8445f5-w945z"]
Jul 16 17:30:36.622508 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:36.622475    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93d6fdd_8adb_46f7_a131_92deb2f5e01b.slice/crio-d7670b2acebaf9a73b83fec72dc95ee554c980620c0f26a7f7df6f45f3634a51 WatchSource:0}: Error finding container d7670b2acebaf9a73b83fec72dc95ee554c980620c0f26a7f7df6f45f3634a51: Status 404 returned error can't find the container with id d7670b2acebaf9a73b83fec72dc95ee554c980620c0f26a7f7df6f45f3634a51
Jul 16 17:30:36.796947 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.796913    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:36.875117 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.875056    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-lz5vb" podStartSLOduration=3.772775728 podStartE2EDuration="5.875014595s" totalImagesPullingTime="2.102238867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:36.668052609 +0000 UTC m=+75.223110050" watchObservedRunningTime="2026-07-16 17:30:36.875014595 +0000 UTC m=+75.430072035"
Jul 16 17:30:36.876578 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.876556    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f996c8655-vj8km"]
Jul 16 17:30:36.921901 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.921871    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6497c54bb4-g69z4"]
Jul 16 17:30:36.924623 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.924599    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:36.937689 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:36.937662    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6497c54bb4-g69z4"]
Jul 16 17:30:37.000712 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.000676    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27398f48-9471-4365-b82d-c40511adcccc-console-serving-cert\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.000887 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.000724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27398f48-9471-4365-b82d-c40511adcccc-console-oauth-config\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.000887 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.000767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-oauth-serving-cert\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.000887 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.000828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nhcd\" (UniqueName: \"kubernetes.io/projected/27398f48-9471-4365-b82d-c40511adcccc-kube-api-access-7nhcd\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.000887 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.000859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-service-ca\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.001149 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.000911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-trusted-ca-bundle\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.001149 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.000969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-console-config\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.102330 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.102236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27398f48-9471-4365-b82d-c40511adcccc-console-serving-cert\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.102330 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.102280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27398f48-9471-4365-b82d-c40511adcccc-console-oauth-config\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.102554 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.102397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-oauth-serving-cert\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.102554 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.102430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nhcd\" (UniqueName: \"kubernetes.io/projected/27398f48-9471-4365-b82d-c40511adcccc-kube-api-access-7nhcd\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.102554 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.102462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-service-ca\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.102554 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.102493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-trusted-ca-bundle\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.102554 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.102536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-console-config\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.103313 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.103288    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-oauth-serving-cert\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.103415 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.103313    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-console-config\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.103415 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.103371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-service-ca\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.103632 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.103598    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-trusted-ca-bundle\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.105052 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.105017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27398f48-9471-4365-b82d-c40511adcccc-console-serving-cert\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.105181 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.105162    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27398f48-9471-4365-b82d-c40511adcccc-console-oauth-config\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.115091 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.115062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nhcd\" (UniqueName: \"kubernetes.io/projected/27398f48-9471-4365-b82d-c40511adcccc-kube-api-access-7nhcd\") pod \"console-6497c54bb4-g69z4\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") " pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.198273 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.198238    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qgvcj\""
Jul 16 17:30:37.234052 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.234000    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:37.407476 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.407071    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6497c54bb4-g69z4"]
Jul 16 17:30:37.495195 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:37.495114    2580 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: failed to sync secret cache: timed out waiting for the condition
Jul 16 17:30:37.495384 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:30:37.495219    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5f3c3f9-27b1-47b6-b10d-f5e0712993e3-monitoring-plugin-cert podName:a5f3c3f9-27b1-47b6-b10d-f5e0712993e3 nodeName:}" failed. No retries permitted until 2026-07-16 17:30:37.995196109 +0000 UTC m=+76.550253530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a5f3c3f9-27b1-47b6-b10d-f5e0712993e3-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-fd2v9" (UID: "a5f3c3f9-27b1-47b6-b10d-f5e0712993e3") : failed to sync secret cache: timed out waiting for the condition
Jul 16 17:30:37.516647 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.515878    2580 generic.go:356] "Generic (PLEG): container finished" podID="ea4e2002-477a-48b0-849b-dc3e5ae44c5d" containerID="de29cda6ded81a657c366d02b3c0f2967eb43d9e6caed322f2970737ea536a16" exitCode=0
Jul 16 17:30:37.516647 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.516012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kk8c" event={"ID":"ea4e2002-477a-48b0-849b-dc3e5ae44c5d","Type":"ContainerDied","Data":"de29cda6ded81a657c366d02b3c0f2967eb43d9e6caed322f2970737ea536a16"}
Jul 16 17:30:37.518101 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.518022    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fcd8445f5-w945z" event={"ID":"c93d6fdd-8adb-46f7-a131-92deb2f5e01b","Type":"ContainerStarted","Data":"d7670b2acebaf9a73b83fec72dc95ee554c980620c0f26a7f7df6f45f3634a51"}
Jul 16 17:30:37.749382 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:37.749346    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 16 17:30:38.013088 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.012991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5f3c3f9-27b1-47b6-b10d-f5e0712993e3-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-fd2v9\" (UID: \"a5f3c3f9-27b1-47b6-b10d-f5e0712993e3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"
Jul 16 17:30:38.015894 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.015838    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5f3c3f9-27b1-47b6-b10d-f5e0712993e3-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-fd2v9\" (UID: \"a5f3c3f9-27b1-47b6-b10d-f5e0712993e3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"
Jul 16 17:30:38.032080 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.032046    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 17:30:38.036118 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.036090    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.042966 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.042941    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 16 17:30:38.043143 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.043027    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 16 17:30:38.043143 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.043122    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7zrdd\""
Jul 16 17:30:38.043782 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.043706    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 16 17:30:38.043921 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.043805    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 16 17:30:38.043921 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.043912    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 16 17:30:38.049421 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.049381    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 16 17:30:38.049743 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.049656    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 16 17:30:38.049836 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.049818    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 16 17:30:38.049959 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.049927    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 16 17:30:38.050216 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.050126    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 16 17:30:38.050216 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.050175    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 16 17:30:38.050595 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.050467    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 16 17:30:38.050595 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.050509    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fqui9kic4dgn1\""
Jul 16 17:30:38.050744 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.050596    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 16 17:30:38.050744 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.050663    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 16 17:30:38.066744 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.066675    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 17:30:38.087193 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.087106    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"
Jul 16 17:30:38.114739 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.114657    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbe49c00-cb48-4a89-8576-911eafbfb651-config-out\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.114907 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.114749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbe49c00-cb48-4a89-8576-911eafbfb651-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.114907 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.114806    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.114907 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.114846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-web-config\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.114907 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.114874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.114907 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.114903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.115224 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.114942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.115224 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.115061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.115510 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.115484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghdpk\" (UniqueName: \"kubernetes.io/projected/fbe49c00-cb48-4a89-8576-911eafbfb651-kube-api-access-ghdpk\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.115625 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.115569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.115625 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.115610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.115749 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.115658    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.115749 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.115692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.115749 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.115726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.119565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.115894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.119565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.115933    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.119565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.115975    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.119565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.116006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-config\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.119565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.116063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.119565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.116097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217269 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbe49c00-cb48-4a89-8576-911eafbfb651-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217269 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217271    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217527 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-web-config\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217527 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217330    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217527 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217527 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217527 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217527 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghdpk\" (UniqueName: \"kubernetes.io/projected/fbe49c00-cb48-4a89-8576-911eafbfb651-kube-api-access-ghdpk\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217527 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217527 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217908 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217908 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217908 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217908 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217908 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217908 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217908 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-config\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217908 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.217908 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.217809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.218494 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.218466    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbe49c00-cb48-4a89-8576-911eafbfb651-config-out\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.221491 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.218592    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.221491 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.219293    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.221491 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.219872    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.221491 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.220277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.221491 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.221432    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.221909 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.221706    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.222300 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.222255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbe49c00-cb48-4a89-8576-911eafbfb651-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.222606 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.222570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.222606 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.222581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.222729 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.222605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.222957 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.222908    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.225175 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.225072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.225175 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.225087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.226499 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.226441    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-config\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.226854 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.226833    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.226952 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.226863    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.227165 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.227135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.227335 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.227308    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbe49c00-cb48-4a89-8576-911eafbfb651-config-out\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.227651 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.227632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-web-config\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.229900 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.229879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghdpk\" (UniqueName: \"kubernetes.io/projected/fbe49c00-cb48-4a89-8576-911eafbfb651-kube-api-access-ghdpk\") pod \"prometheus-k8s-0\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.351524 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.351433    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:38.496890 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.496830    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:38.523547 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.523514    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6497c54bb4-g69z4" event={"ID":"27398f48-9471-4365-b82d-c40511adcccc","Type":"ContainerStarted","Data":"828d9f38cc0d36196e2047793a643baab43ad286d5b1c2f6a0606085e9747c24"}
Jul 16 17:30:38.574677 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:38.574634    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:39.008771 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.008741    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"]
Jul 16 17:30:39.023529 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:39.022799    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f3c3f9_27b1_47b6_b10d_f5e0712993e3.slice/crio-84dc8b30c85797edd9fe7fd2d7b3d045d9c91c928d6aa6b2ff161013499e7628 WatchSource:0}: Error finding container 84dc8b30c85797edd9fe7fd2d7b3d045d9c91c928d6aa6b2ff161013499e7628: Status 404 returned error can't find the container with id 84dc8b30c85797edd9fe7fd2d7b3d045d9c91c928d6aa6b2ff161013499e7628
Jul 16 17:30:39.056982 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.056957    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 17:30:39.059863 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:30:39.059834    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe49c00_cb48_4a89_8576_911eafbfb651.slice/crio-938676cc72a476833c213e3487e578deb7526e5156afadc26a7543166b3f682e WatchSource:0}: Error finding container 938676cc72a476833c213e3487e578deb7526e5156afadc26a7543166b3f682e: Status 404 returned error can't find the container with id 938676cc72a476833c213e3487e578deb7526e5156afadc26a7543166b3f682e
Jul 16 17:30:39.188810 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.188776    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:39.287959 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.287928    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:39.529879 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.529841    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kk8c" event={"ID":"ea4e2002-477a-48b0-849b-dc3e5ae44c5d","Type":"ContainerStarted","Data":"00debbf8ff2cf7270bb98a0caea7bb0cc568a0c26dc35b27423b3d491b539c77"}
Jul 16 17:30:39.530101 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.529896    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kk8c" event={"ID":"ea4e2002-477a-48b0-849b-dc3e5ae44c5d","Type":"ContainerStarted","Data":"03f7f655655eff8c7060ed0c41cb4ac84d62420b17b64f3c3740988e9ed9ff0a"}
Jul 16 17:30:39.537415 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.537381    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerStarted","Data":"3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c"}
Jul 16 17:30:39.537553 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.537495    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerStarted","Data":"3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291"}
Jul 16 17:30:39.537553 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.537540    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerStarted","Data":"d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1"}
Jul 16 17:30:39.537640 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.537578    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerStarted","Data":"88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651"}
Jul 16 17:30:39.537640 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.537616    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerStarted","Data":"238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b"}
Jul 16 17:30:39.538781 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.538757    2580 generic.go:356] "Generic (PLEG): container finished" podID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerID="ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1" exitCode=0
Jul 16 17:30:39.538903 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.538825    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerDied","Data":"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"}
Jul 16 17:30:39.538903 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.538866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerStarted","Data":"938676cc72a476833c213e3487e578deb7526e5156afadc26a7543166b3f682e"}
Jul 16 17:30:39.541174 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.541147    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6" event={"ID":"6ed32354-7dda-4ac3-8624-6a316ef32b79","Type":"ContainerStarted","Data":"630d6381d4e87f1a22ae4de413da284c67a2b3c15f12714aa2284d4a1f0e6054"}
Jul 16 17:30:39.541281 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.541213    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6" event={"ID":"6ed32354-7dda-4ac3-8624-6a316ef32b79","Type":"ContainerStarted","Data":"f154008d40893ce925f6876b79250c3f25be3ad2ce470ccfc9866f80a7f13360"}
Jul 16 17:30:39.541281 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.541256    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6" event={"ID":"6ed32354-7dda-4ac3-8624-6a316ef32b79","Type":"ContainerStarted","Data":"d2b6e11b4b56ff6ff22e18d81b6058831a1dc17d39c02ae8627ffab25323c900"}
Jul 16 17:30:39.542793 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.542766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6497c54bb4-g69z4" event={"ID":"27398f48-9471-4365-b82d-c40511adcccc","Type":"ContainerStarted","Data":"ea412ab58a5bcb1b8ab68edba867a019235833af95680916d9c1f85927a4d46e"}
Jul 16 17:30:39.544385 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.544366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fcd8445f5-w945z" event={"ID":"c93d6fdd-8adb-46f7-a131-92deb2f5e01b","Type":"ContainerStarted","Data":"77c7650214ae987db1b69d4dc140cba3706a8b13354425c3ec33f3b8dfc36e71"}
Jul 16 17:30:39.545963 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.545944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9" event={"ID":"a5f3c3f9-27b1-47b6-b10d-f5e0712993e3","Type":"ContainerStarted","Data":"84dc8b30c85797edd9fe7fd2d7b3d045d9c91c928d6aa6b2ff161013499e7628"}
Jul 16 17:30:39.565966 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.565906    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5kk8c" podStartSLOduration=5.482294412 podStartE2EDuration="8.565886889s" totalImagesPullingTime="3.003451248s" totalInitContainerRuntime="80.141229ms" isStatefulPod=true podCreationTimestamp="2026-07-16 17:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:39.564525569 +0000 UTC m=+78.119583006" watchObservedRunningTime="2026-07-16 17:30:39.565886889 +0000 UTC m=+78.120944331"
Jul 16 17:30:39.651438 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.651387    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-fcd8445f5-w945z" podStartSLOduration=1.460238474 podStartE2EDuration="3.651371634s" totalImagesPullingTime="2.19113316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:39.650462007 +0000 UTC m=+78.205519464" watchObservedRunningTime="2026-07-16 17:30:39.651371634 +0000 UTC m=+78.206429070"
Jul 16 17:30:39.693962 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.693909    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6497c54bb4-g69z4" podStartSLOduration=3.693893677 podStartE2EDuration="3.693893677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:39.692757237 +0000 UTC m=+78.247814673" watchObservedRunningTime="2026-07-16 17:30:39.693893677 +0000 UTC m=+78.248951092"
Jul 16 17:30:39.959347 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:39.959307    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:30:40.560601 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:40.560496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerStarted","Data":"d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad"}
Jul 16 17:30:40.563823 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:40.563784    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6" event={"ID":"6ed32354-7dda-4ac3-8624-6a316ef32b79","Type":"ContainerStarted","Data":"ca1031f08ef178affbc4070f74c8c1e2cd2ca970be9c26dfd9d12d8e6500a17f"}
Jul 16 17:30:40.563955 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:40.563860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6" event={"ID":"6ed32354-7dda-4ac3-8624-6a316ef32b79","Type":"ContainerStarted","Data":"929eec94d819a2b45cd0556e89ef82ecb4c9d48bf24e1e11b2b1571c54af1045"}
Jul 16 17:30:40.563955 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:40.563904    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6" event={"ID":"6ed32354-7dda-4ac3-8624-6a316ef32b79","Type":"ContainerStarted","Data":"923c8e53eb750c8c62ea590bd9be1466b5a512315175a653ccafccc93cbadcde"}
Jul 16 17:30:40.596897 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:40.596831    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.4789858750000002 podStartE2EDuration="8.59680903s" totalImagesPullingTime="5.090248306s" totalInitContainerRuntime="27.574849ms" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:40.594872506 +0000 UTC m=+79.149929945" watchObservedRunningTime="2026-07-16 17:30:40.59680903 +0000 UTC m=+79.151866469"
Jul 16 17:30:40.623269 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:40.623213    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6" podStartSLOduration=2.4157328209999998 podStartE2EDuration="6.623191038s" totalImagesPullingTime="4.207458217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:40.619964284 +0000 UTC m=+79.175021721" watchObservedRunningTime="2026-07-16 17:30:40.623191038 +0000 UTC m=+79.178248476"
Jul 16 17:30:41.569362 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:41.569326    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:41.902993 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:41.902895    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:42.574942 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:42.574902    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9" event={"ID":"a5f3c3f9-27b1-47b6-b10d-f5e0712993e3","Type":"ContainerStarted","Data":"f9070cab8a1ed50b738e28529fc4f26095781d95553e0cfe68414d9bfd1120e0"}
Jul 16 17:30:42.575367 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:42.575267    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"
Jul 16 17:30:42.585912 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:42.585861    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9"
Jul 16 17:30:42.596294 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:42.596246    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fd2v9" podStartSLOduration=3.233927038 podStartE2EDuration="6.596230198s" totalImagesPullingTime="3.36230316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:42.595983281 +0000 UTC m=+81.151040722" watchObservedRunningTime="2026-07-16 17:30:42.596230198 +0000 UTC m=+81.151287635"
Jul 16 17:30:43.414937 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:43.412914    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:43.520064 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:43.520009    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:45.591610 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:45.591570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerStarted","Data":"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"}
Jul 16 17:30:45.592100 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:45.591696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerStarted","Data":"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"}
Jul 16 17:30:45.592100 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:45.591741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerStarted","Data":"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"}
Jul 16 17:30:45.592100 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:45.591784    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerStarted","Data":"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"}
Jul 16 17:30:45.592100 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:45.591820    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerStarted","Data":"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"}
Jul 16 17:30:45.592100 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:45.591861    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerStarted","Data":"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"}
Jul 16 17:30:45.633488 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:45.633373    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.035142631 podStartE2EDuration="8.633351394s" totalImagesPullingTime="5.571971155s" totalInitContainerRuntime="26.237608ms" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:45.63122389 +0000 UTC m=+84.186281346" watchObservedRunningTime="2026-07-16 17:30:45.633351394 +0000 UTC m=+84.188408834"
Jul 16 17:30:46.342492 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:46.342449    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:46.442551 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:46.442510    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:47.234446 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:47.234411    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:47.234883 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:47.234500    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:47.239292 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:47.239273    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:47.581264 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:47.581193    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7dcbd4c656-jx5f6"
Jul 16 17:30:47.603399 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:47.603369    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:30:47.717970 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:47.717934    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77657ffcc5-x5fkp"]
Jul 16 17:30:47.960945 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:47.960912    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:48.131545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:48.131511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:48.352341 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:48.352261    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:30:49.215304 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:49.215266    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:49.442585 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:49.442549    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:51.375988 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:51.375952    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:51.476758 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:51.476726    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:52.339212 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:52.339179    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:52.473932 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:52.473895    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:53.087248 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:53.087203    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:53.213998 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:53.213967    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:53.582769 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:53.582731    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:56.443075 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:56.443024    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:56.443450 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:56.443123    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:30:56.899277 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:56.899239    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:30:56.998991 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:30:56.998956    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:31:01.901051 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:01.901000    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f996c8655-vj8km" podUID="3d68c657-a237-47d4-9154-d0577f9e002e" containerName="console" containerID="cri-o://20353943eb137aa598557f50021e40106a10c357eeb769782ec8df462c7192b8" gracePeriod=15
Jul 16 17:31:02.666088 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.666052    2580 generic.go:356] "Generic (PLEG): container finished" podID="3d68c657-a237-47d4-9154-d0577f9e002e" containerID="20353943eb137aa598557f50021e40106a10c357eeb769782ec8df462c7192b8" exitCode=0
Jul 16 17:31:02.666088 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.666075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f996c8655-vj8km" event={"ID":"3d68c657-a237-47d4-9154-d0577f9e002e","Type":"ContainerDied","Data":"20353943eb137aa598557f50021e40106a10c357eeb769782ec8df462c7192b8"}
Jul 16 17:31:02.666275 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.666126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f996c8655-vj8km" event={"ID":"3d68c657-a237-47d4-9154-d0577f9e002e","Type":"ContainerDied","Data":"1892d5beee425002d718f2c86efd19d7fea832f7de611719f37c7df44be965f6"}
Jul 16 17:31:02.666275 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.666142    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1892d5beee425002d718f2c86efd19d7fea832f7de611719f37c7df44be965f6"
Jul 16 17:31:02.684125 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.684092    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:31:02.748024 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.747989    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjwgs\" (UniqueName: \"kubernetes.io/projected/3d68c657-a237-47d4-9154-d0577f9e002e-kube-api-access-gjwgs\") pod \"3d68c657-a237-47d4-9154-d0577f9e002e\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") "
Jul 16 17:31:02.748206 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.748053    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d68c657-a237-47d4-9154-d0577f9e002e-console-oauth-config\") pod \"3d68c657-a237-47d4-9154-d0577f9e002e\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") "
Jul 16 17:31:02.748206 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.748075    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-console-config\") pod \"3d68c657-a237-47d4-9154-d0577f9e002e\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") "
Jul 16 17:31:02.748206 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.748129    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-trusted-ca-bundle\") pod \"3d68c657-a237-47d4-9154-d0577f9e002e\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") "
Jul 16 17:31:02.748206 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.748156    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d68c657-a237-47d4-9154-d0577f9e002e-console-serving-cert\") pod \"3d68c657-a237-47d4-9154-d0577f9e002e\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") "
Jul 16 17:31:02.748206 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.748204    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-service-ca\") pod \"3d68c657-a237-47d4-9154-d0577f9e002e\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") "
Jul 16 17:31:02.748525 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.748229    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-oauth-serving-cert\") pod \"3d68c657-a237-47d4-9154-d0577f9e002e\" (UID: \"3d68c657-a237-47d4-9154-d0577f9e002e\") "
Jul 16 17:31:02.748596 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.748558    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-console-config" (OuterVolumeSpecName: "console-config") pod "3d68c657-a237-47d4-9154-d0577f9e002e" (UID: "3d68c657-a237-47d4-9154-d0577f9e002e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:02.748596 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.748577    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3d68c657-a237-47d4-9154-d0577f9e002e" (UID: "3d68c657-a237-47d4-9154-d0577f9e002e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:02.748746 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.748635    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d68c657-a237-47d4-9154-d0577f9e002e" (UID: "3d68c657-a237-47d4-9154-d0577f9e002e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:02.748802 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.748761    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d68c657-a237-47d4-9154-d0577f9e002e" (UID: "3d68c657-a237-47d4-9154-d0577f9e002e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:02.750626 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.750592    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d68c657-a237-47d4-9154-d0577f9e002e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d68c657-a237-47d4-9154-d0577f9e002e" (UID: "3d68c657-a237-47d4-9154-d0577f9e002e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:02.750802 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.750780    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d68c657-a237-47d4-9154-d0577f9e002e-kube-api-access-gjwgs" (OuterVolumeSpecName: "kube-api-access-gjwgs") pod "3d68c657-a237-47d4-9154-d0577f9e002e" (UID: "3d68c657-a237-47d4-9154-d0577f9e002e"). InnerVolumeSpecName "kube-api-access-gjwgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:31:02.750859 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.750790    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d68c657-a237-47d4-9154-d0577f9e002e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d68c657-a237-47d4-9154-d0577f9e002e" (UID: "3d68c657-a237-47d4-9154-d0577f9e002e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:02.849320 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.849218    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-service-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:02.849320 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.849255    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-oauth-serving-cert\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:02.849320 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.849264    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjwgs\" (UniqueName: \"kubernetes.io/projected/3d68c657-a237-47d4-9154-d0577f9e002e-kube-api-access-gjwgs\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:02.849320 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.849274    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d68c657-a237-47d4-9154-d0577f9e002e-console-oauth-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:02.849320 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.849282    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-console-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:02.849320 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.849292    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d68c657-a237-47d4-9154-d0577f9e002e-trusted-ca-bundle\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:02.849320 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:02.849302    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d68c657-a237-47d4-9154-d0577f9e002e-console-serving-cert\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:03.671350 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:03.671318    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f996c8655-vj8km"
Jul 16 17:31:03.695704 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:03.695665    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f996c8655-vj8km"]
Jul 16 17:31:03.701717 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:03.701691    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f996c8655-vj8km"]
Jul 16 17:31:03.965677 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:03.965644    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d68c657-a237-47d4-9154-d0577f9e002e" path="/var/lib/kubelet/pods/3d68c657-a237-47d4-9154-d0577f9e002e/volumes"
Jul 16 17:31:05.487553 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:05.487524    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7lq4t"
Jul 16 17:31:11.967266 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:11.967231    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:31:12.747308 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:12.747267    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77657ffcc5-x5fkp" podUID="24857346-526d-467b-858e-dda2cbab4615" containerName="console" containerID="cri-o://179f0d9f4f0ae9c56d013e93aec2c833cd70fd08d74fa47ece3f040df5432926" gracePeriod=15
Jul 16 17:31:13.010401 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.010379    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:31:13.148933 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.148894    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h7d2\" (UniqueName: \"kubernetes.io/projected/24857346-526d-467b-858e-dda2cbab4615-kube-api-access-7h7d2\") pod \"24857346-526d-467b-858e-dda2cbab4615\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") "
Jul 16 17:31:13.149121 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.148966    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24857346-526d-467b-858e-dda2cbab4615-console-oauth-config\") pod \"24857346-526d-467b-858e-dda2cbab4615\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") "
Jul 16 17:31:13.149121 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.149017    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-oauth-serving-cert\") pod \"24857346-526d-467b-858e-dda2cbab4615\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") "
Jul 16 17:31:13.149121 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.149077    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-service-ca\") pod \"24857346-526d-467b-858e-dda2cbab4615\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") "
Jul 16 17:31:13.149121 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.149117    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24857346-526d-467b-858e-dda2cbab4615-console-serving-cert\") pod \"24857346-526d-467b-858e-dda2cbab4615\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") "
Jul 16 17:31:13.149331 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.149144    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-console-config\") pod \"24857346-526d-467b-858e-dda2cbab4615\" (UID: \"24857346-526d-467b-858e-dda2cbab4615\") "
Jul 16 17:31:13.149477 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.149446    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-service-ca" (OuterVolumeSpecName: "service-ca") pod "24857346-526d-467b-858e-dda2cbab4615" (UID: "24857346-526d-467b-858e-dda2cbab4615"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:13.149545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.149452    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "24857346-526d-467b-858e-dda2cbab4615" (UID: "24857346-526d-467b-858e-dda2cbab4615"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:13.149545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.149498    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-console-config" (OuterVolumeSpecName: "console-config") pod "24857346-526d-467b-858e-dda2cbab4615" (UID: "24857346-526d-467b-858e-dda2cbab4615"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:13.151303 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.151276    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24857346-526d-467b-858e-dda2cbab4615-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "24857346-526d-467b-858e-dda2cbab4615" (UID: "24857346-526d-467b-858e-dda2cbab4615"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:13.151398 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.151279    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24857346-526d-467b-858e-dda2cbab4615-kube-api-access-7h7d2" (OuterVolumeSpecName: "kube-api-access-7h7d2") pod "24857346-526d-467b-858e-dda2cbab4615" (UID: "24857346-526d-467b-858e-dda2cbab4615"). InnerVolumeSpecName "kube-api-access-7h7d2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:31:13.151398 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.151353    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24857346-526d-467b-858e-dda2cbab4615-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "24857346-526d-467b-858e-dda2cbab4615" (UID: "24857346-526d-467b-858e-dda2cbab4615"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:13.250625 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.250511    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24857346-526d-467b-858e-dda2cbab4615-console-serving-cert\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:13.250625 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.250557    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-console-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:13.250625 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.250570    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h7d2\" (UniqueName: \"kubernetes.io/projected/24857346-526d-467b-858e-dda2cbab4615-kube-api-access-7h7d2\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:13.250625 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.250586    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24857346-526d-467b-858e-dda2cbab4615-console-oauth-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:13.250625 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.250598    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-oauth-serving-cert\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:13.250625 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.250611    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24857346-526d-467b-858e-dda2cbab4615-service-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:13.717767 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.717735    2580 generic.go:356] "Generic (PLEG): container finished" podID="24857346-526d-467b-858e-dda2cbab4615" containerID="179f0d9f4f0ae9c56d013e93aec2c833cd70fd08d74fa47ece3f040df5432926" exitCode=0
Jul 16 17:31:13.717927 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.717782    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77657ffcc5-x5fkp"
Jul 16 17:31:13.717927 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.717822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77657ffcc5-x5fkp" event={"ID":"24857346-526d-467b-858e-dda2cbab4615","Type":"ContainerDied","Data":"179f0d9f4f0ae9c56d013e93aec2c833cd70fd08d74fa47ece3f040df5432926"}
Jul 16 17:31:13.717927 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.717872    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77657ffcc5-x5fkp" event={"ID":"24857346-526d-467b-858e-dda2cbab4615","Type":"ContainerDied","Data":"1458303bf8cb2e4584cafa10512d77dfacf449a3a2bfa7ecdf616240d80195d4"}
Jul 16 17:31:13.717927 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.717894    2580 scope.go:117] "RemoveContainer" containerID="179f0d9f4f0ae9c56d013e93aec2c833cd70fd08d74fa47ece3f040df5432926"
Jul 16 17:31:13.727897 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.727879    2580 scope.go:117] "RemoveContainer" containerID="179f0d9f4f0ae9c56d013e93aec2c833cd70fd08d74fa47ece3f040df5432926"
Jul 16 17:31:13.728192 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:13.728172    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"179f0d9f4f0ae9c56d013e93aec2c833cd70fd08d74fa47ece3f040df5432926\": container with ID starting with 179f0d9f4f0ae9c56d013e93aec2c833cd70fd08d74fa47ece3f040df5432926 not found: ID does not exist" containerID="179f0d9f4f0ae9c56d013e93aec2c833cd70fd08d74fa47ece3f040df5432926"
Jul 16 17:31:13.728253 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.728203    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"179f0d9f4f0ae9c56d013e93aec2c833cd70fd08d74fa47ece3f040df5432926"} err="failed to get container status \"179f0d9f4f0ae9c56d013e93aec2c833cd70fd08d74fa47ece3f040df5432926\": rpc error: code = NotFound desc = could not find container \"179f0d9f4f0ae9c56d013e93aec2c833cd70fd08d74fa47ece3f040df5432926\": container with ID starting with 179f0d9f4f0ae9c56d013e93aec2c833cd70fd08d74fa47ece3f040df5432926 not found: ID does not exist"
Jul 16 17:31:13.743226 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.743204    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77657ffcc5-x5fkp"]
Jul 16 17:31:13.748713 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.748691    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77657ffcc5-x5fkp"]
Jul 16 17:31:13.805727 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.805702    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:31:13.965421 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:13.965390    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24857346-526d-467b-858e-dda2cbab4615" path="/var/lib/kubelet/pods/24857346-526d-467b-858e-dda2cbab4615/volumes"
Jul 16 17:31:16.448422 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:16.448390    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:31:16.452418 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:16.452400    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-fcd8445f5-w945z"
Jul 16 17:31:24.410452 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:24.410411    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:31:24.507275 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:24.507239    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:31:27.206380 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:27.206347    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:31:38.352007 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:38.351963    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:38.375664 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:38.375630    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:38.845930 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:38.845900    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:51.029919 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:51.029878    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:31:51.332875 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:51.332783    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:31:52.094703 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.094671    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 17:31:52.095122 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.094952    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="alertmanager" containerID="cri-o://238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b" gracePeriod=120
Jul 16 17:31:52.095122 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.095061    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="kube-rbac-proxy-metric" containerID="cri-o://3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c" gracePeriod=120
Jul 16 17:31:52.095262 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.095093    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="kube-rbac-proxy-web" containerID="cri-o://d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1" gracePeriod=120
Jul 16 17:31:52.095262 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.095126    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="prom-label-proxy" containerID="cri-o://d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad" gracePeriod=120
Jul 16 17:31:52.095262 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.095150    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="config-reloader" containerID="cri-o://88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651" gracePeriod=120
Jul 16 17:31:52.095419 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.095294    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="kube-rbac-proxy" containerID="cri-o://3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291" gracePeriod=120
Jul 16 17:31:52.891917 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.891883    2580 generic.go:356] "Generic (PLEG): container finished" podID="19a4230c-9880-4431-85d1-ef15e541ca84" containerID="d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad" exitCode=0
Jul 16 17:31:52.891917 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.891909    2580 generic.go:356] "Generic (PLEG): container finished" podID="19a4230c-9880-4431-85d1-ef15e541ca84" containerID="3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291" exitCode=0
Jul 16 17:31:52.891917 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.891915    2580 generic.go:356] "Generic (PLEG): container finished" podID="19a4230c-9880-4431-85d1-ef15e541ca84" containerID="88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651" exitCode=0
Jul 16 17:31:52.891917 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.891921    2580 generic.go:356] "Generic (PLEG): container finished" podID="19a4230c-9880-4431-85d1-ef15e541ca84" containerID="238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b" exitCode=0
Jul 16 17:31:52.892266 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.891950    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerDied","Data":"d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad"}
Jul 16 17:31:52.892266 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.892051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerDied","Data":"3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291"}
Jul 16 17:31:52.892266 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.892082    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerDied","Data":"88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651"}
Jul 16 17:31:52.892266 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:52.892106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerDied","Data":"238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b"}
Jul 16 17:31:53.338022 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.338000    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:53.417508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417422    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy-web\") pod \"19a4230c-9880-4431-85d1-ef15e541ca84\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") "
Jul 16 17:31:53.417508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417479    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy\") pod \"19a4230c-9880-4431-85d1-ef15e541ca84\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") "
Jul 16 17:31:53.417508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417506    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19a4230c-9880-4431-85d1-ef15e541ca84-alertmanager-trusted-ca-bundle\") pod \"19a4230c-9880-4431-85d1-ef15e541ca84\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") "
Jul 16 17:31:53.417768 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417550    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/19a4230c-9880-4431-85d1-ef15e541ca84-config-out\") pod \"19a4230c-9880-4431-85d1-ef15e541ca84\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") "
Jul 16 17:31:53.417768 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417592    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-web-config\") pod \"19a4230c-9880-4431-85d1-ef15e541ca84\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") "
Jul 16 17:31:53.417768 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417618    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-cluster-tls-config\") pod \"19a4230c-9880-4431-85d1-ef15e541ca84\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") "
Jul 16 17:31:53.417768 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417648    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19a4230c-9880-4431-85d1-ef15e541ca84-metrics-client-ca\") pod \"19a4230c-9880-4431-85d1-ef15e541ca84\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") "
Jul 16 17:31:53.417768 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417672    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8rks\" (UniqueName: \"kubernetes.io/projected/19a4230c-9880-4431-85d1-ef15e541ca84-kube-api-access-s8rks\") pod \"19a4230c-9880-4431-85d1-ef15e541ca84\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") "
Jul 16 17:31:53.417768 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417697    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-main-tls\") pod \"19a4230c-9880-4431-85d1-ef15e541ca84\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") "
Jul 16 17:31:53.417768 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417749    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/19a4230c-9880-4431-85d1-ef15e541ca84-alertmanager-main-db\") pod \"19a4230c-9880-4431-85d1-ef15e541ca84\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") "
Jul 16 17:31:53.418228 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417786    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy-metric\") pod \"19a4230c-9880-4431-85d1-ef15e541ca84\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") "
Jul 16 17:31:53.418228 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417810    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-config-volume\") pod \"19a4230c-9880-4431-85d1-ef15e541ca84\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") "
Jul 16 17:31:53.418228 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417857    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/19a4230c-9880-4431-85d1-ef15e541ca84-tls-assets\") pod \"19a4230c-9880-4431-85d1-ef15e541ca84\" (UID: \"19a4230c-9880-4431-85d1-ef15e541ca84\") "
Jul 16 17:31:53.418228 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.417918    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19a4230c-9880-4431-85d1-ef15e541ca84-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "19a4230c-9880-4431-85d1-ef15e541ca84" (UID: "19a4230c-9880-4431-85d1-ef15e541ca84"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:53.418228 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.418180    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19a4230c-9880-4431-85d1-ef15e541ca84-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:53.418492 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.418467    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a4230c-9880-4431-85d1-ef15e541ca84-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "19a4230c-9880-4431-85d1-ef15e541ca84" (UID: "19a4230c-9880-4431-85d1-ef15e541ca84"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:31:53.418831 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.418736    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19a4230c-9880-4431-85d1-ef15e541ca84-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "19a4230c-9880-4431-85d1-ef15e541ca84" (UID: "19a4230c-9880-4431-85d1-ef15e541ca84"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:53.421655 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.421614    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "19a4230c-9880-4431-85d1-ef15e541ca84" (UID: "19a4230c-9880-4431-85d1-ef15e541ca84"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:53.422544 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.422392    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a4230c-9880-4431-85d1-ef15e541ca84-config-out" (OuterVolumeSpecName: "config-out") pod "19a4230c-9880-4431-85d1-ef15e541ca84" (UID: "19a4230c-9880-4431-85d1-ef15e541ca84"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:31:53.422544 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.422466    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "19a4230c-9880-4431-85d1-ef15e541ca84" (UID: "19a4230c-9880-4431-85d1-ef15e541ca84"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:53.422697 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.422645    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-config-volume" (OuterVolumeSpecName: "config-volume") pod "19a4230c-9880-4431-85d1-ef15e541ca84" (UID: "19a4230c-9880-4431-85d1-ef15e541ca84"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:53.422782 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.422405    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a4230c-9880-4431-85d1-ef15e541ca84-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "19a4230c-9880-4431-85d1-ef15e541ca84" (UID: "19a4230c-9880-4431-85d1-ef15e541ca84"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:31:53.422904 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.422828    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "19a4230c-9880-4431-85d1-ef15e541ca84" (UID: "19a4230c-9880-4431-85d1-ef15e541ca84"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:53.422973 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.422941    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "19a4230c-9880-4431-85d1-ef15e541ca84" (UID: "19a4230c-9880-4431-85d1-ef15e541ca84"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:53.423250 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.423233    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a4230c-9880-4431-85d1-ef15e541ca84-kube-api-access-s8rks" (OuterVolumeSpecName: "kube-api-access-s8rks") pod "19a4230c-9880-4431-85d1-ef15e541ca84" (UID: "19a4230c-9880-4431-85d1-ef15e541ca84"). InnerVolumeSpecName "kube-api-access-s8rks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:31:53.426785 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.426761    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "19a4230c-9880-4431-85d1-ef15e541ca84" (UID: "19a4230c-9880-4431-85d1-ef15e541ca84"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:53.433764 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.433741    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-web-config" (OuterVolumeSpecName: "web-config") pod "19a4230c-9880-4431-85d1-ef15e541ca84" (UID: "19a4230c-9880-4431-85d1-ef15e541ca84"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:53.518938 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.518898    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-web-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:53.518938 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.518930    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-cluster-tls-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:53.518938 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.518940    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19a4230c-9880-4431-85d1-ef15e541ca84-metrics-client-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:53.519189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.518951    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8rks\" (UniqueName: \"kubernetes.io/projected/19a4230c-9880-4431-85d1-ef15e541ca84-kube-api-access-s8rks\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:53.519189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.518960    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-main-tls\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:53.519189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.518969    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/19a4230c-9880-4431-85d1-ef15e541ca84-alertmanager-main-db\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:53.519189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.518978    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:53.519189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.518988    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-config-volume\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:53.519189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.518998    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/19a4230c-9880-4431-85d1-ef15e541ca84-tls-assets\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:53.519189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.519006    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:53.519189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.519014    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19a4230c-9880-4431-85d1-ef15e541ca84-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:53.519189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.519024    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/19a4230c-9880-4431-85d1-ef15e541ca84-config-out\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:53.899256 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.899223    2580 generic.go:356] "Generic (PLEG): container finished" podID="19a4230c-9880-4431-85d1-ef15e541ca84" containerID="3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c" exitCode=0
Jul 16 17:31:53.899256 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.899248    2580 generic.go:356] "Generic (PLEG): container finished" podID="19a4230c-9880-4431-85d1-ef15e541ca84" containerID="d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1" exitCode=0
Jul 16 17:31:53.899452 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.899298    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerDied","Data":"3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c"}
Jul 16 17:31:53.899452 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.899369    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerDied","Data":"d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1"}
Jul 16 17:31:53.899452 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.899306    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:53.899452 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.899404    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19a4230c-9880-4431-85d1-ef15e541ca84","Type":"ContainerDied","Data":"dd429a60856334da081555ab342662263b9cb152c2816dbf000859be9fa7974c"}
Jul 16 17:31:53.899452 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.899436    2580 scope.go:117] "RemoveContainer" containerID="d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad"
Jul 16 17:31:53.907843 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.907823    2580 scope.go:117] "RemoveContainer" containerID="3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c"
Jul 16 17:31:53.914794 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.914771    2580 scope.go:117] "RemoveContainer" containerID="3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291"
Jul 16 17:31:53.921594 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.921576    2580 scope.go:117] "RemoveContainer" containerID="d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1"
Jul 16 17:31:53.925700 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.925674    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 17:31:53.929146 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.929129    2580 scope.go:117] "RemoveContainer" containerID="88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651"
Jul 16 17:31:53.932227 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.932203    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 17:31:53.937121 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.937105    2580 scope.go:117] "RemoveContainer" containerID="238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b"
Jul 16 17:31:53.944083 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.944063    2580 scope.go:117] "RemoveContainer" containerID="00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500"
Jul 16 17:31:53.952232 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.952214    2580 scope.go:117] "RemoveContainer" containerID="d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad"
Jul 16 17:31:53.952561 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:53.952526    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad\": container with ID starting with d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad not found: ID does not exist" containerID="d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad"
Jul 16 17:31:53.952674 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.952572    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad"} err="failed to get container status \"d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad\": rpc error: code = NotFound desc = could not find container \"d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad\": container with ID starting with d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad not found: ID does not exist"
Jul 16 17:31:53.952674 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.952599    2580 scope.go:117] "RemoveContainer" containerID="3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c"
Jul 16 17:31:53.953204 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:53.952963    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c\": container with ID starting with 3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c not found: ID does not exist" containerID="3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c"
Jul 16 17:31:53.953204 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.953020    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c"} err="failed to get container status \"3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c\": rpc error: code = NotFound desc = could not find container \"3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c\": container with ID starting with 3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c not found: ID does not exist"
Jul 16 17:31:53.953204 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.953083    2580 scope.go:117] "RemoveContainer" containerID="3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291"
Jul 16 17:31:53.953431 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:53.953409    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291\": container with ID starting with 3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291 not found: ID does not exist" containerID="3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291"
Jul 16 17:31:53.953486 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.953442    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291"} err="failed to get container status \"3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291\": rpc error: code = NotFound desc = could not find container \"3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291\": container with ID starting with 3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291 not found: ID does not exist"
Jul 16 17:31:53.953486 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.953465    2580 scope.go:117] "RemoveContainer" containerID="d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1"
Jul 16 17:31:53.953748 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:53.953731    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1\": container with ID starting with d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1 not found: ID does not exist" containerID="d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1"
Jul 16 17:31:53.953807 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.953753    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1"} err="failed to get container status \"d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1\": rpc error: code = NotFound desc = could not find container \"d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1\": container with ID starting with d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1 not found: ID does not exist"
Jul 16 17:31:53.953807 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.953769    2580 scope.go:117] "RemoveContainer" containerID="88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651"
Jul 16 17:31:53.953991 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:53.953977    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651\": container with ID starting with 88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651 not found: ID does not exist" containerID="88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651"
Jul 16 17:31:53.954055 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.953995    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651"} err="failed to get container status \"88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651\": rpc error: code = NotFound desc = could not find container \"88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651\": container with ID starting with 88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651 not found: ID does not exist"
Jul 16 17:31:53.954055 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.954008    2580 scope.go:117] "RemoveContainer" containerID="238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b"
Jul 16 17:31:53.954262 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:53.954247    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b\": container with ID starting with 238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b not found: ID does not exist" containerID="238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b"
Jul 16 17:31:53.954300 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.954266    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b"} err="failed to get container status \"238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b\": rpc error: code = NotFound desc = could not find container \"238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b\": container with ID starting with 238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b not found: ID does not exist"
Jul 16 17:31:53.954300 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.954278    2580 scope.go:117] "RemoveContainer" containerID="00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500"
Jul 16 17:31:53.954489 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:53.954471    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500\": container with ID starting with 00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500 not found: ID does not exist" containerID="00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500"
Jul 16 17:31:53.954533 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.954493    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500"} err="failed to get container status \"00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500\": rpc error: code = NotFound desc = could not find container \"00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500\": container with ID starting with 00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500 not found: ID does not exist"
Jul 16 17:31:53.954533 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.954505    2580 scope.go:117] "RemoveContainer" containerID="d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad"
Jul 16 17:31:53.954728 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.954710    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad"} err="failed to get container status \"d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad\": rpc error: code = NotFound desc = could not find container \"d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad\": container with ID starting with d06bb057759a8452ef5d9c9109ee42744cc873f9aeaaf9d6f924fef0936fedad not found: ID does not exist"
Jul 16 17:31:53.954771 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.954732    2580 scope.go:117] "RemoveContainer" containerID="3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c"
Jul 16 17:31:53.954926 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.954908    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c"} err="failed to get container status \"3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c\": rpc error: code = NotFound desc = could not find container \"3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c\": container with ID starting with 3344809529d6ff95f920abd02c7b10068ef13e0fea4ae8bcd0ae1e40b67b1a7c not found: ID does not exist"
Jul 16 17:31:53.954963 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.954926    2580 scope.go:117] "RemoveContainer" containerID="3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291"
Jul 16 17:31:53.955166 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.955147    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291"} err="failed to get container status \"3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291\": rpc error: code = NotFound desc = could not find container \"3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291\": container with ID starting with 3f8b2a74a65e8cf90112aabf36eb7efb8ae7172e74ee1b87ff92ae2f1cdda291 not found: ID does not exist"
Jul 16 17:31:53.955213 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.955168    2580 scope.go:117] "RemoveContainer" containerID="d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1"
Jul 16 17:31:53.955351 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.955335    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1"} err="failed to get container status \"d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1\": rpc error: code = NotFound desc = could not find container \"d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1\": container with ID starting with d5a3ef2a6eec5a544008d3089cbdf6a6ec24e8884698e3da3cd7c33d75d742f1 not found: ID does not exist"
Jul 16 17:31:53.955392 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.955353    2580 scope.go:117] "RemoveContainer" containerID="88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651"
Jul 16 17:31:53.955544 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.955526    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651"} err="failed to get container status \"88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651\": rpc error: code = NotFound desc = could not find container \"88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651\": container with ID starting with 88dbf3671e0c581917d30ba2cb7c14d08d7a48e8e697c33324147986ba4e0651 not found: ID does not exist"
Jul 16 17:31:53.955609 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.955546    2580 scope.go:117] "RemoveContainer" containerID="238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b"
Jul 16 17:31:53.955747 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.955731    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b"} err="failed to get container status \"238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b\": rpc error: code = NotFound desc = could not find container \"238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b\": container with ID starting with 238edaf9b18c9b12a2d6cadaa48380eb410fb6ece48a59ea4d7166f6c828cf7b not found: ID does not exist"
Jul 16 17:31:53.955821 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.955749    2580 scope.go:117] "RemoveContainer" containerID="00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500"
Jul 16 17:31:53.955993 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.955977    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500"} err="failed to get container status \"00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500\": rpc error: code = NotFound desc = could not find container \"00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500\": container with ID starting with 00ad6ae82686bf18c7add2871fd095ce5117f0458d10b6aa61c0452f5c8c1500 not found: ID does not exist"
Jul 16 17:31:53.965753 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.965725    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" path="/var/lib/kubelet/pods/19a4230c-9880-4431-85d1-ef15e541ca84/volumes"
Jul 16 17:31:53.966258 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966243    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 17:31:53.966551 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966538    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="alertmanager"
Jul 16 17:31:53.966592 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966554    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="alertmanager"
Jul 16 17:31:53.966592 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966567    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="prom-label-proxy"
Jul 16 17:31:53.966592 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966573    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="prom-label-proxy"
Jul 16 17:31:53.966592 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966581    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d68c657-a237-47d4-9154-d0577f9e002e" containerName="console"
Jul 16 17:31:53.966592 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966586    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d68c657-a237-47d4-9154-d0577f9e002e" containerName="console"
Jul 16 17:31:53.966592 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966592    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="config-reloader"
Jul 16 17:31:53.966760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966598    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="config-reloader"
Jul 16 17:31:53.966760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966605    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="kube-rbac-proxy"
Jul 16 17:31:53.966760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966613    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="kube-rbac-proxy"
Jul 16 17:31:53.966760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966633    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="kube-rbac-proxy-web"
Jul 16 17:31:53.966760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966641    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="kube-rbac-proxy-web"
Jul 16 17:31:53.966760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966656    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="init-config-reloader"
Jul 16 17:31:53.966760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966663    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="init-config-reloader"
Jul 16 17:31:53.966760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966671    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="kube-rbac-proxy-metric"
Jul 16 17:31:53.966760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966678    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="kube-rbac-proxy-metric"
Jul 16 17:31:53.966760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966689    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24857346-526d-467b-858e-dda2cbab4615" containerName="console"
Jul 16 17:31:53.966760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966697    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="24857346-526d-467b-858e-dda2cbab4615" containerName="console"
Jul 16 17:31:53.967085 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966768    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="kube-rbac-proxy-metric"
Jul 16 17:31:53.967085 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966782    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="kube-rbac-proxy-web"
Jul 16 17:31:53.967085 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966791    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="kube-rbac-proxy"
Jul 16 17:31:53.967085 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966803    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="24857346-526d-467b-858e-dda2cbab4615" containerName="console"
Jul 16 17:31:53.967085 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966814    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="config-reloader"
Jul 16 17:31:53.967085 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966824    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="alertmanager"
Jul 16 17:31:53.967085 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966833    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d68c657-a237-47d4-9154-d0577f9e002e" containerName="console"
Jul 16 17:31:53.967085 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.966839    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a4230c-9880-4431-85d1-ef15e541ca84" containerName="prom-label-proxy"
Jul 16 17:31:53.970740 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.970723    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:53.974199 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.974167    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 16 17:31:53.974199 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.974174    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 16 17:31:53.974375 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.974237    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 16 17:31:53.974375 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.974244    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 16 17:31:53.974375 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.974291    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 16 17:31:53.974375 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.974267    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 16 17:31:53.974375 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.974190    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 16 17:31:53.974630 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.974490    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d6tnq\""
Jul 16 17:31:53.974681 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.974667    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 16 17:31:53.979470 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.979448    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 16 17:31:53.984905 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:53.984883    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 17:31:54.124935 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.124892    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce7a84dc-48b3-4ed9-9d87-453ac8704426-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.124935 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.124939    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.124935 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.124962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce7a84dc-48b3-4ed9-9d87-453ac8704426-config-out\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.125287 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.125023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.125287 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.125074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce7a84dc-48b3-4ed9-9d87-453ac8704426-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.125287 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.125092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-web-config\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.125287 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.125156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.125287 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.125187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.125287 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.125214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce7a84dc-48b3-4ed9-9d87-453ac8704426-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.125287 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.125253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce7a84dc-48b3-4ed9-9d87-453ac8704426-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.125561 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.125307    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.125561 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.125348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.125561 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.125384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfgg2\" (UniqueName: \"kubernetes.io/projected/ce7a84dc-48b3-4ed9-9d87-453ac8704426-kube-api-access-nfgg2\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.225844 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.225792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.225844 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.225842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.226111 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.226029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce7a84dc-48b3-4ed9-9d87-453ac8704426-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.226179 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.226122    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce7a84dc-48b3-4ed9-9d87-453ac8704426-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.226231 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.226179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.226281 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.226229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.226281 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.226274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfgg2\" (UniqueName: \"kubernetes.io/projected/ce7a84dc-48b3-4ed9-9d87-453ac8704426-kube-api-access-nfgg2\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.226390 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.226318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce7a84dc-48b3-4ed9-9d87-453ac8704426-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.226390 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.226346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.226390 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.226364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce7a84dc-48b3-4ed9-9d87-453ac8704426-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.226390 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.226381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce7a84dc-48b3-4ed9-9d87-453ac8704426-config-out\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.226572 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.226418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.226572 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.226450    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce7a84dc-48b3-4ed9-9d87-453ac8704426-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.226572 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.226479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-web-config\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.227079 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.226784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce7a84dc-48b3-4ed9-9d87-453ac8704426-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.227402 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.227376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce7a84dc-48b3-4ed9-9d87-453ac8704426-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.229232 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.228910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.229232 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.228918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.229232 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.229097    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.229232 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.229161    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce7a84dc-48b3-4ed9-9d87-453ac8704426-config-out\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.229478 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.229264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.229478 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.229379    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.229584 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.229572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce7a84dc-48b3-4ed9-9d87-453ac8704426-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.229752 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.229736    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-web-config\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.230829 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.230808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce7a84dc-48b3-4ed9-9d87-453ac8704426-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.236399 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.236376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfgg2\" (UniqueName: \"kubernetes.io/projected/ce7a84dc-48b3-4ed9-9d87-453ac8704426-kube-api-access-nfgg2\") pod \"alertmanager-main-0\" (UID: \"ce7a84dc-48b3-4ed9-9d87-453ac8704426\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.280573 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.280541    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 17:31:54.420558 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.420474    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 17:31:54.423481 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:31:54.423456    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce7a84dc_48b3_4ed9_9d87_453ac8704426.slice/crio-fb5b5accafe55d0f3c02a810ddea486daab766782a0ad2ff17335f81ecf9369f WatchSource:0}: Error finding container fb5b5accafe55d0f3c02a810ddea486daab766782a0ad2ff17335f81ecf9369f: Status 404 returned error can't find the container with id fb5b5accafe55d0f3c02a810ddea486daab766782a0ad2ff17335f81ecf9369f
Jul 16 17:31:54.905193 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.905158    2580 generic.go:356] "Generic (PLEG): container finished" podID="ce7a84dc-48b3-4ed9-9d87-453ac8704426" containerID="571f89ea3be47487baac7d19804b6850fa35527118be51810dc64d923c795fe3" exitCode=0
Jul 16 17:31:54.905364 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.905240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce7a84dc-48b3-4ed9-9d87-453ac8704426","Type":"ContainerDied","Data":"571f89ea3be47487baac7d19804b6850fa35527118be51810dc64d923c795fe3"}
Jul 16 17:31:54.905364 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:54.905328    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce7a84dc-48b3-4ed9-9d87-453ac8704426","Type":"ContainerStarted","Data":"fb5b5accafe55d0f3c02a810ddea486daab766782a0ad2ff17335f81ecf9369f"}
Jul 16 17:31:55.912386 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:55.912354    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce7a84dc-48b3-4ed9-9d87-453ac8704426","Type":"ContainerStarted","Data":"d5d62d9ed7bf50385c39c65f39dbc243ec93c4b8b8a19856910eb2cacad6dc52"}
Jul 16 17:31:55.912746 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:55.912418    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce7a84dc-48b3-4ed9-9d87-453ac8704426","Type":"ContainerStarted","Data":"550c540537c42324913d5458aa892fe4e3f0b099fa199fdef5d5e4b3f64bb831"}
Jul 16 17:31:55.912746 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:55.912446    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce7a84dc-48b3-4ed9-9d87-453ac8704426","Type":"ContainerStarted","Data":"15fe49e7a867a2cd85db4787afeb1184005d69a27e3bb4c156661d9814696d0a"}
Jul 16 17:31:55.912746 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:55.912470    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce7a84dc-48b3-4ed9-9d87-453ac8704426","Type":"ContainerStarted","Data":"6bfa05563934d52907811387a7f8667e2fd29c76516e6dc9aac37fa710f8f877"}
Jul 16 17:31:55.912746 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:55.912493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce7a84dc-48b3-4ed9-9d87-453ac8704426","Type":"ContainerStarted","Data":"c0f979edfa9c262ad6ab7eb99d2aa6777c36a4efbd81f3e9ff81fd7ac8901813"}
Jul 16 17:31:55.912746 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:55.912518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce7a84dc-48b3-4ed9-9d87-453ac8704426","Type":"ContainerStarted","Data":"6ccb97a3fe66eb042041fb6fab310901bd8e38e3229d7c691d381445e1dcc2be"}
Jul 16 17:31:55.944454 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:55.944393    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.926965213 podStartE2EDuration="2.944371138s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.405925ms" isStatefulPod=false podCreationTimestamp="2026-07-16 17:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:31:55.942230449 +0000 UTC m=+154.497287899" watchObservedRunningTime="2026-07-16 17:31:55.944371138 +0000 UTC m=+154.499428587"
Jul 16 17:31:56.155889 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.155856    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7775cf54d8-tfccf"]
Jul 16 17:31:56.158351 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.158334    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.161767 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.161730    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 16 17:31:56.161906 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.161767    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 16 17:31:56.161906 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.161778    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-h2mf4\""
Jul 16 17:31:56.161906 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.161768    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 16 17:31:56.162100 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.161929    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 16 17:31:56.162232 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.162215    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 16 17:31:56.166332 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.166264    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 16 17:31:56.173915 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.173891    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7775cf54d8-tfccf"]
Jul 16 17:31:56.247572 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.247536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.247572 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.247578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-telemeter-client-tls\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.247767 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.247607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.247767 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.247675    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-federate-client-tls\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.247767 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.247708    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqj4n\" (UniqueName: \"kubernetes.io/projected/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-kube-api-access-mqj4n\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.247767 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.247732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-serving-certs-ca-bundle\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.247901 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.247784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-metrics-client-ca\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.247901 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.247840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-secret-telemeter-client\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.349425 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.348601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.349425 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.348659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-telemeter-client-tls\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.349425 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.348692    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.349425 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.348719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-federate-client-tls\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.349425 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.348744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqj4n\" (UniqueName: \"kubernetes.io/projected/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-kube-api-access-mqj4n\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.349425 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.348771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-serving-certs-ca-bundle\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.349425 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.348808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-metrics-client-ca\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.349425 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.348863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-secret-telemeter-client\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.351026 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.350961    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-serving-certs-ca-bundle\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.351026 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.350977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-metrics-client-ca\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.351479 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.351431    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.352787 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.352764    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-federate-client-tls\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.352909 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.352842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-secret-telemeter-client\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.352976 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.352909    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.353279 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.353263    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-telemeter-client-tls\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.360741 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.360714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqj4n\" (UniqueName: \"kubernetes.io/projected/2b1da8fe-1ec6-4327-92ee-b6f6d7367837-kube-api-access-mqj4n\") pod \"telemeter-client-7775cf54d8-tfccf\" (UID: \"2b1da8fe-1ec6-4327-92ee-b6f6d7367837\") " pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.449324 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.449240    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 17:31:56.449693 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.449540    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="prometheus" containerID="cri-o://372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80" gracePeriod=600
Jul 16 17:31:56.449693 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.449551    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="kube-rbac-proxy" containerID="cri-o://f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee" gracePeriod=600
Jul 16 17:31:56.449693 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.449600    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36" gracePeriod=600
Jul 16 17:31:56.449693 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.449553    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="thanos-sidecar" containerID="cri-o://ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f" gracePeriod=600
Jul 16 17:31:56.449950 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.449604    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="config-reloader" containerID="cri-o://3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff" gracePeriod=600
Jul 16 17:31:56.449950 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.449551    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="kube-rbac-proxy-web" containerID="cri-o://4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688" gracePeriod=600
Jul 16 17:31:56.470751 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.470718    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf"
Jul 16 17:31:56.643657 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.643626    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7775cf54d8-tfccf"]
Jul 16 17:31:56.647468 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:31:56.647441    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1da8fe_1ec6_4327_92ee_b6f6d7367837.slice/crio-c296e3679df58fe2af93c231a78ddbbeadbb9ef00397d615b98556bbb94d6431 WatchSource:0}: Error finding container c296e3679df58fe2af93c231a78ddbbeadbb9ef00397d615b98556bbb94d6431: Status 404 returned error can't find the container with id c296e3679df58fe2af93c231a78ddbbeadbb9ef00397d615b98556bbb94d6431
Jul 16 17:31:56.722975 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.722948    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:56.854953 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.854923    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-metrics-client-ca\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855143 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.854964    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-kube-rbac-proxy\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855143 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.854981    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-trusted-ca-bundle\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855143 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855009    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-grpc-tls\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855143 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855027    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-db\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855355 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855162    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-tls\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855355 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855209    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-1\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855355 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855239    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855355 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855284    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-config\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855355 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855347    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbe49c00-cb48-4a89-8576-911eafbfb651-config-out\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855591 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855381    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:56.855591 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855385    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-thanos-prometheus-http-client-file\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855591 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855443    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-metrics-client-certs\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855591 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855460    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:56.855591 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855475    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-serving-certs-ca-bundle\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855591 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855508    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-web-config\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855591 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855533    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-0\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855591 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855566    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbe49c00-cb48-4a89-8576-911eafbfb651-tls-assets\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.855591 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855593    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-kubelet-serving-ca-bundle\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.856029 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855627    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghdpk\" (UniqueName: \"kubernetes.io/projected/fbe49c00-cb48-4a89-8576-911eafbfb651-kube-api-access-ghdpk\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.856029 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855651    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.856029 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855700    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-2\") pod \"fbe49c00-cb48-4a89-8576-911eafbfb651\" (UID: \"fbe49c00-cb48-4a89-8576-911eafbfb651\") "
Jul 16 17:31:56.856029 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.855708    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:56.856029 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.856013    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.856296 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.856051    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.856296 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.856071    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-metrics-client-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.856296 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.856266    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:31:56.856445 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.856347    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:56.857994 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.857712    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:56.857994 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.857736    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:56.857994 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.857844    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:56.858250 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.858115    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-config" (OuterVolumeSpecName: "config") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:56.858250 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.858130    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:56.858562 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.858538    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:56.858726 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.858672    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe49c00-cb48-4a89-8576-911eafbfb651-config-out" (OuterVolumeSpecName: "config-out") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:31:56.859057 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.859014    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:56.859155 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.859021    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:56.859438 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.859416    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:56.859741 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.859724    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe49c00-cb48-4a89-8576-911eafbfb651-kube-api-access-ghdpk" (OuterVolumeSpecName: "kube-api-access-ghdpk") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "kube-api-access-ghdpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:31:56.859865 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.859849    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe49c00-cb48-4a89-8576-911eafbfb651-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:31:56.859964 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.859948    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:56.860018 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.859961    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:31:56.870518 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.870493    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-web-config" (OuterVolumeSpecName: "web-config") pod "fbe49c00-cb48-4a89-8576-911eafbfb651" (UID: "fbe49c00-cb48-4a89-8576-911eafbfb651"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:56.918175 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.918137    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf" event={"ID":"2b1da8fe-1ec6-4327-92ee-b6f6d7367837","Type":"ContainerStarted","Data":"c296e3679df58fe2af93c231a78ddbbeadbb9ef00397d615b98556bbb94d6431"}
Jul 16 17:31:56.921158 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921130    2580 generic.go:356] "Generic (PLEG): container finished" podID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerID="1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36" exitCode=0
Jul 16 17:31:56.921158 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921153    2580 generic.go:356] "Generic (PLEG): container finished" podID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerID="f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee" exitCode=0
Jul 16 17:31:56.921158 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921159    2580 generic.go:356] "Generic (PLEG): container finished" podID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerID="4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688" exitCode=0
Jul 16 17:31:56.921367 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921166    2580 generic.go:356] "Generic (PLEG): container finished" podID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerID="ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f" exitCode=0
Jul 16 17:31:56.921367 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921174    2580 generic.go:356] "Generic (PLEG): container finished" podID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerID="3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff" exitCode=0
Jul 16 17:31:56.921367 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921179    2580 generic.go:356] "Generic (PLEG): container finished" podID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerID="372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80" exitCode=0
Jul 16 17:31:56.921367 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921206    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:56.921367 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921210    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerDied","Data":"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"}
Jul 16 17:31:56.921367 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921275    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerDied","Data":"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"}
Jul 16 17:31:56.921367 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerDied","Data":"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"}
Jul 16 17:31:56.921367 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerDied","Data":"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"}
Jul 16 17:31:56.921367 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921343    2580 scope.go:117] "RemoveContainer" containerID="1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"
Jul 16 17:31:56.921705 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921374    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerDied","Data":"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"}
Jul 16 17:31:56.921705 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921415    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerDied","Data":"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"}
Jul 16 17:31:56.921705 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.921456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fbe49c00-cb48-4a89-8576-911eafbfb651","Type":"ContainerDied","Data":"938676cc72a476833c213e3487e578deb7526e5156afadc26a7543166b3f682e"}
Jul 16 17:31:56.929878 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.929862    2580 scope.go:117] "RemoveContainer" containerID="f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"
Jul 16 17:31:56.936837 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.936818    2580 scope.go:117] "RemoveContainer" containerID="4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"
Jul 16 17:31:56.943407 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.943380    2580 scope.go:117] "RemoveContainer" containerID="ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"
Jul 16 17:31:56.947867 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.947843    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 17:31:56.951207 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.951140    2580 scope.go:117] "RemoveContainer" containerID="3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"
Jul 16 17:31:56.952860 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.952842    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 17:31:56.957370 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957349    2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-kube-rbac-proxy\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957436 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957372    2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-grpc-tls\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957436 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957386    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-db\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957436 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957397    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957436 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957408    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957436 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957416    2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957436 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957424    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbe49c00-cb48-4a89-8576-911eafbfb651-config-out\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957436 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957433    2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957443    2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-metrics-client-certs\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957452    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957463    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-web-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957474    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957481    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbe49c00-cb48-4a89-8576-911eafbfb651-tls-assets\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957490    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957498    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghdpk\" (UniqueName: \"kubernetes.io/projected/fbe49c00-cb48-4a89-8576-911eafbfb651-kube-api-access-ghdpk\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957506    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbe49c00-cb48-4a89-8576-911eafbfb651-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.957636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.957514    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fbe49c00-cb48-4a89-8576-911eafbfb651-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:31:56.958091 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.958079    2580 scope.go:117] "RemoveContainer" containerID="372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"
Jul 16 17:31:56.965359 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.965341    2580 scope.go:117] "RemoveContainer" containerID="ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"
Jul 16 17:31:56.972658 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.972638    2580 scope.go:117] "RemoveContainer" containerID="1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"
Jul 16 17:31:56.972944 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:56.972923    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36\": container with ID starting with 1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36 not found: ID does not exist" containerID="1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"
Jul 16 17:31:56.973016 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.972954    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"} err="failed to get container status \"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36\": rpc error: code = NotFound desc = could not find container \"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36\": container with ID starting with 1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36 not found: ID does not exist"
Jul 16 17:31:56.973016 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.972975    2580 scope.go:117] "RemoveContainer" containerID="f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"
Jul 16 17:31:56.973255 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:56.973236    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee\": container with ID starting with f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee not found: ID does not exist" containerID="f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"
Jul 16 17:31:56.973294 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.973261    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"} err="failed to get container status \"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee\": rpc error: code = NotFound desc = could not find container \"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee\": container with ID starting with f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee not found: ID does not exist"
Jul 16 17:31:56.973294 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.973278    2580 scope.go:117] "RemoveContainer" containerID="4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"
Jul 16 17:31:56.973495 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:56.973477    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688\": container with ID starting with 4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688 not found: ID does not exist" containerID="4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"
Jul 16 17:31:56.973562 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.973503    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"} err="failed to get container status \"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688\": rpc error: code = NotFound desc = could not find container \"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688\": container with ID starting with 4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688 not found: ID does not exist"
Jul 16 17:31:56.973562 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.973524    2580 scope.go:117] "RemoveContainer" containerID="ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"
Jul 16 17:31:56.973774 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:56.973756    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f\": container with ID starting with ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f not found: ID does not exist" containerID="ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"
Jul 16 17:31:56.973811 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.973778    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"} err="failed to get container status \"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f\": rpc error: code = NotFound desc = could not find container \"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f\": container with ID starting with ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f not found: ID does not exist"
Jul 16 17:31:56.973811 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.973791    2580 scope.go:117] "RemoveContainer" containerID="3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"
Jul 16 17:31:56.973994 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:56.973978    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff\": container with ID starting with 3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff not found: ID does not exist" containerID="3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"
Jul 16 17:31:56.974083 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.974002    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"} err="failed to get container status \"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff\": rpc error: code = NotFound desc = could not find container \"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff\": container with ID starting with 3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff not found: ID does not exist"
Jul 16 17:31:56.974083 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.974021    2580 scope.go:117] "RemoveContainer" containerID="372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"
Jul 16 17:31:56.974257 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:56.974241    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80\": container with ID starting with 372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80 not found: ID does not exist" containerID="372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"
Jul 16 17:31:56.974290 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.974260    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"} err="failed to get container status \"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80\": rpc error: code = NotFound desc = could not find container \"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80\": container with ID starting with 372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80 not found: ID does not exist"
Jul 16 17:31:56.974290 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.974276    2580 scope.go:117] "RemoveContainer" containerID="ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"
Jul 16 17:31:56.974503 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:31:56.974488    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1\": container with ID starting with ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1 not found: ID does not exist" containerID="ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"
Jul 16 17:31:56.974539 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.974506    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"} err="failed to get container status \"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1\": rpc error: code = NotFound desc = could not find container \"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1\": container with ID starting with ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1 not found: ID does not exist"
Jul 16 17:31:56.974539 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.974519    2580 scope.go:117] "RemoveContainer" containerID="1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"
Jul 16 17:31:56.974747 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.974730    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"} err="failed to get container status \"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36\": rpc error: code = NotFound desc = could not find container \"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36\": container with ID starting with 1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36 not found: ID does not exist"
Jul 16 17:31:56.974814 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.974749    2580 scope.go:117] "RemoveContainer" containerID="f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"
Jul 16 17:31:56.974968 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.974953    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"} err="failed to get container status \"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee\": rpc error: code = NotFound desc = could not find container \"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee\": container with ID starting with f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee not found: ID does not exist"
Jul 16 17:31:56.975012 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.974968    2580 scope.go:117] "RemoveContainer" containerID="4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"
Jul 16 17:31:56.975166 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.975150    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"} err="failed to get container status \"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688\": rpc error: code = NotFound desc = could not find container \"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688\": container with ID starting with 4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688 not found: ID does not exist"
Jul 16 17:31:56.975206 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.975166    2580 scope.go:117] "RemoveContainer" containerID="ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"
Jul 16 17:31:56.975352 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.975334    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"} err="failed to get container status \"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f\": rpc error: code = NotFound desc = could not find container \"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f\": container with ID starting with ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f not found: ID does not exist"
Jul 16 17:31:56.975424 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.975355    2580 scope.go:117] "RemoveContainer" containerID="3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"
Jul 16 17:31:56.975571 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.975551    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"} err="failed to get container status \"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff\": rpc error: code = NotFound desc = could not find container \"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff\": container with ID starting with 3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff not found: ID does not exist"
Jul 16 17:31:56.975617 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.975573    2580 scope.go:117] "RemoveContainer" containerID="372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"
Jul 16 17:31:56.975775 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.975755    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"} err="failed to get container status \"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80\": rpc error: code = NotFound desc = could not find container \"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80\": container with ID starting with 372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80 not found: ID does not exist"
Jul 16 17:31:56.975853 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.975777    2580 scope.go:117] "RemoveContainer" containerID="ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"
Jul 16 17:31:56.976018 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.976000    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"} err="failed to get container status \"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1\": rpc error: code = NotFound desc = could not find container \"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1\": container with ID starting with ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1 not found: ID does not exist"
Jul 16 17:31:56.976192 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.976021    2580 scope.go:117] "RemoveContainer" containerID="1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"
Jul 16 17:31:56.976256 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.976234    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"} err="failed to get container status \"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36\": rpc error: code = NotFound desc = could not find container \"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36\": container with ID starting with 1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36 not found: ID does not exist"
Jul 16 17:31:56.976309 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.976259    2580 scope.go:117] "RemoveContainer" containerID="f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"
Jul 16 17:31:56.976498 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.976479    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"} err="failed to get container status \"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee\": rpc error: code = NotFound desc = could not find container \"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee\": container with ID starting with f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee not found: ID does not exist"
Jul 16 17:31:56.976546 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.976498    2580 scope.go:117] "RemoveContainer" containerID="4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"
Jul 16 17:31:56.976692 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.976673    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"} err="failed to get container status \"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688\": rpc error: code = NotFound desc = could not find container \"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688\": container with ID starting with 4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688 not found: ID does not exist"
Jul 16 17:31:56.976772 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.976693    2580 scope.go:117] "RemoveContainer" containerID="ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"
Jul 16 17:31:56.976872 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.976855    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"} err="failed to get container status \"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f\": rpc error: code = NotFound desc = could not find container \"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f\": container with ID starting with ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f not found: ID does not exist"
Jul 16 17:31:56.976924 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.976873    2580 scope.go:117] "RemoveContainer" containerID="3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"
Jul 16 17:31:56.977072 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.977055    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"} err="failed to get container status \"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff\": rpc error: code = NotFound desc = could not find container \"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff\": container with ID starting with 3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff not found: ID does not exist"
Jul 16 17:31:56.977127 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.977072    2580 scope.go:117] "RemoveContainer" containerID="372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"
Jul 16 17:31:56.977249 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.977220    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"} err="failed to get container status \"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80\": rpc error: code = NotFound desc = could not find container \"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80\": container with ID starting with 372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80 not found: ID does not exist"
Jul 16 17:31:56.977249 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.977246    2580 scope.go:117] "RemoveContainer" containerID="ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"
Jul 16 17:31:56.977483 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.977466    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"} err="failed to get container status \"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1\": rpc error: code = NotFound desc = could not find container \"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1\": container with ID starting with ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1 not found: ID does not exist"
Jul 16 17:31:56.977525 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.977493    2580 scope.go:117] "RemoveContainer" containerID="1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"
Jul 16 17:31:56.977723 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.977701    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"} err="failed to get container status \"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36\": rpc error: code = NotFound desc = could not find container \"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36\": container with ID starting with 1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36 not found: ID does not exist"
Jul 16 17:31:56.977766 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.977724    2580 scope.go:117] "RemoveContainer" containerID="f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"
Jul 16 17:31:56.977944 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.977929    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"} err="failed to get container status \"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee\": rpc error: code = NotFound desc = could not find container \"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee\": container with ID starting with f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee not found: ID does not exist"
Jul 16 17:31:56.977988 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.977944    2580 scope.go:117] "RemoveContainer" containerID="4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"
Jul 16 17:31:56.978265 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.978243    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"} err="failed to get container status \"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688\": rpc error: code = NotFound desc = could not find container \"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688\": container with ID starting with 4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688 not found: ID does not exist"
Jul 16 17:31:56.978339 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.978281    2580 scope.go:117] "RemoveContainer" containerID="ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"
Jul 16 17:31:56.978554 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.978513    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"} err="failed to get container status \"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f\": rpc error: code = NotFound desc = could not find container \"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f\": container with ID starting with ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f not found: ID does not exist"
Jul 16 17:31:56.978554 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.978555    2580 scope.go:117] "RemoveContainer" containerID="3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"
Jul 16 17:31:56.978843 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.978821    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"} err="failed to get container status \"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff\": rpc error: code = NotFound desc = could not find container \"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff\": container with ID starting with 3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff not found: ID does not exist"
Jul 16 17:31:56.978843 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.978842    2580 scope.go:117] "RemoveContainer" containerID="372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"
Jul 16 17:31:56.979545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.979218    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"} err="failed to get container status \"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80\": rpc error: code = NotFound desc = could not find container \"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80\": container with ID starting with 372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80 not found: ID does not exist"
Jul 16 17:31:56.979545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.979242    2580 scope.go:117] "RemoveContainer" containerID="ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"
Jul 16 17:31:56.979545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.979501    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"} err="failed to get container status \"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1\": rpc error: code = NotFound desc = could not find container \"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1\": container with ID starting with ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1 not found: ID does not exist"
Jul 16 17:31:56.979545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.979520    2580 scope.go:117] "RemoveContainer" containerID="1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"
Jul 16 17:31:56.979785 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.979753    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"} err="failed to get container status \"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36\": rpc error: code = NotFound desc = could not find container \"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36\": container with ID starting with 1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36 not found: ID does not exist"
Jul 16 17:31:56.979785 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.979773    2580 scope.go:117] "RemoveContainer" containerID="f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"
Jul 16 17:31:56.979986 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.979969    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"} err="failed to get container status \"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee\": rpc error: code = NotFound desc = could not find container \"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee\": container with ID starting with f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee not found: ID does not exist"
Jul 16 17:31:56.979986 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.979985    2580 scope.go:117] "RemoveContainer" containerID="4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"
Jul 16 17:31:56.980270 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.980251    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"} err="failed to get container status \"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688\": rpc error: code = NotFound desc = could not find container \"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688\": container with ID starting with 4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688 not found: ID does not exist"
Jul 16 17:31:56.980328 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.980272    2580 scope.go:117] "RemoveContainer" containerID="ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"
Jul 16 17:31:56.980536 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.980514    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"} err="failed to get container status \"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f\": rpc error: code = NotFound desc = could not find container \"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f\": container with ID starting with ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f not found: ID does not exist"
Jul 16 17:31:56.980617 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.980539    2580 scope.go:117] "RemoveContainer" containerID="3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"
Jul 16 17:31:56.980757 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.980736    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"} err="failed to get container status \"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff\": rpc error: code = NotFound desc = could not find container \"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff\": container with ID starting with 3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff not found: ID does not exist"
Jul 16 17:31:56.980811 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.980758    2580 scope.go:117] "RemoveContainer" containerID="372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"
Jul 16 17:31:56.980937 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.980921    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 17:31:56.980985 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.980936    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"} err="failed to get container status \"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80\": rpc error: code = NotFound desc = could not find container \"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80\": container with ID starting with 372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80 not found: ID does not exist"
Jul 16 17:31:56.980985 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.980949    2580 scope.go:117] "RemoveContainer" containerID="ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"
Jul 16 17:31:56.981147 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981131    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"} err="failed to get container status \"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1\": rpc error: code = NotFound desc = could not find container \"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1\": container with ID starting with ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1 not found: ID does not exist"
Jul 16 17:31:56.981194 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981147    2580 scope.go:117] "RemoveContainer" containerID="1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"
Jul 16 17:31:56.981289 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981276    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="kube-rbac-proxy-web"
Jul 16 17:31:56.981330 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981291    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="kube-rbac-proxy-web"
Jul 16 17:31:56.981330 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981303    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="kube-rbac-proxy-thanos"
Jul 16 17:31:56.981330 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981310    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="kube-rbac-proxy-thanos"
Jul 16 17:31:56.981330 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981312    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36"} err="failed to get container status \"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36\": rpc error: code = NotFound desc = could not find container \"1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36\": container with ID starting with 1f87cb6c9fa3e66c095e7fc8760906f1eabb9aa497ebb65c8e77271eeed25c36 not found: ID does not exist"
Jul 16 17:31:56.981330 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981326    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="init-config-reloader"
Jul 16 17:31:56.981492 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981338    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="init-config-reloader"
Jul 16 17:31:56.981492 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981347    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="kube-rbac-proxy"
Jul 16 17:31:56.981492 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981353    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="kube-rbac-proxy"
Jul 16 17:31:56.981492 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981365    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="prometheus"
Jul 16 17:31:56.981492 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981371    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="prometheus"
Jul 16 17:31:56.981492 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981378    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="thanos-sidecar"
Jul 16 17:31:56.981492 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981383    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="thanos-sidecar"
Jul 16 17:31:56.981492 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981394    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="config-reloader"
Jul 16 17:31:56.981492 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981400    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="config-reloader"
Jul 16 17:31:56.981492 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981326    2580 scope.go:117] "RemoveContainer" containerID="f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"
Jul 16 17:31:56.981789 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981470    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="kube-rbac-proxy-web"
Jul 16 17:31:56.981789 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981530    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="kube-rbac-proxy"
Jul 16 17:31:56.981789 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981541    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="prometheus"
Jul 16 17:31:56.981789 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981552    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="config-reloader"
Jul 16 17:31:56.981789 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981560    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="thanos-sidecar"
Jul 16 17:31:56.981789 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981567    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" containerName="kube-rbac-proxy-thanos"
Jul 16 17:31:56.981789 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981726    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee"} err="failed to get container status \"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee\": rpc error: code = NotFound desc = could not find container \"f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee\": container with ID starting with f04244c887da153a4bf150ae0f6befea7eda8c5228d11c47f9a7c67a5b3147ee not found: ID does not exist"
Jul 16 17:31:56.981789 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981739    2580 scope.go:117] "RemoveContainer" containerID="4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"
Jul 16 17:31:56.982056 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981939    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688"} err="failed to get container status \"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688\": rpc error: code = NotFound desc = could not find container \"4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688\": container with ID starting with 4e5a40d0e2290f85351c0e28a93833ea46324fa961575b54e624a90b3516a688 not found: ID does not exist"
Jul 16 17:31:56.982056 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.981955    2580 scope.go:117] "RemoveContainer" containerID="ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"
Jul 16 17:31:56.982188 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.982171    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f"} err="failed to get container status \"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f\": rpc error: code = NotFound desc = could not find container \"ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f\": container with ID starting with ea14899ab1c5100b1b0696fbb7bbd2145a2778c75174c2f5b81e93dce5fcd95f not found: ID does not exist"
Jul 16 17:31:56.982230 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.982188    2580 scope.go:117] "RemoveContainer" containerID="3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"
Jul 16 17:31:56.982393 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.982378    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff"} err="failed to get container status \"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff\": rpc error: code = NotFound desc = could not find container \"3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff\": container with ID starting with 3804e4a3c234a6de18b0433a1699143629dda115cbf301915e7b344390cabfff not found: ID does not exist"
Jul 16 17:31:56.982434 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.982393    2580 scope.go:117] "RemoveContainer" containerID="372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"
Jul 16 17:31:56.982612 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.982587    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80"} err="failed to get container status \"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80\": rpc error: code = NotFound desc = could not find container \"372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80\": container with ID starting with 372f20b184cdfe6de6bbeefbc3eefff08dc7ae7ba3391a2bdb6a562fa974ad80 not found: ID does not exist"
Jul 16 17:31:56.982708 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.982614    2580 scope.go:117] "RemoveContainer" containerID="ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"
Jul 16 17:31:56.983013 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.982985    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1"} err="failed to get container status \"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1\": rpc error: code = NotFound desc = could not find container \"ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1\": container with ID starting with ce281b900460c3eb6624a7d7e194928aced29347d96d72479a7d86a5667e6fd1 not found: ID does not exist"
Jul 16 17:31:56.985450 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.985430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:56.988184 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.988148    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 16 17:31:56.988284 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.988224    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 16 17:31:56.988401 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.988383    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fqui9kic4dgn1\""
Jul 16 17:31:56.988495 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.988455    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 16 17:31:56.988495 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.988468    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 16 17:31:56.988607 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.988527    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 16 17:31:56.988607 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.988533    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 16 17:31:56.988607 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.988588    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 16 17:31:56.988761 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.988682    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 16 17:31:56.990823 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.989231    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 16 17:31:56.990823 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.990204    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 16 17:31:56.990823 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.990371    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 16 17:31:56.990823 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.990508    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 16 17:31:56.991651 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.991630    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7zrdd\""
Jul 16 17:31:56.992168 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.992151    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 16 17:31:56.994927 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:56.994890    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 16 17:31:57.004461 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.004435    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 17:31:57.058409 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058372    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.058579 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058414    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.058579 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.058579 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058540    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-web-config\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.058579 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058564    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-config\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.058780 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.058780 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.058780 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.058780 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.058780 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.058780 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.058780 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.058780 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.059190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058833    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.059190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.059190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.058932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.059190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.059060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsqht\" (UniqueName: \"kubernetes.io/projected/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-kube-api-access-bsqht\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.059190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.059109    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.059190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.059135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.059439 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.059250    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-config-out\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.160548 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.160548 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.160788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.160788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.160788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160605    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.160788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.160788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.160788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.160788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160712    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.160788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.161201 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsqht\" (UniqueName: \"kubernetes.io/projected/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-kube-api-access-bsqht\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.161201 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160830    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.161201 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.161201 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-config-out\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.161201 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.161201 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.160973    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.161201 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.161011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.161201 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.161065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-web-config\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.161201 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.161091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-config\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.161201 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.161123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.161731 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.161413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.161731 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.161659    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.161971 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.161854    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.162124 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.162056    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.162124 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.162061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.163261 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.163003    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.163848 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.163822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.163948 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.163933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.164013 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.163969    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.164323 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.164292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.164575 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.164548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.165206 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.165177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.165592 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.165568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-config\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.165810 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.165787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.165881 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.165809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.166053 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.166017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-config-out\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.166228 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.166207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.166476 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.166457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.166943 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.166926    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-web-config\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.172159 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.172138    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsqht\" (UniqueName: \"kubernetes.io/projected/bebe43e9-8097-4f2d-bc0e-2ee733d47fe7-kube-api-access-bsqht\") pod \"prometheus-k8s-0\" (UID: \"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.297538 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.297449    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:31:57.449429 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.449254    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 17:31:57.451512 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:31:57.451478    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbebe43e9_8097_4f2d_bc0e_2ee733d47fe7.slice/crio-17846b8ebee7eb0a2e64c2b94e8ec220cc1dccc7b11fad3025f6922b4495d419 WatchSource:0}: Error finding container 17846b8ebee7eb0a2e64c2b94e8ec220cc1dccc7b11fad3025f6922b4495d419: Status 404 returned error can't find the container with id 17846b8ebee7eb0a2e64c2b94e8ec220cc1dccc7b11fad3025f6922b4495d419
Jul 16 17:31:57.927750 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.927655    2580 generic.go:356] "Generic (PLEG): container finished" podID="bebe43e9-8097-4f2d-bc0e-2ee733d47fe7" containerID="052d0df35ac2994d9697e079f457791e69e4f772399e33b528ae07ff134cf58c" exitCode=0
Jul 16 17:31:57.927750 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.927721    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7","Type":"ContainerDied","Data":"052d0df35ac2994d9697e079f457791e69e4f772399e33b528ae07ff134cf58c"}
Jul 16 17:31:57.928155 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.927788    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7","Type":"ContainerStarted","Data":"17846b8ebee7eb0a2e64c2b94e8ec220cc1dccc7b11fad3025f6922b4495d419"}
Jul 16 17:31:57.967438 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:57.967400    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbe49c00-cb48-4a89-8576-911eafbfb651" path="/var/lib/kubelet/pods/fbe49c00-cb48-4a89-8576-911eafbfb651/volumes"
Jul 16 17:31:58.934770 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:58.934678    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7","Type":"ContainerStarted","Data":"5e26cd5c4cdd086593b9e835b586f0078a4ceefb9e98ecada98cbd4d7c87012e"}
Jul 16 17:31:58.934770 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:58.934752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7","Type":"ContainerStarted","Data":"3f552b9b09ec98a7daf24a8ec72de3c2e501fbb1b67a596732c3ef7106174fb8"}
Jul 16 17:31:58.935207 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:58.934788    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7","Type":"ContainerStarted","Data":"15fe498fb79777045e0a0a68c2a6a31a91ecf53c5a05bfbeeeab98b0572e2ff5"}
Jul 16 17:31:58.935207 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:58.934813    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7","Type":"ContainerStarted","Data":"0852d073c9e20327403ba2044a6bf80c41ca8052411d174363abbc150592ee94"}
Jul 16 17:31:58.935207 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:58.934845    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7","Type":"ContainerStarted","Data":"6b3de91696ad9e1125f8cd6f61e9300197d900daa9f11289afd3fb7907e311ce"}
Jul 16 17:31:58.935207 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:58.934877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bebe43e9-8097-4f2d-bc0e-2ee733d47fe7","Type":"ContainerStarted","Data":"ff2a5b463b6cdf6b0b5d9739a5ea0f61d5b6e913fe05aaf3d5647f502af1eb97"}
Jul 16 17:31:58.936768 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:58.936744    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf" event={"ID":"2b1da8fe-1ec6-4327-92ee-b6f6d7367837","Type":"ContainerStarted","Data":"292ef32860ff8e2b77bfccde079413b9b153f0fa6598d23fc13ccc8cdef38f61"}
Jul 16 17:31:58.936860 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:58.936787    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf" event={"ID":"2b1da8fe-1ec6-4327-92ee-b6f6d7367837","Type":"ContainerStarted","Data":"3b4bc118c4dea0860ab391c9b8ef809bf864c7fae00519b4b8a339afc432957e"}
Jul 16 17:31:58.936860 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:58.936805    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf" event={"ID":"2b1da8fe-1ec6-4327-92ee-b6f6d7367837","Type":"ContainerStarted","Data":"73080e5f8f7433e57807a14524b3f03ea2ae91f1171b4441459e804b538ec734"}
Jul 16 17:31:58.971786 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:58.971706    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.950911237 podStartE2EDuration="2.971683443s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.772206ms" isStatefulPod=false podCreationTimestamp="2026-07-16 17:31:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:31:58.969536273 +0000 UTC m=+157.524593712" watchObservedRunningTime="2026-07-16 17:31:58.971683443 +0000 UTC m=+157.526740879"
Jul 16 17:31:59.001401 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:59.001349    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7775cf54d8-tfccf" podStartSLOduration=0.967627558 podStartE2EDuration="3.001334939s" totalImagesPullingTime="2.033707381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:31:58.999706826 +0000 UTC m=+157.554764264" watchObservedRunningTime="2026-07-16 17:31:59.001334939 +0000 UTC m=+157.556392386"
Jul 16 17:31:59.997994 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:31:59.997952    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78848cf446-x7ns8"]
Jul 16 17:32:00.000705 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.000676    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.014579 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.014551    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78848cf446-x7ns8"]
Jul 16 17:32:00.056770 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.056741    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:32:00.094191 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.094148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-service-ca\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.094383 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.094328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn7kh\" (UniqueName: \"kubernetes.io/projected/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-kube-api-access-dn7kh\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.094637 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.094599    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-oauth-config\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.094778 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.094663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-serving-cert\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.094778 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.094712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-oauth-serving-cert\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.094889 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.094838    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-trusted-ca-bundle\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.095094 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.095067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-config\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.196271 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.196214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-config\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.196531 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.196316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-service-ca\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.196531 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.196344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn7kh\" (UniqueName: \"kubernetes.io/projected/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-kube-api-access-dn7kh\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.196531 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.196385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-oauth-config\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.196702 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.196561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-serving-cert\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.196702 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.196592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-oauth-serving-cert\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.196702 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.196643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-trusted-ca-bundle\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.197075 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.197025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-config\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.197159 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.197121    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-service-ca\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.197266 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.197248    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-oauth-serving-cert\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.197555 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.197536    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-trusted-ca-bundle\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.198818 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.198800    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-oauth-config\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.199045 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.199007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-serving-cert\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.207680 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.207652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn7kh\" (UniqueName: \"kubernetes.io/projected/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-kube-api-access-dn7kh\") pod \"console-78848cf446-x7ns8\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") " pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.310834 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.310742    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:00.450572 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.450538    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78848cf446-x7ns8"]
Jul 16 17:32:00.453868 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:32:00.453838    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf120965_04e8_4b7e_a3b9_cd66441e0f8d.slice/crio-577f063bee16b553c1f32d3895a5153698791a877c63495afd92e2ac25849855 WatchSource:0}: Error finding container 577f063bee16b553c1f32d3895a5153698791a877c63495afd92e2ac25849855: Status 404 returned error can't find the container with id 577f063bee16b553c1f32d3895a5153698791a877c63495afd92e2ac25849855
Jul 16 17:32:00.947525 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.947483    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78848cf446-x7ns8" event={"ID":"bf120965-04e8-4b7e-a3b9-cd66441e0f8d","Type":"ContainerStarted","Data":"0da6bdb6f33fef8238202a175fe7cfb7586a1e1a4cd0dd5d00a0963db86a69bc"}
Jul 16 17:32:00.947684 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.947539    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78848cf446-x7ns8" event={"ID":"bf120965-04e8-4b7e-a3b9-cd66441e0f8d","Type":"ContainerStarted","Data":"577f063bee16b553c1f32d3895a5153698791a877c63495afd92e2ac25849855"}
Jul 16 17:32:00.968135 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:00.968075    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78848cf446-x7ns8" podStartSLOduration=1.968057343 podStartE2EDuration="1.968057343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:31:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:32:00.968000774 +0000 UTC m=+159.523058212" watchObservedRunningTime="2026-07-16 17:32:00.968057343 +0000 UTC m=+159.523114771"
Jul 16 17:32:02.297717 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:02.297681    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:32:10.311415 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:10.311376    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:10.311879 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:10.311441    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:10.317171 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:10.317148    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:10.995089 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:10.995061    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:32:11.060276 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:11.060239    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6497c54bb4-g69z4"]
Jul 16 17:32:11.187706 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:11.187671    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:32:11.289480 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:11.289391    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:32:11.390876 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:11.390842    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:32:36.081587 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.081543    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6497c54bb4-g69z4" podUID="27398f48-9471-4365-b82d-c40511adcccc" containerName="console" containerID="cri-o://ea412ab58a5bcb1b8ab68edba867a019235833af95680916d9c1f85927a4d46e" gracePeriod=15
Jul 16 17:32:36.329795 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.329766    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:32:36.423964 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.423871    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-oauth-serving-cert\") pod \"27398f48-9471-4365-b82d-c40511adcccc\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") "
Jul 16 17:32:36.423964 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.423939    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27398f48-9471-4365-b82d-c40511adcccc-console-oauth-config\") pod \"27398f48-9471-4365-b82d-c40511adcccc\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") "
Jul 16 17:32:36.424229 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.424072    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-service-ca\") pod \"27398f48-9471-4365-b82d-c40511adcccc\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") "
Jul 16 17:32:36.424229 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.424129    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-trusted-ca-bundle\") pod \"27398f48-9471-4365-b82d-c40511adcccc\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") "
Jul 16 17:32:36.424229 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.424166    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nhcd\" (UniqueName: \"kubernetes.io/projected/27398f48-9471-4365-b82d-c40511adcccc-kube-api-access-7nhcd\") pod \"27398f48-9471-4365-b82d-c40511adcccc\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") "
Jul 16 17:32:36.424229 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.424202    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27398f48-9471-4365-b82d-c40511adcccc-console-serving-cert\") pod \"27398f48-9471-4365-b82d-c40511adcccc\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") "
Jul 16 17:32:36.424441 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.424282    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-console-config\") pod \"27398f48-9471-4365-b82d-c40511adcccc\" (UID: \"27398f48-9471-4365-b82d-c40511adcccc\") "
Jul 16 17:32:36.424441 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.424424    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-service-ca" (OuterVolumeSpecName: "service-ca") pod "27398f48-9471-4365-b82d-c40511adcccc" (UID: "27398f48-9471-4365-b82d-c40511adcccc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:32:36.424537 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.424342    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27398f48-9471-4365-b82d-c40511adcccc" (UID: "27398f48-9471-4365-b82d-c40511adcccc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:32:36.424537 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.424508    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "27398f48-9471-4365-b82d-c40511adcccc" (UID: "27398f48-9471-4365-b82d-c40511adcccc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:32:36.424662 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.424643    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-oauth-serving-cert\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:32:36.424717 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.424665    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-service-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:32:36.424717 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.424679    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-trusted-ca-bundle\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:32:36.424717 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.424701    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-console-config" (OuterVolumeSpecName: "console-config") pod "27398f48-9471-4365-b82d-c40511adcccc" (UID: "27398f48-9471-4365-b82d-c40511adcccc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:32:36.426238 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.426210    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27398f48-9471-4365-b82d-c40511adcccc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27398f48-9471-4365-b82d-c40511adcccc" (UID: "27398f48-9471-4365-b82d-c40511adcccc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:32:36.426351 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.426235    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27398f48-9471-4365-b82d-c40511adcccc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27398f48-9471-4365-b82d-c40511adcccc" (UID: "27398f48-9471-4365-b82d-c40511adcccc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:32:36.426351 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.426238    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27398f48-9471-4365-b82d-c40511adcccc-kube-api-access-7nhcd" (OuterVolumeSpecName: "kube-api-access-7nhcd") pod "27398f48-9471-4365-b82d-c40511adcccc" (UID: "27398f48-9471-4365-b82d-c40511adcccc"). InnerVolumeSpecName "kube-api-access-7nhcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:32:36.525695 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.525657    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27398f48-9471-4365-b82d-c40511adcccc-console-oauth-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:32:36.525695 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.525688    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nhcd\" (UniqueName: \"kubernetes.io/projected/27398f48-9471-4365-b82d-c40511adcccc-kube-api-access-7nhcd\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:32:36.525695 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.525700    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27398f48-9471-4365-b82d-c40511adcccc-console-serving-cert\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:32:36.525936 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:36.525708    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27398f48-9471-4365-b82d-c40511adcccc-console-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:32:37.099373 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:37.099340    2580 generic.go:356] "Generic (PLEG): container finished" podID="27398f48-9471-4365-b82d-c40511adcccc" containerID="ea412ab58a5bcb1b8ab68edba867a019235833af95680916d9c1f85927a4d46e" exitCode=0
Jul 16 17:32:37.099846 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:37.099390    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6497c54bb4-g69z4"
Jul 16 17:32:37.099846 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:37.099422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6497c54bb4-g69z4" event={"ID":"27398f48-9471-4365-b82d-c40511adcccc","Type":"ContainerDied","Data":"ea412ab58a5bcb1b8ab68edba867a019235833af95680916d9c1f85927a4d46e"}
Jul 16 17:32:37.099846 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:37.099473    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6497c54bb4-g69z4" event={"ID":"27398f48-9471-4365-b82d-c40511adcccc","Type":"ContainerDied","Data":"828d9f38cc0d36196e2047793a643baab43ad286d5b1c2f6a0606085e9747c24"}
Jul 16 17:32:37.099846 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:37.099493    2580 scope.go:117] "RemoveContainer" containerID="ea412ab58a5bcb1b8ab68edba867a019235833af95680916d9c1f85927a4d46e"
Jul 16 17:32:37.110322 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:37.110165    2580 scope.go:117] "RemoveContainer" containerID="ea412ab58a5bcb1b8ab68edba867a019235833af95680916d9c1f85927a4d46e"
Jul 16 17:32:37.110792 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:32:37.110772    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea412ab58a5bcb1b8ab68edba867a019235833af95680916d9c1f85927a4d46e\": container with ID starting with ea412ab58a5bcb1b8ab68edba867a019235833af95680916d9c1f85927a4d46e not found: ID does not exist" containerID="ea412ab58a5bcb1b8ab68edba867a019235833af95680916d9c1f85927a4d46e"
Jul 16 17:32:37.110851 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:37.110800    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea412ab58a5bcb1b8ab68edba867a019235833af95680916d9c1f85927a4d46e"} err="failed to get container status \"ea412ab58a5bcb1b8ab68edba867a019235833af95680916d9c1f85927a4d46e\": rpc error: code = NotFound desc = could not find container \"ea412ab58a5bcb1b8ab68edba867a019235833af95680916d9c1f85927a4d46e\": container with ID starting with ea412ab58a5bcb1b8ab68edba867a019235833af95680916d9c1f85927a4d46e not found: ID does not exist"
Jul 16 17:32:37.123726 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:37.123701    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6497c54bb4-g69z4"]
Jul 16 17:32:37.130709 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:37.130684    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6497c54bb4-g69z4"]
Jul 16 17:32:37.965458 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:37.965430    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27398f48-9471-4365-b82d-c40511adcccc" path="/var/lib/kubelet/pods/27398f48-9471-4365-b82d-c40511adcccc/volumes"
Jul 16 17:32:46.108818 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:46.108777    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:32:46.210674 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:46.210638    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:32:49.522296 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:49.522261    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:32:57.298529 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:57.298481    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:32:57.314731 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:57.314701    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:32:58.200572 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:32:58.200543    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 17:33:03.694231 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:03.694189    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:06.298530 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:06.298475    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:06.359853 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:06.359814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:18.908009 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:18.907969    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:19.031202 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:19.031156    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:21.552835 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:21.552790    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:21.638357 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:21.638320    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:28.349969 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:28.349911    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:28.417200 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:28.417165    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:32.664929 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:32.664889    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:35.366776 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.366737    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-544c9b9886-rz7mg"]
Jul 16 17:33:35.367242 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.367109    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27398f48-9471-4365-b82d-c40511adcccc" containerName="console"
Jul 16 17:33:35.367242 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.367120    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="27398f48-9471-4365-b82d-c40511adcccc" containerName="console"
Jul 16 17:33:35.367242 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.367187    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="27398f48-9471-4365-b82d-c40511adcccc" containerName="console"
Jul 16 17:33:35.371151 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.371129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.391237 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.391210    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544c9b9886-rz7mg"]
Jul 16 17:33:35.439214 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.439179    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:35.455973 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.455941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-serving-cert\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.456112 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.455987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-oauth-serving-cert\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.456112 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.456070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-service-ca\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.456112 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.456105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-trusted-ca-bundle\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.456217 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.456135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-config\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.456217 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.456167    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf8pz\" (UniqueName: \"kubernetes.io/projected/4e9a60b1-8e8f-476e-a620-35c4e542903a-kube-api-access-rf8pz\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.456217 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.456198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-oauth-config\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.556754 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.556716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-oauth-serving-cert\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.556887 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.556774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-service-ca\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.556887 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.556809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-trusted-ca-bundle\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.556887 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.556840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-config\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.556887 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.556860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf8pz\" (UniqueName: \"kubernetes.io/projected/4e9a60b1-8e8f-476e-a620-35c4e542903a-kube-api-access-rf8pz\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.557121 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.556912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-oauth-config\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.557121 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.556938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-serving-cert\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.557591 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.557568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-config\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.557696 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.557633    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-service-ca\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.557696 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.557637    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-oauth-serving-cert\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.557770 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.557733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-trusted-ca-bundle\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.559457 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.559434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-serving-cert\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.559575 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.559488    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-oauth-config\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.569412 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.569388    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf8pz\" (UniqueName: \"kubernetes.io/projected/4e9a60b1-8e8f-476e-a620-35c4e542903a-kube-api-access-rf8pz\") pod \"console-544c9b9886-rz7mg\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") " pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.680793 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.680696    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:35.835189 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:35.835144    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544c9b9886-rz7mg"]
Jul 16 17:33:35.839049 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:33:35.839004    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e9a60b1_8e8f_476e_a620_35c4e542903a.slice/crio-175ef77d635371253ad8ef765bc038bbf5766f750fac8d5cafed37e2e3da71e3 WatchSource:0}: Error finding container 175ef77d635371253ad8ef765bc038bbf5766f750fac8d5cafed37e2e3da71e3: Status 404 returned error can't find the container with id 175ef77d635371253ad8ef765bc038bbf5766f750fac8d5cafed37e2e3da71e3
Jul 16 17:33:36.342325 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:36.342285    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544c9b9886-rz7mg" event={"ID":"4e9a60b1-8e8f-476e-a620-35c4e542903a","Type":"ContainerStarted","Data":"be5c47bf4f923889e2e22cd6d1470cc763ceed018d5d30bd4f3a543d68edc6d6"}
Jul 16 17:33:36.342521 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:36.342349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544c9b9886-rz7mg" event={"ID":"4e9a60b1-8e8f-476e-a620-35c4e542903a","Type":"ContainerStarted","Data":"175ef77d635371253ad8ef765bc038bbf5766f750fac8d5cafed37e2e3da71e3"}
Jul 16 17:33:36.366893 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:36.366836    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-544c9b9886-rz7mg" podStartSLOduration=1.366813958 podStartE2EDuration="1.366813958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:36.364909723 +0000 UTC m=+254.919967191" watchObservedRunningTime="2026-07-16 17:33:36.366813958 +0000 UTC m=+254.921871396"
Jul 16 17:33:45.681950 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:45.681846    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:45.681950 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:45.681917    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:45.686537 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:45.686515    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:46.386865 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:46.386834    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:33:46.449126 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:46.449093    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78848cf446-x7ns8"]
Jul 16 17:33:46.569001 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:46.568970    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:46.673329 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:46.673242    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:46.754235 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:33:46.754197    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:11.473771 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.473700    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78848cf446-x7ns8" podUID="bf120965-04e8-4b7e-a3b9-cd66441e0f8d" containerName="console" containerID="cri-o://0da6bdb6f33fef8238202a175fe7cfb7586a1e1a4cd0dd5d00a0963db86a69bc" gracePeriod=15
Jul 16 17:34:11.716559 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.716531    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:34:11.767116 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.767002    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn7kh\" (UniqueName: \"kubernetes.io/projected/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-kube-api-access-dn7kh\") pod \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") "
Jul 16 17:34:11.767267 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.767175    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-oauth-serving-cert\") pod \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") "
Jul 16 17:34:11.767267 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.767251    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-oauth-config\") pod \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") "
Jul 16 17:34:11.767394 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.767278    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-service-ca\") pod \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") "
Jul 16 17:34:11.767394 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.767307    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-serving-cert\") pod \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") "
Jul 16 17:34:11.767499 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.767427    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-config\") pod \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") "
Jul 16 17:34:11.767499 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.767476    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-trusted-ca-bundle\") pod \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\" (UID: \"bf120965-04e8-4b7e-a3b9-cd66441e0f8d\") "
Jul 16 17:34:11.767774 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.767724    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-service-ca" (OuterVolumeSpecName: "service-ca") pod "bf120965-04e8-4b7e-a3b9-cd66441e0f8d" (UID: "bf120965-04e8-4b7e-a3b9-cd66441e0f8d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:34:11.767774 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.767724    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bf120965-04e8-4b7e-a3b9-cd66441e0f8d" (UID: "bf120965-04e8-4b7e-a3b9-cd66441e0f8d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:34:11.768094 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.767778    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-config" (OuterVolumeSpecName: "console-config") pod "bf120965-04e8-4b7e-a3b9-cd66441e0f8d" (UID: "bf120965-04e8-4b7e-a3b9-cd66441e0f8d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:34:11.768094 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.767839    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-service-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:34:11.768094 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.767861    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-oauth-serving-cert\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:34:11.768094 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.768008    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bf120965-04e8-4b7e-a3b9-cd66441e0f8d" (UID: "bf120965-04e8-4b7e-a3b9-cd66441e0f8d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:34:11.769242 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.769220    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-kube-api-access-dn7kh" (OuterVolumeSpecName: "kube-api-access-dn7kh") pod "bf120965-04e8-4b7e-a3b9-cd66441e0f8d" (UID: "bf120965-04e8-4b7e-a3b9-cd66441e0f8d"). InnerVolumeSpecName "kube-api-access-dn7kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:34:11.769371 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.769351    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bf120965-04e8-4b7e-a3b9-cd66441e0f8d" (UID: "bf120965-04e8-4b7e-a3b9-cd66441e0f8d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:34:11.769459 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.769441    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bf120965-04e8-4b7e-a3b9-cd66441e0f8d" (UID: "bf120965-04e8-4b7e-a3b9-cd66441e0f8d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:34:11.868297 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.868258    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:34:11.868297 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.868290    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-trusted-ca-bundle\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:34:11.868297 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.868300    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn7kh\" (UniqueName: \"kubernetes.io/projected/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-kube-api-access-dn7kh\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:34:11.868297 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.868309    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-oauth-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:34:11.868562 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:11.868318    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf120965-04e8-4b7e-a3b9-cd66441e0f8d-console-serving-cert\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:34:12.493323 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:12.493284    2580 generic.go:356] "Generic (PLEG): container finished" podID="bf120965-04e8-4b7e-a3b9-cd66441e0f8d" containerID="0da6bdb6f33fef8238202a175fe7cfb7586a1e1a4cd0dd5d00a0963db86a69bc" exitCode=0
Jul 16 17:34:12.493801 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:12.493338    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78848cf446-x7ns8"
Jul 16 17:34:12.493801 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:12.493374    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78848cf446-x7ns8" event={"ID":"bf120965-04e8-4b7e-a3b9-cd66441e0f8d","Type":"ContainerDied","Data":"0da6bdb6f33fef8238202a175fe7cfb7586a1e1a4cd0dd5d00a0963db86a69bc"}
Jul 16 17:34:12.493801 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:12.493440    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78848cf446-x7ns8" event={"ID":"bf120965-04e8-4b7e-a3b9-cd66441e0f8d","Type":"ContainerDied","Data":"577f063bee16b553c1f32d3895a5153698791a877c63495afd92e2ac25849855"}
Jul 16 17:34:12.493801 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:12.493473    2580 scope.go:117] "RemoveContainer" containerID="0da6bdb6f33fef8238202a175fe7cfb7586a1e1a4cd0dd5d00a0963db86a69bc"
Jul 16 17:34:12.505758 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:12.505737    2580 scope.go:117] "RemoveContainer" containerID="0da6bdb6f33fef8238202a175fe7cfb7586a1e1a4cd0dd5d00a0963db86a69bc"
Jul 16 17:34:12.506085 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:34:12.506061    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0da6bdb6f33fef8238202a175fe7cfb7586a1e1a4cd0dd5d00a0963db86a69bc\": container with ID starting with 0da6bdb6f33fef8238202a175fe7cfb7586a1e1a4cd0dd5d00a0963db86a69bc not found: ID does not exist" containerID="0da6bdb6f33fef8238202a175fe7cfb7586a1e1a4cd0dd5d00a0963db86a69bc"
Jul 16 17:34:12.506194 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:12.506094    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da6bdb6f33fef8238202a175fe7cfb7586a1e1a4cd0dd5d00a0963db86a69bc"} err="failed to get container status \"0da6bdb6f33fef8238202a175fe7cfb7586a1e1a4cd0dd5d00a0963db86a69bc\": rpc error: code = NotFound desc = could not find container \"0da6bdb6f33fef8238202a175fe7cfb7586a1e1a4cd0dd5d00a0963db86a69bc\": container with ID starting with 0da6bdb6f33fef8238202a175fe7cfb7586a1e1a4cd0dd5d00a0963db86a69bc not found: ID does not exist"
Jul 16 17:34:12.526046 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:12.525999    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78848cf446-x7ns8"]
Jul 16 17:34:12.532738 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:12.532710    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78848cf446-x7ns8"]
Jul 16 17:34:13.965516 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:13.965480    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf120965-04e8-4b7e-a3b9-cd66441e0f8d" path="/var/lib/kubelet/pods/bf120965-04e8-4b7e-a3b9-cd66441e0f8d/volumes"
Jul 16 17:34:21.799260 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:21.799234    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:34:21.802094 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:21.802069    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:34:21.803307 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:21.803279    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 17:34:35.457840 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:35.457786    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:37.483841 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:37.483805    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:58.919195 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:58.919157    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:59.081373 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:34:59.081322    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:31.348967 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:31.348925    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:31.700191 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:31.700103    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:35.758558 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:35.758526    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:35.922214 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:35.922175    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:37.869788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:37.869755    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:37.960128 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:37.960075    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-txfxd"]
Jul 16 17:35:37.960488 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:37.960473    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf120965-04e8-4b7e-a3b9-cd66441e0f8d" containerName="console"
Jul 16 17:35:37.960530 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:37.960490    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf120965-04e8-4b7e-a3b9-cd66441e0f8d" containerName="console"
Jul 16 17:35:37.960563 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:37.960548    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf120965-04e8-4b7e-a3b9-cd66441e0f8d" containerName="console"
Jul 16 17:35:37.963726 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:37.963702    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-txfxd"
Jul 16 17:35:37.968024 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:37.968004    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 16 17:35:37.969213 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:37.969194    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 16 17:35:37.969319 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:37.969194    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2sdzm\""
Jul 16 17:35:37.995988 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:37.995958    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-txfxd"]
Jul 16 17:35:38.123738 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:38.123642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a19d3942-8a82-4081-a73f-0e8b88a43cbc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-txfxd\" (UID: \"a19d3942-8a82-4081-a73f-0e8b88a43cbc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-txfxd"
Jul 16 17:35:38.123922 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:38.123756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zb6h\" (UniqueName: \"kubernetes.io/projected/a19d3942-8a82-4081-a73f-0e8b88a43cbc-kube-api-access-2zb6h\") pod \"cert-manager-webhook-6486ffd997-txfxd\" (UID: \"a19d3942-8a82-4081-a73f-0e8b88a43cbc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-txfxd"
Jul 16 17:35:38.224922 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:38.224888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a19d3942-8a82-4081-a73f-0e8b88a43cbc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-txfxd\" (UID: \"a19d3942-8a82-4081-a73f-0e8b88a43cbc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-txfxd"
Jul 16 17:35:38.225162 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:38.224938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zb6h\" (UniqueName: \"kubernetes.io/projected/a19d3942-8a82-4081-a73f-0e8b88a43cbc-kube-api-access-2zb6h\") pod \"cert-manager-webhook-6486ffd997-txfxd\" (UID: \"a19d3942-8a82-4081-a73f-0e8b88a43cbc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-txfxd"
Jul 16 17:35:38.241555 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:38.241525    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zb6h\" (UniqueName: \"kubernetes.io/projected/a19d3942-8a82-4081-a73f-0e8b88a43cbc-kube-api-access-2zb6h\") pod \"cert-manager-webhook-6486ffd997-txfxd\" (UID: \"a19d3942-8a82-4081-a73f-0e8b88a43cbc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-txfxd"
Jul 16 17:35:38.243743 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:38.243718    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a19d3942-8a82-4081-a73f-0e8b88a43cbc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-txfxd\" (UID: \"a19d3942-8a82-4081-a73f-0e8b88a43cbc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-txfxd"
Jul 16 17:35:38.282623 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:38.282585    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-txfxd"
Jul 16 17:35:38.462233 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:35:38.462199    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda19d3942_8a82_4081_a73f_0e8b88a43cbc.slice/crio-fdccfb23ef2da6971b7a81b99ecaa5fef966ef41a1e5570d56d59acac3e981c7 WatchSource:0}: Error finding container fdccfb23ef2da6971b7a81b99ecaa5fef966ef41a1e5570d56d59acac3e981c7: Status 404 returned error can't find the container with id fdccfb23ef2da6971b7a81b99ecaa5fef966ef41a1e5570d56d59acac3e981c7
Jul 16 17:35:38.463017 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:38.462988    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-txfxd"]
Jul 16 17:35:38.464113 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:38.464096    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:35:38.847382 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:38.847290    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-txfxd" event={"ID":"a19d3942-8a82-4081-a73f-0e8b88a43cbc","Type":"ContainerStarted","Data":"fdccfb23ef2da6971b7a81b99ecaa5fef966ef41a1e5570d56d59acac3e981c7"}
Jul 16 17:35:38.897341 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:38.897305    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:39.116460 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:39.116370    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:40.086262 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:40.086226    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:41.494755 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:41.494721    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:41.971568 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:41.971522    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:42.066053 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:42.066002    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:42.867089 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:42.866973    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-txfxd" event={"ID":"a19d3942-8a82-4081-a73f-0e8b88a43cbc","Type":"ContainerStarted","Data":"8622bfd3a208099f737b1dc5d40705d0efffe70e70c798000442f05f916fc975"}
Jul 16 17:35:42.867514 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:42.867090    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-txfxd"
Jul 16 17:35:42.912440 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:42.912384    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-txfxd" podStartSLOduration=1.896697013 podStartE2EDuration="5.91236374s" totalImagesPullingTime="4.015666727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:42.911389774 +0000 UTC m=+381.466447224" watchObservedRunningTime="2026-07-16 17:35:42.91236374 +0000 UTC m=+381.467421178"
Jul 16 17:35:45.997728 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:45.997699    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-v44qk"]
Jul 16 17:35:46.000733 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.000714    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-v44qk"
Jul 16 17:35:46.004293 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.004273    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-kgrws\""
Jul 16 17:35:46.024754 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.024723    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-v44qk"]
Jul 16 17:35:46.092517 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.092482    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da321009-bc99-4dee-8acb-4a2db9f6fee6-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-v44qk\" (UID: \"da321009-bc99-4dee-8acb-4a2db9f6fee6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-v44qk"
Jul 16 17:35:46.092517 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.092519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7phg\" (UniqueName: \"kubernetes.io/projected/da321009-bc99-4dee-8acb-4a2db9f6fee6-kube-api-access-x7phg\") pod \"cert-manager-cainjector-559cdd8c87-v44qk\" (UID: \"da321009-bc99-4dee-8acb-4a2db9f6fee6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-v44qk"
Jul 16 17:35:46.193546 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.193502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da321009-bc99-4dee-8acb-4a2db9f6fee6-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-v44qk\" (UID: \"da321009-bc99-4dee-8acb-4a2db9f6fee6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-v44qk"
Jul 16 17:35:46.193546 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.193541    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7phg\" (UniqueName: \"kubernetes.io/projected/da321009-bc99-4dee-8acb-4a2db9f6fee6-kube-api-access-x7phg\") pod \"cert-manager-cainjector-559cdd8c87-v44qk\" (UID: \"da321009-bc99-4dee-8acb-4a2db9f6fee6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-v44qk"
Jul 16 17:35:46.206546 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.206520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7phg\" (UniqueName: \"kubernetes.io/projected/da321009-bc99-4dee-8acb-4a2db9f6fee6-kube-api-access-x7phg\") pod \"cert-manager-cainjector-559cdd8c87-v44qk\" (UID: \"da321009-bc99-4dee-8acb-4a2db9f6fee6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-v44qk"
Jul 16 17:35:46.206975 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.206958    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da321009-bc99-4dee-8acb-4a2db9f6fee6-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-v44qk\" (UID: \"da321009-bc99-4dee-8acb-4a2db9f6fee6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-v44qk"
Jul 16 17:35:46.309866 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.309775    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-v44qk"
Jul 16 17:35:46.452023 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.451989    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-v44qk"]
Jul 16 17:35:46.455723 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:35:46.455697    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda321009_bc99_4dee_8acb_4a2db9f6fee6.slice/crio-1d5363f144d86967a52e80ef65730cbb8ef3c406aa1ff2f23f8e9e039b5d9bb4 WatchSource:0}: Error finding container 1d5363f144d86967a52e80ef65730cbb8ef3c406aa1ff2f23f8e9e039b5d9bb4: Status 404 returned error can't find the container with id 1d5363f144d86967a52e80ef65730cbb8ef3c406aa1ff2f23f8e9e039b5d9bb4
Jul 16 17:35:46.884861 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.884826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-v44qk" event={"ID":"da321009-bc99-4dee-8acb-4a2db9f6fee6","Type":"ContainerStarted","Data":"d48000f3f72409d38b46002e726c9f5f889d249e312aabffa7b38806be5b7f33"}
Jul 16 17:35:46.884861 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.884865    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-v44qk" event={"ID":"da321009-bc99-4dee-8acb-4a2db9f6fee6","Type":"ContainerStarted","Data":"1d5363f144d86967a52e80ef65730cbb8ef3c406aa1ff2f23f8e9e039b5d9bb4"}
Jul 16 17:35:46.908788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:46.908742    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-v44qk" podStartSLOduration=1.908725452 podStartE2EDuration="1.908725452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:46.905978788 +0000 UTC m=+385.461036224" watchObservedRunningTime="2026-07-16 17:35:46.908725452 +0000 UTC m=+385.463782889"
Jul 16 17:35:47.306755 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:47.306719    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:47.482509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:47.482474    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:48.873963 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:48.873932    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-txfxd"
Jul 16 17:35:48.881131 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:48.881101    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:49.046320 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:49.046290    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:54.512237 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:54.512196    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:54.640422 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:54.640384    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:56.721772 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:35:56.721736    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:08.304308 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:08.304268    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:08.475046 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:08.475011    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:08.907047 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:08.907005    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:09.443628 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.443593    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:09.547624 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.547586    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:09.593097 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.593058    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"]
Jul 16 17:36:09.639375 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.639337    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"]
Jul 16 17:36:09.639538 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.639387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.642538 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.642518    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 17:36:09.642660 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.642637    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 17:36:09.642892 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.642872    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 17:36:09.642981 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.642915    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 17:36:09.643182 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.643166    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gfh6s\""
Jul 16 17:36:09.695612 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.695521    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-tmp\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.695612 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.695555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.695612 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.695592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.695870 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.695726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmjdl\" (UniqueName: \"kubernetes.io/projected/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-kube-api-access-pmjdl\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.695870 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.695783    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-manifests\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.787722 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.787688    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:09.796414 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.796391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-tmp\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.796414 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.796417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.796637 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.796449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.796637 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.796487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmjdl\" (UniqueName: \"kubernetes.io/projected/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-kube-api-access-pmjdl\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.796637 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.796622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-manifests\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.796988 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.796962    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-manifests\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.798751 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.798731    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-tmp\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.798963 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.798947    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.799104 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.799084    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.811767 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.811744    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmjdl\" (UniqueName: \"kubernetes.io/projected/894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd-kube-api-access-pmjdl\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-bfr5c\" (UID: \"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.886811 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.886770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:09.950080 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.949970    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:09.981754 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:09.981723    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:10.067717 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:10.067662    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:10.105679 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:10.105645    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"]
Jul 16 17:36:10.108756 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:36:10.108733    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894e4d0d_a83b_44ac_8fc5_bbd0a2d32bfd.slice/crio-8d1688f9e34a4a0db3c9169d05768930b41e774895423ede7fed69ea537317fa WatchSource:0}: Error finding container 8d1688f9e34a4a0db3c9169d05768930b41e774895423ede7fed69ea537317fa: Status 404 returned error can't find the container with id 8d1688f9e34a4a0db3c9169d05768930b41e774895423ede7fed69ea537317fa
Jul 16 17:36:10.141904 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:10.141873    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:10.248555 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:10.248517    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:10.400682 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:10.400653    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:10.995302 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:10.995258    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c" event={"ID":"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd","Type":"ContainerStarted","Data":"8d1688f9e34a4a0db3c9169d05768930b41e774895423ede7fed69ea537317fa"}
Jul 16 17:36:14.010345 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:14.010304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c" event={"ID":"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd","Type":"ContainerStarted","Data":"cf224aaa901b5a61aecb1219a47f10457005ca2645f64fc7e19e79c4fca7fc48"}
Jul 16 17:36:15.015656 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:15.015623    2580 generic.go:356] "Generic (PLEG): container finished" podID="894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd" containerID="cf224aaa901b5a61aecb1219a47f10457005ca2645f64fc7e19e79c4fca7fc48" exitCode=0
Jul 16 17:36:15.016068 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:15.015698    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c" event={"ID":"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd","Type":"ContainerDied","Data":"cf224aaa901b5a61aecb1219a47f10457005ca2645f64fc7e19e79c4fca7fc48"}
Jul 16 17:36:16.021745 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:16.021711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c" event={"ID":"894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd","Type":"ContainerStarted","Data":"e41be6b6498b27cc4a6060e8b4047b1a20e93f0a0ddb18968a145f18f1afff7d"}
Jul 16 17:36:16.022144 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:16.021839    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:16.066241 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:16.066187    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c" podStartSLOduration=2.747456296 podStartE2EDuration="7.066170416s" totalImagesPullingTime="3.258061172s" totalInitContainerRuntime="1.060652948s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:16.065606463 +0000 UTC m=+414.620663900" watchObservedRunningTime="2026-07-16 17:36:16.066170416 +0000 UTC m=+414.621227853"
Jul 16 17:36:18.838649 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:18.838604    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:18.930220 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:18.930179    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:20.691171 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:20.691137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:20.884434 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:20.884396    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:23.083123 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:23.083090    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:23.184529 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:23.184492    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:27.028538 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:27.028509    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-bfr5c"
Jul 16 17:36:29.001846 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.001809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:29.202524 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.202489    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:29.280542 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.280463    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"]
Jul 16 17:36:29.289185 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.289161    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.294874 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.294850    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 16 17:36:29.295151 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.295132    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 16 17:36:29.296516 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.296500    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 17:36:29.312987 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.312955    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:36:29.313977 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.313951    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cfdd5\""
Jul 16 17:36:29.313977 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.313975    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 16 17:36:29.315011 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.314989    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"]
Jul 16 17:36:29.372300 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.372272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87-metrics-cert\") pod \"lws-controller-manager-55f946f648-llbwd\" (UID: \"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.372491 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.372316    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6c6z\" (UniqueName: \"kubernetes.io/projected/9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87-kube-api-access-v6c6z\") pod \"lws-controller-manager-55f946f648-llbwd\" (UID: \"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.372491 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.372410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87-cert\") pod \"lws-controller-manager-55f946f648-llbwd\" (UID: \"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.372491 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.372470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87-manager-config\") pod \"lws-controller-manager-55f946f648-llbwd\" (UID: \"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.444508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.444474    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:29.473793 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.473756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87-metrics-cert\") pod \"lws-controller-manager-55f946f648-llbwd\" (UID: \"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.473913 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.473806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6c6z\" (UniqueName: \"kubernetes.io/projected/9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87-kube-api-access-v6c6z\") pod \"lws-controller-manager-55f946f648-llbwd\" (UID: \"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.473913 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.473851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87-cert\") pod \"lws-controller-manager-55f946f648-llbwd\" (UID: \"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.474115 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.474096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87-manager-config\") pod \"lws-controller-manager-55f946f648-llbwd\" (UID: \"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.474726 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.474700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87-manager-config\") pod \"lws-controller-manager-55f946f648-llbwd\" (UID: \"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.476532 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.476501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87-metrics-cert\") pod \"lws-controller-manager-55f946f648-llbwd\" (UID: \"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.476616 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.476501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87-cert\") pod \"lws-controller-manager-55f946f648-llbwd\" (UID: \"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.486200 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.486172    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6c6z\" (UniqueName: \"kubernetes.io/projected/9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87-kube-api-access-v6c6z\") pod \"lws-controller-manager-55f946f648-llbwd\" (UID: \"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.598493 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.598395    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:29.625345 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.624076    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"]
Jul 16 17:36:29.628473 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.628395    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"
Jul 16 17:36:29.632730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.632420    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 17:36:29.632730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.632481    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pjrmn\""
Jul 16 17:36:29.632730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.632558    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 17:36:29.633381 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.633358    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 17:36:29.645264 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.645237    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 17:36:29.665366 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.657383    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"]
Jul 16 17:36:29.675295 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.675253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40b366b5-5079-4d86-91fc-eb2d0c3569dc-tls-certs\") pod \"kube-auth-proxy-7f8cccc594-jsjr7\" (UID: \"40b366b5-5079-4d86-91fc-eb2d0c3569dc\") " pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"
Jul 16 17:36:29.675592 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.675566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jq44\" (UniqueName: \"kubernetes.io/projected/40b366b5-5079-4d86-91fc-eb2d0c3569dc-kube-api-access-5jq44\") pod \"kube-auth-proxy-7f8cccc594-jsjr7\" (UID: \"40b366b5-5079-4d86-91fc-eb2d0c3569dc\") " pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"
Jul 16 17:36:29.675775 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.675751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40b366b5-5079-4d86-91fc-eb2d0c3569dc-tmp\") pod \"kube-auth-proxy-7f8cccc594-jsjr7\" (UID: \"40b366b5-5079-4d86-91fc-eb2d0c3569dc\") " pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"
Jul 16 17:36:29.729896 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.729784    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:29.777050 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.777003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40b366b5-5079-4d86-91fc-eb2d0c3569dc-tmp\") pod \"kube-auth-proxy-7f8cccc594-jsjr7\" (UID: \"40b366b5-5079-4d86-91fc-eb2d0c3569dc\") " pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"
Jul 16 17:36:29.777229 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.777130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40b366b5-5079-4d86-91fc-eb2d0c3569dc-tls-certs\") pod \"kube-auth-proxy-7f8cccc594-jsjr7\" (UID: \"40b366b5-5079-4d86-91fc-eb2d0c3569dc\") " pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"
Jul 16 17:36:29.777229 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.777150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jq44\" (UniqueName: \"kubernetes.io/projected/40b366b5-5079-4d86-91fc-eb2d0c3569dc-kube-api-access-5jq44\") pod \"kube-auth-proxy-7f8cccc594-jsjr7\" (UID: \"40b366b5-5079-4d86-91fc-eb2d0c3569dc\") " pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"
Jul 16 17:36:29.779407 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.779382    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40b366b5-5079-4d86-91fc-eb2d0c3569dc-tmp\") pod \"kube-auth-proxy-7f8cccc594-jsjr7\" (UID: \"40b366b5-5079-4d86-91fc-eb2d0c3569dc\") " pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"
Jul 16 17:36:29.779750 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.779728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40b366b5-5079-4d86-91fc-eb2d0c3569dc-tls-certs\") pod \"kube-auth-proxy-7f8cccc594-jsjr7\" (UID: \"40b366b5-5079-4d86-91fc-eb2d0c3569dc\") " pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"
Jul 16 17:36:29.787169 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.787093    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"]
Jul 16 17:36:29.789670 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:36:29.789639    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae99efd_1cc9_4b88_a0ea_8d1589e8cb87.slice/crio-b8ab5cd25ccb8ccf161ee1f9c5884d9c166ef3b12fec2ac28cc37ba483841f46 WatchSource:0}: Error finding container b8ab5cd25ccb8ccf161ee1f9c5884d9c166ef3b12fec2ac28cc37ba483841f46: Status 404 returned error can't find the container with id b8ab5cd25ccb8ccf161ee1f9c5884d9c166ef3b12fec2ac28cc37ba483841f46
Jul 16 17:36:29.790160 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.790138    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jq44\" (UniqueName: \"kubernetes.io/projected/40b366b5-5079-4d86-91fc-eb2d0c3569dc-kube-api-access-5jq44\") pod \"kube-auth-proxy-7f8cccc594-jsjr7\" (UID: \"40b366b5-5079-4d86-91fc-eb2d0c3569dc\") " pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"
Jul 16 17:36:29.872641 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.872535    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:29.942287 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.942252    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"
Jul 16 17:36:29.978255 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:29.978179    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:30.087439 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:30.087397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd" event={"ID":"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87","Type":"ContainerStarted","Data":"b8ab5cd25ccb8ccf161ee1f9c5884d9c166ef3b12fec2ac28cc37ba483841f46"}
Jul 16 17:36:30.115220 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:30.115166    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:30.144405 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:30.144381    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7"]
Jul 16 17:36:30.146801 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:36:30.146777    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b366b5_5079_4d86_91fc_eb2d0c3569dc.slice/crio-6e225a633b0f3ad9634f4e93255db83cc8b8a252b42e3a6683a34178b172872c WatchSource:0}: Error finding container 6e225a633b0f3ad9634f4e93255db83cc8b8a252b42e3a6683a34178b172872c: Status 404 returned error can't find the container with id 6e225a633b0f3ad9634f4e93255db83cc8b8a252b42e3a6683a34178b172872c
Jul 16 17:36:30.642504 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:30.642474    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:30.842545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:30.842508    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:31.096544 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:31.096496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7" event={"ID":"40b366b5-5079-4d86-91fc-eb2d0c3569dc","Type":"ContainerStarted","Data":"6e225a633b0f3ad9634f4e93255db83cc8b8a252b42e3a6683a34178b172872c"}
Jul 16 17:36:31.830433 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:31.830397    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:31.942438 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:31.942293    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:33.432254 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:33.432217    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:34.112636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:34.112597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd" event={"ID":"9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87","Type":"ContainerStarted","Data":"b8ca7218cf7512089e2cac80a8c28b69191f4b11f307bbe5caaecdbdadb71e94"}
Jul 16 17:36:34.112844 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:34.112650    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:36:34.113983 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:34.113955    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7" event={"ID":"40b366b5-5079-4d86-91fc-eb2d0c3569dc","Type":"ContainerStarted","Data":"f84c9cf5cbe7076b9dc47372b8483cc330d1234a6dab109760675ff2c3847a1d"}
Jul 16 17:36:34.132437 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:34.132365    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd" podStartSLOduration=1.4650956640000001 podStartE2EDuration="5.132351699s" totalImagesPullingTime="3.667256035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:34.131142053 +0000 UTC m=+432.686199492" watchObservedRunningTime="2026-07-16 17:36:34.132351699 +0000 UTC m=+432.687409136"
Jul 16 17:36:34.156678 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:34.156626    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f8cccc594-jsjr7" podStartSLOduration=1.843803521 podStartE2EDuration="5.156610714s" totalImagesPullingTime="3.312807193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:34.154550322 +0000 UTC m=+432.709607760" watchObservedRunningTime="2026-07-16 17:36:34.156610714 +0000 UTC m=+432.711668150"
Jul 16 17:36:38.711622 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:38.711582    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:38.828762 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:38.828718    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:39.628261 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:39.628228    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:39.898313 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:39.898210    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:39.993108 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:39.993072    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:40.769566 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:40.769530    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:41.019904 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:41.019810    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:41.129549 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:41.129508    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:42.100212 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:42.100164    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:42.276359 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:42.276326    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:43.304760 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:43.304630    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:45.121266 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:36:45.121235    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55f946f648-llbwd"
Jul 16 17:37:02.433626 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.432528    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-669ccf5889-t256d"]
Jul 16 17:37:02.441069 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.441018    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.465613 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.465574    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669ccf5889-t256d"]
Jul 16 17:37:02.577631 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.577601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-console-oauth-config\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.577832 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.577642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-console-serving-cert\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.577832 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.577718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-trusted-ca-bundle\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.577832 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.577751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hsqw\" (UniqueName: \"kubernetes.io/projected/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-kube-api-access-7hsqw\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.577832 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.577779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-oauth-serving-cert\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.577832 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.577820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-console-config\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.578113 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.577903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-service-ca\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.578113 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.577935    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:02.679181 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.679137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-service-ca\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.679181 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.679180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-console-oauth-config\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.679404 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.679202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-console-serving-cert\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.679404 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.679244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-trusted-ca-bundle\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.679404 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.679279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hsqw\" (UniqueName: \"kubernetes.io/projected/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-kube-api-access-7hsqw\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.679404 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.679306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-oauth-serving-cert\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.679404 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.679344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-console-config\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.680089 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.680065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-console-config\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.680089 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.680078    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-oauth-serving-cert\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.680245 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.680098    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-service-ca\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.680245 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.680150    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-trusted-ca-bundle\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.682303 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.682276    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-console-oauth-config\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.682518 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.682496    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-console-serving-cert\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.690114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.690022    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hsqw\" (UniqueName: \"kubernetes.io/projected/ed7ce6ae-59c0-4835-85ca-43be813d2fa5-kube-api-access-7hsqw\") pod \"console-669ccf5889-t256d\" (UID: \"ed7ce6ae-59c0-4835-85ca-43be813d2fa5\") " pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.751112 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.751074    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:02.903939 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:02.903905    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669ccf5889-t256d"]
Jul 16 17:37:02.907426 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:37:02.907389    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7ce6ae_59c0_4835_85ca_43be813d2fa5.slice/crio-2de5e372d3342cec20e9e8b7565cfdb8b52eeab5422451ac9868feef6a591ece WatchSource:0}: Error finding container 2de5e372d3342cec20e9e8b7565cfdb8b52eeab5422451ac9868feef6a591ece: Status 404 returned error can't find the container with id 2de5e372d3342cec20e9e8b7565cfdb8b52eeab5422451ac9868feef6a591ece
Jul 16 17:37:03.250557 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:03.250456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669ccf5889-t256d" event={"ID":"ed7ce6ae-59c0-4835-85ca-43be813d2fa5","Type":"ContainerStarted","Data":"32897c8fe1d208840873a56a52438aebbbc02c990bffd0fbe3f7fa8e9a288517"}
Jul 16 17:37:03.250557 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:03.250528    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669ccf5889-t256d" event={"ID":"ed7ce6ae-59c0-4835-85ca-43be813d2fa5","Type":"ContainerStarted","Data":"2de5e372d3342cec20e9e8b7565cfdb8b52eeab5422451ac9868feef6a591ece"}
Jul 16 17:37:03.273478 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:03.273423    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-669ccf5889-t256d" podStartSLOduration=1.273405784 podStartE2EDuration="1.273405784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:37:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:37:03.27219959 +0000 UTC m=+461.827257050" watchObservedRunningTime="2026-07-16 17:37:03.273405784 +0000 UTC m=+461.828463220"
Jul 16 17:37:03.768567 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:03.768529    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:12.751883 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:12.751828    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:12.752390 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:12.751954    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:12.756884 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:12.756860    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:13.304070 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:13.304024    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-669ccf5889-t256d"
Jul 16 17:37:13.360489 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:13.360457    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-544c9b9886-rz7mg"]
Jul 16 17:37:13.513987 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:13.513941    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:14.462048 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:14.461984    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:14.520173 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:14.520138    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:21.839051 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:21.839013    2580 scope.go:117] "RemoveContainer" containerID="20353943eb137aa598557f50021e40106a10c357eeb769782ec8df462c7192b8"
Jul 16 17:37:30.477476 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:30.477437    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:30.576181 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:30.576147    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:30.709759 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:30.709705    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:31.426367 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:31.426330    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:31.629807 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:31.629778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:38.381539 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.381495    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-544c9b9886-rz7mg" podUID="4e9a60b1-8e8f-476e-a620-35c4e542903a" containerName="console" containerID="cri-o://be5c47bf4f923889e2e22cd6d1470cc763ceed018d5d30bd4f3a543d68edc6d6" gracePeriod=15
Jul 16 17:37:38.635462 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.635402    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:37:38.713928 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.713893    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-service-ca\") pod \"4e9a60b1-8e8f-476e-a620-35c4e542903a\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") "
Jul 16 17:37:38.714151 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.713938    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-oauth-serving-cert\") pod \"4e9a60b1-8e8f-476e-a620-35c4e542903a\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") "
Jul 16 17:37:38.714151 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.713965    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-trusted-ca-bundle\") pod \"4e9a60b1-8e8f-476e-a620-35c4e542903a\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") "
Jul 16 17:37:38.714151 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.713982    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-oauth-config\") pod \"4e9a60b1-8e8f-476e-a620-35c4e542903a\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") "
Jul 16 17:37:38.714151 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.714124    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf8pz\" (UniqueName: \"kubernetes.io/projected/4e9a60b1-8e8f-476e-a620-35c4e542903a-kube-api-access-rf8pz\") pod \"4e9a60b1-8e8f-476e-a620-35c4e542903a\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") "
Jul 16 17:37:38.714383 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.714176    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-config\") pod \"4e9a60b1-8e8f-476e-a620-35c4e542903a\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") "
Jul 16 17:37:38.714383 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.714271    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-serving-cert\") pod \"4e9a60b1-8e8f-476e-a620-35c4e542903a\" (UID: \"4e9a60b1-8e8f-476e-a620-35c4e542903a\") "
Jul 16 17:37:38.714535 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.714500    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-service-ca" (OuterVolumeSpecName: "service-ca") pod "4e9a60b1-8e8f-476e-a620-35c4e542903a" (UID: "4e9a60b1-8e8f-476e-a620-35c4e542903a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:37:38.714640 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.714398    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4e9a60b1-8e8f-476e-a620-35c4e542903a" (UID: "4e9a60b1-8e8f-476e-a620-35c4e542903a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:37:38.714640 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.714574    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-config" (OuterVolumeSpecName: "console-config") pod "4e9a60b1-8e8f-476e-a620-35c4e542903a" (UID: "4e9a60b1-8e8f-476e-a620-35c4e542903a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:37:38.714750 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.714611    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-service-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:37:38.714750 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.714733    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4e9a60b1-8e8f-476e-a620-35c4e542903a" (UID: "4e9a60b1-8e8f-476e-a620-35c4e542903a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:37:38.716244 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.716213    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4e9a60b1-8e8f-476e-a620-35c4e542903a" (UID: "4e9a60b1-8e8f-476e-a620-35c4e542903a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:37:38.716347 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.716309    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4e9a60b1-8e8f-476e-a620-35c4e542903a" (UID: "4e9a60b1-8e8f-476e-a620-35c4e542903a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:37:38.716347 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.716324    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e9a60b1-8e8f-476e-a620-35c4e542903a-kube-api-access-rf8pz" (OuterVolumeSpecName: "kube-api-access-rf8pz") pod "4e9a60b1-8e8f-476e-a620-35c4e542903a" (UID: "4e9a60b1-8e8f-476e-a620-35c4e542903a"). InnerVolumeSpecName "kube-api-access-rf8pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:37:38.815816 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.815780    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:37:38.815816 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.815810    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-serving-cert\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:37:38.815816 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.815821    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-oauth-serving-cert\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:37:38.816077 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.815829    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9a60b1-8e8f-476e-a620-35c4e542903a-trusted-ca-bundle\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:37:38.816077 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.815838    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e9a60b1-8e8f-476e-a620-35c4e542903a-console-oauth-config\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:37:38.816077 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:38.815847    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf8pz\" (UniqueName: \"kubernetes.io/projected/4e9a60b1-8e8f-476e-a620-35c4e542903a-kube-api-access-rf8pz\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:37:39.420417 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:39.420383    2580 generic.go:356] "Generic (PLEG): container finished" podID="4e9a60b1-8e8f-476e-a620-35c4e542903a" containerID="be5c47bf4f923889e2e22cd6d1470cc763ceed018d5d30bd4f3a543d68edc6d6" exitCode=0
Jul 16 17:37:39.420861 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:39.420424    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544c9b9886-rz7mg"
Jul 16 17:37:39.420861 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:39.420433    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544c9b9886-rz7mg" event={"ID":"4e9a60b1-8e8f-476e-a620-35c4e542903a","Type":"ContainerDied","Data":"be5c47bf4f923889e2e22cd6d1470cc763ceed018d5d30bd4f3a543d68edc6d6"}
Jul 16 17:37:39.420861 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:39.420486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544c9b9886-rz7mg" event={"ID":"4e9a60b1-8e8f-476e-a620-35c4e542903a","Type":"ContainerDied","Data":"175ef77d635371253ad8ef765bc038bbf5766f750fac8d5cafed37e2e3da71e3"}
Jul 16 17:37:39.420861 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:39.420516    2580 scope.go:117] "RemoveContainer" containerID="be5c47bf4f923889e2e22cd6d1470cc763ceed018d5d30bd4f3a543d68edc6d6"
Jul 16 17:37:39.429390 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:39.429372    2580 scope.go:117] "RemoveContainer" containerID="be5c47bf4f923889e2e22cd6d1470cc763ceed018d5d30bd4f3a543d68edc6d6"
Jul 16 17:37:39.429637 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:37:39.429620    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be5c47bf4f923889e2e22cd6d1470cc763ceed018d5d30bd4f3a543d68edc6d6\": container with ID starting with be5c47bf4f923889e2e22cd6d1470cc763ceed018d5d30bd4f3a543d68edc6d6 not found: ID does not exist" containerID="be5c47bf4f923889e2e22cd6d1470cc763ceed018d5d30bd4f3a543d68edc6d6"
Jul 16 17:37:39.429698 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:39.429644    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be5c47bf4f923889e2e22cd6d1470cc763ceed018d5d30bd4f3a543d68edc6d6"} err="failed to get container status \"be5c47bf4f923889e2e22cd6d1470cc763ceed018d5d30bd4f3a543d68edc6d6\": rpc error: code = NotFound desc = could not find container \"be5c47bf4f923889e2e22cd6d1470cc763ceed018d5d30bd4f3a543d68edc6d6\": container with ID starting with be5c47bf4f923889e2e22cd6d1470cc763ceed018d5d30bd4f3a543d68edc6d6 not found: ID does not exist"
Jul 16 17:37:39.444788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:39.444761    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-544c9b9886-rz7mg"]
Jul 16 17:37:39.449470 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:39.449445    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-544c9b9886-rz7mg"]
Jul 16 17:37:39.966291 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:39.966260    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e9a60b1-8e8f-476e-a620-35c4e542903a" path="/var/lib/kubelet/pods/4e9a60b1-8e8f-476e-a620-35c4e542903a/volumes"
Jul 16 17:37:59.689900 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:37:59.689860    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:03.432953 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:03.432915    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:06.352263 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:06.352225    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:09.698660 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:09.698628    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:10.954311 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:10.954276    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:11.051479 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:11.051440    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:11.640447 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:11.640414    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:12.703150 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:12.703108    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:15.500766 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:15.500671    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:17.266812 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:17.266770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:17.370952 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:17.370911    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:20.646623 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:20.646587    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:20.748565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:20.748527    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:21.497525 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.497493    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"]
Jul 16 17:38:21.497895 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.497882    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e9a60b1-8e8f-476e-a620-35c4e542903a" containerName="console"
Jul 16 17:38:21.497939 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.497898    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e9a60b1-8e8f-476e-a620-35c4e542903a" containerName="console"
Jul 16 17:38:21.497974 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.497962    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e9a60b1-8e8f-476e-a620-35c4e542903a" containerName="console"
Jul 16 17:38:21.501092 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.501067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"
Jul 16 17:38:21.503734 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.503711    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 16 17:38:21.503941 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.503925    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2tmqz\""
Jul 16 17:38:21.504083 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.504057    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 17:38:21.504196 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.504143    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 17:38:21.505264 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.505247    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 16 17:38:21.511777 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.511733    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"]
Jul 16 17:38:21.512081 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.511898    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:21.603336 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.603296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/323e9254-61a5-4cf1-8cae-50a86b329b57-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9vczq\" (UID: \"323e9254-61a5-4cf1-8cae-50a86b329b57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"
Jul 16 17:38:21.603336 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.603336    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/323e9254-61a5-4cf1-8cae-50a86b329b57-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9vczq\" (UID: \"323e9254-61a5-4cf1-8cae-50a86b329b57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"
Jul 16 17:38:21.603554 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.603449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t64gz\" (UniqueName: \"kubernetes.io/projected/323e9254-61a5-4cf1-8cae-50a86b329b57-kube-api-access-t64gz\") pod \"kuadrant-console-plugin-66b5774985-9vczq\" (UID: \"323e9254-61a5-4cf1-8cae-50a86b329b57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"
Jul 16 17:38:21.703930 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.703891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/323e9254-61a5-4cf1-8cae-50a86b329b57-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9vczq\" (UID: \"323e9254-61a5-4cf1-8cae-50a86b329b57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"
Jul 16 17:38:21.704348 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.703981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t64gz\" (UniqueName: \"kubernetes.io/projected/323e9254-61a5-4cf1-8cae-50a86b329b57-kube-api-access-t64gz\") pod \"kuadrant-console-plugin-66b5774985-9vczq\" (UID: \"323e9254-61a5-4cf1-8cae-50a86b329b57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"
Jul 16 17:38:21.704348 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.704064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/323e9254-61a5-4cf1-8cae-50a86b329b57-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9vczq\" (UID: \"323e9254-61a5-4cf1-8cae-50a86b329b57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"
Jul 16 17:38:21.704576 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.704556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/323e9254-61a5-4cf1-8cae-50a86b329b57-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9vczq\" (UID: \"323e9254-61a5-4cf1-8cae-50a86b329b57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"
Jul 16 17:38:21.706445 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.706428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/323e9254-61a5-4cf1-8cae-50a86b329b57-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9vczq\" (UID: \"323e9254-61a5-4cf1-8cae-50a86b329b57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"
Jul 16 17:38:21.714687 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.714664    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t64gz\" (UniqueName: \"kubernetes.io/projected/323e9254-61a5-4cf1-8cae-50a86b329b57-kube-api-access-t64gz\") pod \"kuadrant-console-plugin-66b5774985-9vczq\" (UID: \"323e9254-61a5-4cf1-8cae-50a86b329b57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"
Jul 16 17:38:21.814912 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.814830    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2tmqz\""
Jul 16 17:38:21.822438 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.822416    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"
Jul 16 17:38:21.972205 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:38:21.967221    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod323e9254_61a5_4cf1_8cae_50a86b329b57.slice/crio-a0a80581c6302f95320db2037451d14356e214f21161a8860fc2c88fe5371a05 WatchSource:0}: Error finding container a0a80581c6302f95320db2037451d14356e214f21161a8860fc2c88fe5371a05: Status 404 returned error can't find the container with id a0a80581c6302f95320db2037451d14356e214f21161a8860fc2c88fe5371a05
Jul 16 17:38:21.972816 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:21.972772    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq"]
Jul 16 17:38:22.251488 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:22.251451    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:22.620509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:22.620422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq" event={"ID":"323e9254-61a5-4cf1-8cae-50a86b329b57","Type":"ContainerStarted","Data":"a0a80581c6302f95320db2037451d14356e214f21161a8860fc2c88fe5371a05"}
Jul 16 17:38:24.031932 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:24.031892    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:24.179526 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:24.179490    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:31.476449 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.476404    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"]
Jul 16 17:38:31.485382 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.485352    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:31.488554 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.488521    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8cgsj\""
Jul 16 17:38:31.493645 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.493612    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"]
Jul 16 17:38:31.605788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.605742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vshhz\" (UniqueName: \"kubernetes.io/projected/a2ec30a5-a880-4efa-85d8-b00d10658254-kube-api-access-vshhz\") pod \"kuadrant-operator-controller-manager-55467d9f7-f6v8k\" (UID: \"a2ec30a5-a880-4efa-85d8-b00d10658254\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:31.605985 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.605883    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2ec30a5-a880-4efa-85d8-b00d10658254-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-f6v8k\" (UID: \"a2ec30a5-a880-4efa-85d8-b00d10658254\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:31.707131 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.707094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2ec30a5-a880-4efa-85d8-b00d10658254-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-f6v8k\" (UID: \"a2ec30a5-a880-4efa-85d8-b00d10658254\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:31.707323 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.707211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vshhz\" (UniqueName: \"kubernetes.io/projected/a2ec30a5-a880-4efa-85d8-b00d10658254-kube-api-access-vshhz\") pod \"kuadrant-operator-controller-manager-55467d9f7-f6v8k\" (UID: \"a2ec30a5-a880-4efa-85d8-b00d10658254\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:31.707550 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.707526    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2ec30a5-a880-4efa-85d8-b00d10658254-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-f6v8k\" (UID: \"a2ec30a5-a880-4efa-85d8-b00d10658254\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:31.717933 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.717904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vshhz\" (UniqueName: \"kubernetes.io/projected/a2ec30a5-a880-4efa-85d8-b00d10658254-kube-api-access-vshhz\") pod \"kuadrant-operator-controller-manager-55467d9f7-f6v8k\" (UID: \"a2ec30a5-a880-4efa-85d8-b00d10658254\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:31.801089 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.800994    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:31.841541 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.841502    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"]
Jul 16 17:38:31.853903 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.853846    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"]
Jul 16 17:38:31.868454 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.868399    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"]
Jul 16 17:38:31.873901 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.873872    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"
Jul 16 17:38:31.891886 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:31.891840    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"]
Jul 16 17:38:32.011157 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:32.011117    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf4010aa-4c53-49ff-84d9-87cbead1ec9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zldwl\" (UID: \"cf4010aa-4c53-49ff-84d9-87cbead1ec9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"
Jul 16 17:38:32.011359 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:32.011296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq2fh\" (UniqueName: \"kubernetes.io/projected/cf4010aa-4c53-49ff-84d9-87cbead1ec9f-kube-api-access-vq2fh\") pod \"kuadrant-operator-controller-manager-55467d9f7-zldwl\" (UID: \"cf4010aa-4c53-49ff-84d9-87cbead1ec9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"
Jul 16 17:38:32.112436 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:32.112111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq2fh\" (UniqueName: \"kubernetes.io/projected/cf4010aa-4c53-49ff-84d9-87cbead1ec9f-kube-api-access-vq2fh\") pod \"kuadrant-operator-controller-manager-55467d9f7-zldwl\" (UID: \"cf4010aa-4c53-49ff-84d9-87cbead1ec9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"
Jul 16 17:38:32.112436 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:32.112191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf4010aa-4c53-49ff-84d9-87cbead1ec9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zldwl\" (UID: \"cf4010aa-4c53-49ff-84d9-87cbead1ec9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"
Jul 16 17:38:32.112721 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:32.112699    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf4010aa-4c53-49ff-84d9-87cbead1ec9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zldwl\" (UID: \"cf4010aa-4c53-49ff-84d9-87cbead1ec9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"
Jul 16 17:38:32.135330 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:32.135290    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq2fh\" (UniqueName: \"kubernetes.io/projected/cf4010aa-4c53-49ff-84d9-87cbead1ec9f-kube-api-access-vq2fh\") pod \"kuadrant-operator-controller-manager-55467d9f7-zldwl\" (UID: \"cf4010aa-4c53-49ff-84d9-87cbead1ec9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"
Jul 16 17:38:32.188661 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:32.188616    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"
Jul 16 17:38:34.262923 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:34.262885    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:34.361753 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:34.361712    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:34.847134 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:34.847085    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:34.958580 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:34.958545    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:38.838922 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:38.838885    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:38.944846 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:38.944805    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:42.040048 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:42.039990    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:42.140414 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:42.140374    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:45.644891 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:45.644844    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:45.712728 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:45.712698    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:45.767586 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:45.767553    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"]
Jul 16 17:38:45.913026 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:38:45.912949    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4010aa_4c53_49ff_84d9_87cbead1ec9f.slice/crio-8eb39567ba81b437dc1fa1911a94c9b21a377b469374964584340d0695a68b46 WatchSource:0}: Error finding container 8eb39567ba81b437dc1fa1911a94c9b21a377b469374964584340d0695a68b46: Status 404 returned error can't find the container with id 8eb39567ba81b437dc1fa1911a94c9b21a377b469374964584340d0695a68b46
Jul 16 17:38:46.751918 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:46.751871    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl" event={"ID":"cf4010aa-4c53-49ff-84d9-87cbead1ec9f","Type":"ContainerStarted","Data":"8eb39567ba81b437dc1fa1911a94c9b21a377b469374964584340d0695a68b46"}
Jul 16 17:38:46.753382 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:46.753344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq" event={"ID":"323e9254-61a5-4cf1-8cae-50a86b329b57","Type":"ContainerStarted","Data":"a05f8cc8e818bfff8648a14ac0d5a110e4ca1211b708b64e3424b6696f3e9592"}
Jul 16 17:38:46.777234 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:46.777180    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9vczq" podStartSLOduration=1.794828623 podStartE2EDuration="25.777160636s" totalImagesPullingTime="23.982332013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:38:46.775501381 +0000 UTC m=+565.330558820" watchObservedRunningTime="2026-07-16 17:38:46.777160636 +0000 UTC m=+565.332218073"
Jul 16 17:38:48.274958 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:38:48.274904    2580 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-f6v8k_kuadrant-system_a2ec30a5-a880-4efa-85d8-b00d10658254_0(761232c3677bc0a1c4f2c5464c54cfe107cf1f32e565e6f98cb9951593d81141): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-f6v8k to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 16 17:38:48.275338 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:38:48.274994    2580 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-f6v8k_kuadrant-system_a2ec30a5-a880-4efa-85d8-b00d10658254_0(761232c3677bc0a1c4f2c5464c54cfe107cf1f32e565e6f98cb9951593d81141): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-f6v8k to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:48.764132 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:48.764103    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:48.766696 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:38:48.766667    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-f6v8k\" is forbidden: User \"system:node:ip-10-0-130-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-51.ec2.internal' and this object" podUID="a2ec30a5-a880-4efa-85d8-b00d10658254" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:48.784569 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:48.784542    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:48.787256 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:38:48.787232    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-f6v8k\" is forbidden: User \"system:node:ip-10-0-130-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-51.ec2.internal' and this object" podUID="a2ec30a5-a880-4efa-85d8-b00d10658254" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:48.887025 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:48.886986    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vshhz\" (UniqueName: \"kubernetes.io/projected/a2ec30a5-a880-4efa-85d8-b00d10658254-kube-api-access-vshhz\") pod \"a2ec30a5-a880-4efa-85d8-b00d10658254\" (UID: \"a2ec30a5-a880-4efa-85d8-b00d10658254\") "
Jul 16 17:38:48.887237 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:48.887074    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2ec30a5-a880-4efa-85d8-b00d10658254-extensions-socket-volume\") pod \"a2ec30a5-a880-4efa-85d8-b00d10658254\" (UID: \"a2ec30a5-a880-4efa-85d8-b00d10658254\") "
Jul 16 17:38:48.887604 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:48.887575    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2ec30a5-a880-4efa-85d8-b00d10658254-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a2ec30a5-a880-4efa-85d8-b00d10658254" (UID: "a2ec30a5-a880-4efa-85d8-b00d10658254"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:38:48.889342 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:48.889313    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2ec30a5-a880-4efa-85d8-b00d10658254-kube-api-access-vshhz" (OuterVolumeSpecName: "kube-api-access-vshhz") pod "a2ec30a5-a880-4efa-85d8-b00d10658254" (UID: "a2ec30a5-a880-4efa-85d8-b00d10658254"). InnerVolumeSpecName "kube-api-access-vshhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:38:48.988183 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:48.988146    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vshhz\" (UniqueName: \"kubernetes.io/projected/a2ec30a5-a880-4efa-85d8-b00d10658254-kube-api-access-vshhz\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:38:48.988183 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:48.988177    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2ec30a5-a880-4efa-85d8-b00d10658254-extensions-socket-volume\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:38:49.771381 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:49.771348    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:49.774171 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:38:49.774133    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-f6v8k\" is forbidden: User \"system:node:ip-10-0-130-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-51.ec2.internal' and this object" podUID="a2ec30a5-a880-4efa-85d8-b00d10658254" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:49.783401 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:38:49.780586    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-f6v8k\" is forbidden: User \"system:node:ip-10-0-130-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-51.ec2.internal' and this object" podUID="a2ec30a5-a880-4efa-85d8-b00d10658254" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f6v8k"
Jul 16 17:38:49.968245 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:49.968204    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2ec30a5-a880-4efa-85d8-b00d10658254" path="/var/lib/kubelet/pods/a2ec30a5-a880-4efa-85d8-b00d10658254/volumes"
Jul 16 17:38:52.789073 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:52.789014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl" event={"ID":"cf4010aa-4c53-49ff-84d9-87cbead1ec9f","Type":"ContainerStarted","Data":"0f9566025047b14826c35803f2d31bed9085a41017534f5ea470d64ae0e19f45"}
Jul 16 17:38:52.789570 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:52.789137    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"
Jul 16 17:38:52.812959 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:52.812901    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl" podStartSLOduration=15.893732544 podStartE2EDuration="21.812883396s" totalImagesPullingTime="5.919150852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:38:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:38:52.809944429 +0000 UTC m=+571.365001885" watchObservedRunningTime="2026-07-16 17:38:52.812883396 +0000 UTC m=+571.367940832"
Jul 16 17:38:54.733789 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:54.733741    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:54.835299 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:54.835260    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:55.418204 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:55.418167    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:55.493563 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:38:55.493525    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:01.550675 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:01.550633    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:01.653785 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:01.653742    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:03.796203 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:03.796169    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"
Jul 16 17:39:04.843523 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:04.843482    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:04.944347 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:04.944309    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:06.133979 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:06.133946    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:06.233908 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:06.233871    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:08.359103 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:08.359069    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:08.459595 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:08.459562    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:16.351879 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.351839    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"]
Jul 16 17:39:16.352325 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.352055    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl" podUID="cf4010aa-4c53-49ff-84d9-87cbead1ec9f" containerName="manager" containerID="cri-o://0f9566025047b14826c35803f2d31bed9085a41017534f5ea470d64ae0e19f45" gracePeriod=10
Jul 16 17:39:16.608471 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.608386    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"
Jul 16 17:39:16.751896 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.751860    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf4010aa-4c53-49ff-84d9-87cbead1ec9f-extensions-socket-volume\") pod \"cf4010aa-4c53-49ff-84d9-87cbead1ec9f\" (UID: \"cf4010aa-4c53-49ff-84d9-87cbead1ec9f\") "
Jul 16 17:39:16.752129 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.751919    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq2fh\" (UniqueName: \"kubernetes.io/projected/cf4010aa-4c53-49ff-84d9-87cbead1ec9f-kube-api-access-vq2fh\") pod \"cf4010aa-4c53-49ff-84d9-87cbead1ec9f\" (UID: \"cf4010aa-4c53-49ff-84d9-87cbead1ec9f\") "
Jul 16 17:39:16.752430 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.752404    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf4010aa-4c53-49ff-84d9-87cbead1ec9f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cf4010aa-4c53-49ff-84d9-87cbead1ec9f" (UID: "cf4010aa-4c53-49ff-84d9-87cbead1ec9f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:39:16.754241 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.754214    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf4010aa-4c53-49ff-84d9-87cbead1ec9f-kube-api-access-vq2fh" (OuterVolumeSpecName: "kube-api-access-vq2fh") pod "cf4010aa-4c53-49ff-84d9-87cbead1ec9f" (UID: "cf4010aa-4c53-49ff-84d9-87cbead1ec9f"). InnerVolumeSpecName "kube-api-access-vq2fh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:39:16.852601 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.852565    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq2fh\" (UniqueName: \"kubernetes.io/projected/cf4010aa-4c53-49ff-84d9-87cbead1ec9f-kube-api-access-vq2fh\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:39:16.852601 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.852594    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf4010aa-4c53-49ff-84d9-87cbead1ec9f-extensions-socket-volume\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:39:16.882348 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.882254    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:16.905435 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.905399    2580 generic.go:356] "Generic (PLEG): container finished" podID="cf4010aa-4c53-49ff-84d9-87cbead1ec9f" containerID="0f9566025047b14826c35803f2d31bed9085a41017534f5ea470d64ae0e19f45" exitCode=0
Jul 16 17:39:16.905611 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.905446    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"
Jul 16 17:39:16.905611 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.905491    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl" event={"ID":"cf4010aa-4c53-49ff-84d9-87cbead1ec9f","Type":"ContainerDied","Data":"0f9566025047b14826c35803f2d31bed9085a41017534f5ea470d64ae0e19f45"}
Jul 16 17:39:16.905611 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.905545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl" event={"ID":"cf4010aa-4c53-49ff-84d9-87cbead1ec9f","Type":"ContainerDied","Data":"8eb39567ba81b437dc1fa1911a94c9b21a377b469374964584340d0695a68b46"}
Jul 16 17:39:16.905611 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.905569    2580 scope.go:117] "RemoveContainer" containerID="0f9566025047b14826c35803f2d31bed9085a41017534f5ea470d64ae0e19f45"
Jul 16 17:39:16.914730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.914713    2580 scope.go:117] "RemoveContainer" containerID="0f9566025047b14826c35803f2d31bed9085a41017534f5ea470d64ae0e19f45"
Jul 16 17:39:16.915014 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:39:16.914996    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f9566025047b14826c35803f2d31bed9085a41017534f5ea470d64ae0e19f45\": container with ID starting with 0f9566025047b14826c35803f2d31bed9085a41017534f5ea470d64ae0e19f45 not found: ID does not exist" containerID="0f9566025047b14826c35803f2d31bed9085a41017534f5ea470d64ae0e19f45"
Jul 16 17:39:16.915095 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.915025    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f9566025047b14826c35803f2d31bed9085a41017534f5ea470d64ae0e19f45"} err="failed to get container status \"0f9566025047b14826c35803f2d31bed9085a41017534f5ea470d64ae0e19f45\": rpc error: code = NotFound desc = could not find container \"0f9566025047b14826c35803f2d31bed9085a41017534f5ea470d64ae0e19f45\": container with ID starting with 0f9566025047b14826c35803f2d31bed9085a41017534f5ea470d64ae0e19f45 not found: ID does not exist"
Jul 16 17:39:16.935775 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.935730    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"]
Jul 16 17:39:16.944224 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.944198    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zldwl"]
Jul 16 17:39:16.981089 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:16.981056    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:17.965561 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:17.965527    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf4010aa-4c53-49ff-84d9-87cbead1ec9f" path="/var/lib/kubelet/pods/cf4010aa-4c53-49ff-84d9-87cbead1ec9f/volumes"
Jul 16 17:39:20.309643 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:20.309603    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:20.472486 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:20.472450    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:21.833460 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:21.833431    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:39:21.833895 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:21.833710    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:39:22.967836 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:22.967794    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"]
Jul 16 17:39:22.968410 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:22.968390    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf4010aa-4c53-49ff-84d9-87cbead1ec9f" containerName="manager"
Jul 16 17:39:22.968494 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:22.968412    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf4010aa-4c53-49ff-84d9-87cbead1ec9f" containerName="manager"
Jul 16 17:39:22.968549 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:22.968507    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf4010aa-4c53-49ff-84d9-87cbead1ec9f" containerName="manager"
Jul 16 17:39:22.969798 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:22.969766    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:22.972645 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:22.972624    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"
Jul 16 17:39:22.975468 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:22.975446    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 17:39:22.983136 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:22.983113    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"]
Jul 16 17:39:23.066707 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.066676    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"]
Jul 16 17:39:23.078986 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.078949    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:23.111855 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.111815    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0c84c6f-aeea-4f2a-a71d-5e6e814dc316-config-file\") pod \"limitador-limitador-64c94fd64f-s9k2g\" (UID: \"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"
Jul 16 17:39:23.112070 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.111964    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2spz\" (UniqueName: \"kubernetes.io/projected/b0c84c6f-aeea-4f2a-a71d-5e6e814dc316-kube-api-access-h2spz\") pod \"limitador-limitador-64c94fd64f-s9k2g\" (UID: \"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"
Jul 16 17:39:23.149741 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.149705    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:23.213453 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.213406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0c84c6f-aeea-4f2a-a71d-5e6e814dc316-config-file\") pod \"limitador-limitador-64c94fd64f-s9k2g\" (UID: \"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"
Jul 16 17:39:23.213653 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.213489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2spz\" (UniqueName: \"kubernetes.io/projected/b0c84c6f-aeea-4f2a-a71d-5e6e814dc316-kube-api-access-h2spz\") pod \"limitador-limitador-64c94fd64f-s9k2g\" (UID: \"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"
Jul 16 17:39:23.214021 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.214000    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0c84c6f-aeea-4f2a-a71d-5e6e814dc316-config-file\") pod \"limitador-limitador-64c94fd64f-s9k2g\" (UID: \"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"
Jul 16 17:39:23.223373 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.223309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2spz\" (UniqueName: \"kubernetes.io/projected/b0c84c6f-aeea-4f2a-a71d-5e6e814dc316-kube-api-access-h2spz\") pod \"limitador-limitador-64c94fd64f-s9k2g\" (UID: \"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"
Jul 16 17:39:23.283382 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.283353    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"
Jul 16 17:39:23.424386 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.424242    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"]
Jul 16 17:39:23.427349 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:39:23.427315    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c84c6f_aeea_4f2a_a71d_5e6e814dc316.slice/crio-5cf01e0b5c2e7b9ad8b38cc5367b2ac407f6d0a55d887ae4f39f3d900852718b WatchSource:0}: Error finding container 5cf01e0b5c2e7b9ad8b38cc5367b2ac407f6d0a55d887ae4f39f3d900852718b: Status 404 returned error can't find the container with id 5cf01e0b5c2e7b9ad8b38cc5367b2ac407f6d0a55d887ae4f39f3d900852718b
Jul 16 17:39:23.844635 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.844590    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:23.904649 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.904617    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:23.941519 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.941482    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g" event={"ID":"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316","Type":"ContainerStarted","Data":"5cf01e0b5c2e7b9ad8b38cc5367b2ac407f6d0a55d887ae4f39f3d900852718b"}
Jul 16 17:39:23.967174 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.967143    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-qbv78"]
Jul 16 17:39:23.970552 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.970533    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qbv78"
Jul 16 17:39:23.973296 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.973275    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-djg2f\""
Jul 16 17:39:23.978565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:23.978537    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qbv78"]
Jul 16 17:39:24.019567 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:24.019530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvhds\" (UniqueName: \"kubernetes.io/projected/899bd437-8bd8-4234-ab33-7a46ac0083ad-kube-api-access-jvhds\") pod \"authorino-75d556bd77-qbv78\" (UID: \"899bd437-8bd8-4234-ab33-7a46ac0083ad\") " pod="kuadrant-system/authorino-75d556bd77-qbv78"
Jul 16 17:39:24.120135 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:24.120018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvhds\" (UniqueName: \"kubernetes.io/projected/899bd437-8bd8-4234-ab33-7a46ac0083ad-kube-api-access-jvhds\") pod \"authorino-75d556bd77-qbv78\" (UID: \"899bd437-8bd8-4234-ab33-7a46ac0083ad\") " pod="kuadrant-system/authorino-75d556bd77-qbv78"
Jul 16 17:39:24.129542 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:24.129514    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvhds\" (UniqueName: \"kubernetes.io/projected/899bd437-8bd8-4234-ab33-7a46ac0083ad-kube-api-access-jvhds\") pod \"authorino-75d556bd77-qbv78\" (UID: \"899bd437-8bd8-4234-ab33-7a46ac0083ad\") " pod="kuadrant-system/authorino-75d556bd77-qbv78"
Jul 16 17:39:24.280828 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:24.280790    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qbv78"
Jul 16 17:39:24.465852 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:24.465813    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qbv78"]
Jul 16 17:39:24.469189 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:39:24.469152    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod899bd437_8bd8_4234_ab33_7a46ac0083ad.slice/crio-23568d379b93e40c29e1a9776931335cbb9abdb11e84b15888bf8e84b6c4f374 WatchSource:0}: Error finding container 23568d379b93e40c29e1a9776931335cbb9abdb11e84b15888bf8e84b6c4f374: Status 404 returned error can't find the container with id 23568d379b93e40c29e1a9776931335cbb9abdb11e84b15888bf8e84b6c4f374
Jul 16 17:39:24.949332 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:24.949301    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qbv78" event={"ID":"899bd437-8bd8-4234-ab33-7a46ac0083ad","Type":"ContainerStarted","Data":"23568d379b93e40c29e1a9776931335cbb9abdb11e84b15888bf8e84b6c4f374"}
Jul 16 17:39:26.058707 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:26.058624    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:28.973351 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:28.973311    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g" event={"ID":"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316","Type":"ContainerStarted","Data":"45ad419b37185ac3c747846967d9fdf9b6284eab7525d1ecf346938a93cb484c"}
Jul 16 17:39:28.973779 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:28.973383    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"
Jul 16 17:39:28.974786 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:28.974760    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qbv78" event={"ID":"899bd437-8bd8-4234-ab33-7a46ac0083ad","Type":"ContainerStarted","Data":"264af0fcaa241f1c5d62e938b0a3c90a6a4f9a5124d9bc147381a6f8e9874c6b"}
Jul 16 17:39:28.993259 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:28.993212    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g" podStartSLOduration=2.279850311 podStartE2EDuration="6.993196183s" totalImagesPullingTime="4.713345872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:39:28.992004362 +0000 UTC m=+607.547061798" watchObservedRunningTime="2026-07-16 17:39:28.993196183 +0000 UTC m=+607.548253620"
Jul 16 17:39:29.008490 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:29.008430    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-qbv78" podStartSLOduration=2.335057573 podStartE2EDuration="6.008412585s" totalImagesPullingTime="3.673355012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:39:29.006865907 +0000 UTC m=+607.561923345" watchObservedRunningTime="2026-07-16 17:39:29.008412585 +0000 UTC m=+607.563470022"
Jul 16 17:39:37.550243 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:37.550200    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"]
Jul 16 17:39:37.551695 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:37.550401    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g" podUID="b0c84c6f-aeea-4f2a-a71d-5e6e814dc316" containerName="limitador" containerID="cri-o://45ad419b37185ac3c747846967d9fdf9b6284eab7525d1ecf346938a93cb484c" gracePeriod=30
Jul 16 17:39:37.551695 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:37.551025    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"
Jul 16 17:39:38.025355 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:38.025317    2580 generic.go:356] "Generic (PLEG): container finished" podID="b0c84c6f-aeea-4f2a-a71d-5e6e814dc316" containerID="45ad419b37185ac3c747846967d9fdf9b6284eab7525d1ecf346938a93cb484c" exitCode=0
Jul 16 17:39:38.025519 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:38.025364    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g" event={"ID":"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316","Type":"ContainerDied","Data":"45ad419b37185ac3c747846967d9fdf9b6284eab7525d1ecf346938a93cb484c"}
Jul 16 17:39:38.099511 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:38.099481    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"
Jul 16 17:39:38.152030 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:38.151942    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2spz\" (UniqueName: \"kubernetes.io/projected/b0c84c6f-aeea-4f2a-a71d-5e6e814dc316-kube-api-access-h2spz\") pod \"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316\" (UID: \"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316\") "
Jul 16 17:39:38.152030 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:38.152020    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0c84c6f-aeea-4f2a-a71d-5e6e814dc316-config-file\") pod \"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316\" (UID: \"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316\") "
Jul 16 17:39:38.152410 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:38.152384    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0c84c6f-aeea-4f2a-a71d-5e6e814dc316-config-file" (OuterVolumeSpecName: "config-file") pod "b0c84c6f-aeea-4f2a-a71d-5e6e814dc316" (UID: "b0c84c6f-aeea-4f2a-a71d-5e6e814dc316"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:39:38.154120 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:38.154097    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0c84c6f-aeea-4f2a-a71d-5e6e814dc316-kube-api-access-h2spz" (OuterVolumeSpecName: "kube-api-access-h2spz") pod "b0c84c6f-aeea-4f2a-a71d-5e6e814dc316" (UID: "b0c84c6f-aeea-4f2a-a71d-5e6e814dc316"). InnerVolumeSpecName "kube-api-access-h2spz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:39:38.253027 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:38.252988    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2spz\" (UniqueName: \"kubernetes.io/projected/b0c84c6f-aeea-4f2a-a71d-5e6e814dc316-kube-api-access-h2spz\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:39:38.253027 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:38.253019    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0c84c6f-aeea-4f2a-a71d-5e6e814dc316-config-file\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:39:39.031992 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:39.031952    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g" event={"ID":"b0c84c6f-aeea-4f2a-a71d-5e6e814dc316","Type":"ContainerDied","Data":"5cf01e0b5c2e7b9ad8b38cc5367b2ac407f6d0a55d887ae4f39f3d900852718b"}
Jul 16 17:39:39.031992 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:39.031981    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"
Jul 16 17:39:39.032495 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:39.032024    2580 scope.go:117] "RemoveContainer" containerID="45ad419b37185ac3c747846967d9fdf9b6284eab7525d1ecf346938a93cb484c"
Jul 16 17:39:39.056433 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:39.056400    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"]
Jul 16 17:39:39.061487 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:39.061456    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s9k2g"]
Jul 16 17:39:39.965773 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:39.965740    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0c84c6f-aeea-4f2a-a71d-5e6e814dc316" path="/var/lib/kubelet/pods/b0c84c6f-aeea-4f2a-a71d-5e6e814dc316/volumes"
Jul 16 17:39:43.086377 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:43.086339    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:44.225574 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.225539    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cfg49"]
Jul 16 17:39:44.226212 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.226195    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c84c6f-aeea-4f2a-a71d-5e6e814dc316" containerName="limitador"
Jul 16 17:39:44.226261 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.226215    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c84c6f-aeea-4f2a-a71d-5e6e814dc316" containerName="limitador"
Jul 16 17:39:44.226316 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.226305    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0c84c6f-aeea-4f2a-a71d-5e6e814dc316" containerName="limitador"
Jul 16 17:39:44.229839 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.229817    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cfg49"
Jul 16 17:39:44.233346 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.233317    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 17:39:44.233480 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.233317    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 16 17:39:44.234594 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.234572    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qhwgn\""
Jul 16 17:39:44.234678 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.234603    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 17:39:44.238291 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.238269    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cfg49"]
Jul 16 17:39:44.313104 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.313060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldt2h\" (UniqueName: \"kubernetes.io/projected/7c3e96c1-1bda-441a-ad8c-50dfd44c93f3-kube-api-access-ldt2h\") pod \"postgres-69fb4594cf-cfg49\" (UID: \"7c3e96c1-1bda-441a-ad8c-50dfd44c93f3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cfg49"
Jul 16 17:39:44.313104 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.313105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c3e96c1-1bda-441a-ad8c-50dfd44c93f3-data\") pod \"postgres-69fb4594cf-cfg49\" (UID: \"7c3e96c1-1bda-441a-ad8c-50dfd44c93f3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cfg49"
Jul 16 17:39:44.414213 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.414179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldt2h\" (UniqueName: \"kubernetes.io/projected/7c3e96c1-1bda-441a-ad8c-50dfd44c93f3-kube-api-access-ldt2h\") pod \"postgres-69fb4594cf-cfg49\" (UID: \"7c3e96c1-1bda-441a-ad8c-50dfd44c93f3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cfg49"
Jul 16 17:39:44.414479 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.414223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c3e96c1-1bda-441a-ad8c-50dfd44c93f3-data\") pod \"postgres-69fb4594cf-cfg49\" (UID: \"7c3e96c1-1bda-441a-ad8c-50dfd44c93f3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cfg49"
Jul 16 17:39:44.414867 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.414838    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c3e96c1-1bda-441a-ad8c-50dfd44c93f3-data\") pod \"postgres-69fb4594cf-cfg49\" (UID: \"7c3e96c1-1bda-441a-ad8c-50dfd44c93f3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cfg49"
Jul 16 17:39:44.424255 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.424223    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldt2h\" (UniqueName: \"kubernetes.io/projected/7c3e96c1-1bda-441a-ad8c-50dfd44c93f3-kube-api-access-ldt2h\") pod \"postgres-69fb4594cf-cfg49\" (UID: \"7c3e96c1-1bda-441a-ad8c-50dfd44c93f3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cfg49"
Jul 16 17:39:44.541365 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.541266    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cfg49"
Jul 16 17:39:44.674130 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.674022    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cfg49"]
Jul 16 17:39:44.676659 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:39:44.676630    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3e96c1_1bda_441a_ad8c_50dfd44c93f3.slice/crio-1fdfea53d734ec611ee44cf02993d2d433f2bef982eaab983af22d6ff2d0ed8e WatchSource:0}: Error finding container 1fdfea53d734ec611ee44cf02993d2d433f2bef982eaab983af22d6ff2d0ed8e: Status 404 returned error can't find the container with id 1fdfea53d734ec611ee44cf02993d2d433f2bef982eaab983af22d6ff2d0ed8e
Jul 16 17:39:44.952289 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:44.952190    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:45.061112 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:45.061072    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cfg49" event={"ID":"7c3e96c1-1bda-441a-ad8c-50dfd44c93f3","Type":"ContainerStarted","Data":"1fdfea53d734ec611ee44cf02993d2d433f2bef982eaab983af22d6ff2d0ed8e"}
Jul 16 17:39:50.095613 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:50.095570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cfg49" event={"ID":"7c3e96c1-1bda-441a-ad8c-50dfd44c93f3","Type":"ContainerStarted","Data":"bfc3b3ecea684507c9b38b73cbe0e2bf68331d5d24398f29032642c010389140"}
Jul 16 17:39:50.096091 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:50.095648    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cfg49"
Jul 16 17:39:50.115657 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:50.115603    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cfg49" podStartSLOduration=1.13744194 podStartE2EDuration="6.115587235s" totalImagesPullingTime="4.978145295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:39:50.114449107 +0000 UTC m=+628.669506544" watchObservedRunningTime="2026-07-16 17:39:50.115587235 +0000 UTC m=+628.670644671"
Jul 16 17:39:56.130969 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:56.130940    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cfg49"
Jul 16 17:39:56.480759 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:56.480726    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:56.602545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:56.602511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:56.743928 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:56.743849    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptdps"]
Jul 16 17:39:56.748872 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:56.748849    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptdps"
Jul 16 17:39:56.756898 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:56.756871    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptdps"]
Jul 16 17:39:56.835383 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:56.835343    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cjxs\" (UniqueName: \"kubernetes.io/projected/c3d925fe-2aae-4b2f-a77f-5302f06144be-kube-api-access-4cjxs\") pod \"authorino-5d4b67c446-ptdps\" (UID: \"c3d925fe-2aae-4b2f-a77f-5302f06144be\") " pod="kuadrant-system/authorino-5d4b67c446-ptdps"
Jul 16 17:39:56.936834 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:56.936802    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cjxs\" (UniqueName: \"kubernetes.io/projected/c3d925fe-2aae-4b2f-a77f-5302f06144be-kube-api-access-4cjxs\") pod \"authorino-5d4b67c446-ptdps\" (UID: \"c3d925fe-2aae-4b2f-a77f-5302f06144be\") " pod="kuadrant-system/authorino-5d4b67c446-ptdps"
Jul 16 17:39:56.950664 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:56.950630    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cjxs\" (UniqueName: \"kubernetes.io/projected/c3d925fe-2aae-4b2f-a77f-5302f06144be-kube-api-access-4cjxs\") pod \"authorino-5d4b67c446-ptdps\" (UID: \"c3d925fe-2aae-4b2f-a77f-5302f06144be\") " pod="kuadrant-system/authorino-5d4b67c446-ptdps"
Jul 16 17:39:56.985997 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:56.985963    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptdps"]
Jul 16 17:39:56.986325 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:56.986305    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptdps"
Jul 16 17:39:57.020653 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.020620    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-778649574-jw99j"]
Jul 16 17:39:57.025245 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.025226    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778649574-jw99j"
Jul 16 17:39:57.032508 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.032477    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-778649574-jw99j"]
Jul 16 17:39:57.127450 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.127415    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptdps"]
Jul 16 17:39:57.130826 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:39:57.130800    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3d925fe_2aae_4b2f_a77f_5302f06144be.slice/crio-f9dca16a9011e021efe42247d85c17dcf1ff4eb04b43277f60d69fc75aa50e67 WatchSource:0}: Error finding container f9dca16a9011e021efe42247d85c17dcf1ff4eb04b43277f60d69fc75aa50e67: Status 404 returned error can't find the container with id f9dca16a9011e021efe42247d85c17dcf1ff4eb04b43277f60d69fc75aa50e67
Jul 16 17:39:57.137098 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.137066    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptdps" event={"ID":"c3d925fe-2aae-4b2f-a77f-5302f06144be","Type":"ContainerStarted","Data":"f9dca16a9011e021efe42247d85c17dcf1ff4eb04b43277f60d69fc75aa50e67"}
Jul 16 17:39:57.138440 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.138417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh6ng\" (UniqueName: \"kubernetes.io/projected/e2fe0af4-e8b0-4400-9893-72e6676e62d0-kube-api-access-qh6ng\") pod \"authorino-778649574-jw99j\" (UID: \"e2fe0af4-e8b0-4400-9893-72e6676e62d0\") " pod="kuadrant-system/authorino-778649574-jw99j"
Jul 16 17:39:57.196228 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.196183    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-778649574-jw99j"]
Jul 16 17:39:57.196547 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:39:57.196522    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qh6ng], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-778649574-jw99j" podUID="e2fe0af4-e8b0-4400-9893-72e6676e62d0"
Jul 16 17:39:57.226428 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.226379    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c9d797bcd-rrbvh"]
Jul 16 17:39:57.234935 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.234896    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c9d797bcd-rrbvh"
Jul 16 17:39:57.236866 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.236843    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c9d797bcd-rrbvh"]
Jul 16 17:39:57.237542 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.237518    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 17:39:57.239114 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.239092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh6ng\" (UniqueName: \"kubernetes.io/projected/e2fe0af4-e8b0-4400-9893-72e6676e62d0-kube-api-access-qh6ng\") pod \"authorino-778649574-jw99j\" (UID: \"e2fe0af4-e8b0-4400-9893-72e6676e62d0\") " pod="kuadrant-system/authorino-778649574-jw99j"
Jul 16 17:39:57.248134 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.248071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh6ng\" (UniqueName: \"kubernetes.io/projected/e2fe0af4-e8b0-4400-9893-72e6676e62d0-kube-api-access-qh6ng\") pod \"authorino-778649574-jw99j\" (UID: \"e2fe0af4-e8b0-4400-9893-72e6676e62d0\") " pod="kuadrant-system/authorino-778649574-jw99j"
Jul 16 17:39:57.340470 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.340432    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7bff2a06-6ad4-4a2f-b29f-04161691ee44-tls-cert\") pod \"authorino-7c9d797bcd-rrbvh\" (UID: \"7bff2a06-6ad4-4a2f-b29f-04161691ee44\") " pod="kuadrant-system/authorino-7c9d797bcd-rrbvh"
Jul 16 17:39:57.340658 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.340563    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dshm4\" (UniqueName: \"kubernetes.io/projected/7bff2a06-6ad4-4a2f-b29f-04161691ee44-kube-api-access-dshm4\") pod \"authorino-7c9d797bcd-rrbvh\" (UID: \"7bff2a06-6ad4-4a2f-b29f-04161691ee44\") " pod="kuadrant-system/authorino-7c9d797bcd-rrbvh"
Jul 16 17:39:57.441380 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.441341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7bff2a06-6ad4-4a2f-b29f-04161691ee44-tls-cert\") pod \"authorino-7c9d797bcd-rrbvh\" (UID: \"7bff2a06-6ad4-4a2f-b29f-04161691ee44\") " pod="kuadrant-system/authorino-7c9d797bcd-rrbvh"
Jul 16 17:39:57.441569 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.441437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dshm4\" (UniqueName: \"kubernetes.io/projected/7bff2a06-6ad4-4a2f-b29f-04161691ee44-kube-api-access-dshm4\") pod \"authorino-7c9d797bcd-rrbvh\" (UID: \"7bff2a06-6ad4-4a2f-b29f-04161691ee44\") " pod="kuadrant-system/authorino-7c9d797bcd-rrbvh"
Jul 16 17:39:57.443825 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.443802    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7bff2a06-6ad4-4a2f-b29f-04161691ee44-tls-cert\") pod \"authorino-7c9d797bcd-rrbvh\" (UID: \"7bff2a06-6ad4-4a2f-b29f-04161691ee44\") " pod="kuadrant-system/authorino-7c9d797bcd-rrbvh"
Jul 16 17:39:57.450445 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.450423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dshm4\" (UniqueName: \"kubernetes.io/projected/7bff2a06-6ad4-4a2f-b29f-04161691ee44-kube-api-access-dshm4\") pod \"authorino-7c9d797bcd-rrbvh\" (UID: \"7bff2a06-6ad4-4a2f-b29f-04161691ee44\") " pod="kuadrant-system/authorino-7c9d797bcd-rrbvh"
Jul 16 17:39:57.546291 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.546187    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c9d797bcd-rrbvh"
Jul 16 17:39:57.687420 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:57.687390    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c9d797bcd-rrbvh"]
Jul 16 17:39:57.689220 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:39:57.689195    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7bff2a06_6ad4_4a2f_b29f_04161691ee44.slice/crio-bf4bad323440ae310948218bd0a64e55a5b8c04152c38ca9b6beb6d1fa0189df WatchSource:0}: Error finding container bf4bad323440ae310948218bd0a64e55a5b8c04152c38ca9b6beb6d1fa0189df: Status 404 returned error can't find the container with id bf4bad323440ae310948218bd0a64e55a5b8c04152c38ca9b6beb6d1fa0189df
Jul 16 17:39:58.144236 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:58.144193    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c9d797bcd-rrbvh" event={"ID":"7bff2a06-6ad4-4a2f-b29f-04161691ee44","Type":"ContainerStarted","Data":"bf4bad323440ae310948218bd0a64e55a5b8c04152c38ca9b6beb6d1fa0189df"}
Jul 16 17:39:58.145872 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:58.145844    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptdps" event={"ID":"c3d925fe-2aae-4b2f-a77f-5302f06144be","Type":"ContainerStarted","Data":"b46f032f466f28a078f18f3d58d7f11dc5e8235af0605a40aa28f1b0f931ea59"}
Jul 16 17:39:58.146047 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:58.145872    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778649574-jw99j"
Jul 16 17:39:58.146047 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:58.145895    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-ptdps" podUID="c3d925fe-2aae-4b2f-a77f-5302f06144be" containerName="authorino" containerID="cri-o://b46f032f466f28a078f18f3d58d7f11dc5e8235af0605a40aa28f1b0f931ea59" gracePeriod=30
Jul 16 17:39:58.154198 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:58.154162    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778649574-jw99j"
Jul 16 17:39:58.165943 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:58.165883    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-ptdps" podStartSLOduration=1.6986430270000001 podStartE2EDuration="2.165863391s" totalImagesPullingTime="467.220364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:39:58.162766829 +0000 UTC m=+636.717824289" watchObservedRunningTime="2026-07-16 17:39:58.165863391 +0000 UTC m=+636.720920830"
Jul 16 17:39:58.248391 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:58.248343    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh6ng\" (UniqueName: \"kubernetes.io/projected/e2fe0af4-e8b0-4400-9893-72e6676e62d0-kube-api-access-qh6ng\") pod \"e2fe0af4-e8b0-4400-9893-72e6676e62d0\" (UID: \"e2fe0af4-e8b0-4400-9893-72e6676e62d0\") "
Jul 16 17:39:58.250952 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:58.250912    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2fe0af4-e8b0-4400-9893-72e6676e62d0-kube-api-access-qh6ng" (OuterVolumeSpecName: "kube-api-access-qh6ng") pod "e2fe0af4-e8b0-4400-9893-72e6676e62d0" (UID: "e2fe0af4-e8b0-4400-9893-72e6676e62d0"). InnerVolumeSpecName "kube-api-access-qh6ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:39:58.349680 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:58.349479    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh6ng\" (UniqueName: \"kubernetes.io/projected/e2fe0af4-e8b0-4400-9893-72e6676e62d0-kube-api-access-qh6ng\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:39:58.397458 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:58.397383    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptdps"
Jul 16 17:39:58.550486 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:58.550449    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cjxs\" (UniqueName: \"kubernetes.io/projected/c3d925fe-2aae-4b2f-a77f-5302f06144be-kube-api-access-4cjxs\") pod \"c3d925fe-2aae-4b2f-a77f-5302f06144be\" (UID: \"c3d925fe-2aae-4b2f-a77f-5302f06144be\") "
Jul 16 17:39:58.552521 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:58.552490    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d925fe-2aae-4b2f-a77f-5302f06144be-kube-api-access-4cjxs" (OuterVolumeSpecName: "kube-api-access-4cjxs") pod "c3d925fe-2aae-4b2f-a77f-5302f06144be" (UID: "c3d925fe-2aae-4b2f-a77f-5302f06144be"). InnerVolumeSpecName "kube-api-access-4cjxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:39:58.652239 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:58.652152    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cjxs\" (UniqueName: \"kubernetes.io/projected/c3d925fe-2aae-4b2f-a77f-5302f06144be-kube-api-access-4cjxs\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:39:59.153357 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.153320    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c9d797bcd-rrbvh" event={"ID":"7bff2a06-6ad4-4a2f-b29f-04161691ee44","Type":"ContainerStarted","Data":"13c60257193a3112ad811fbcb383ce7e6ffadc31aee52b0ccec204c3f438486c"}
Jul 16 17:39:59.154602 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.154579    2580 generic.go:356] "Generic (PLEG): container finished" podID="c3d925fe-2aae-4b2f-a77f-5302f06144be" containerID="b46f032f466f28a078f18f3d58d7f11dc5e8235af0605a40aa28f1b0f931ea59" exitCode=0
Jul 16 17:39:59.154660 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.154608    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptdps"
Jul 16 17:39:59.154660 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.154654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptdps" event={"ID":"c3d925fe-2aae-4b2f-a77f-5302f06144be","Type":"ContainerDied","Data":"b46f032f466f28a078f18f3d58d7f11dc5e8235af0605a40aa28f1b0f931ea59"}
Jul 16 17:39:59.154733 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.154681    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptdps" event={"ID":"c3d925fe-2aae-4b2f-a77f-5302f06144be","Type":"ContainerDied","Data":"f9dca16a9011e021efe42247d85c17dcf1ff4eb04b43277f60d69fc75aa50e67"}
Jul 16 17:39:59.154733 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.154696    2580 scope.go:117] "RemoveContainer" containerID="b46f032f466f28a078f18f3d58d7f11dc5e8235af0605a40aa28f1b0f931ea59"
Jul 16 17:39:59.154870 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.154857    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778649574-jw99j"
Jul 16 17:39:59.164180 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.164161    2580 scope.go:117] "RemoveContainer" containerID="b46f032f466f28a078f18f3d58d7f11dc5e8235af0605a40aa28f1b0f931ea59"
Jul 16 17:39:59.164481 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:39:59.164462    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b46f032f466f28a078f18f3d58d7f11dc5e8235af0605a40aa28f1b0f931ea59\": container with ID starting with b46f032f466f28a078f18f3d58d7f11dc5e8235af0605a40aa28f1b0f931ea59 not found: ID does not exist" containerID="b46f032f466f28a078f18f3d58d7f11dc5e8235af0605a40aa28f1b0f931ea59"
Jul 16 17:39:59.164531 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.164490    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b46f032f466f28a078f18f3d58d7f11dc5e8235af0605a40aa28f1b0f931ea59"} err="failed to get container status \"b46f032f466f28a078f18f3d58d7f11dc5e8235af0605a40aa28f1b0f931ea59\": rpc error: code = NotFound desc = could not find container \"b46f032f466f28a078f18f3d58d7f11dc5e8235af0605a40aa28f1b0f931ea59\": container with ID starting with b46f032f466f28a078f18f3d58d7f11dc5e8235af0605a40aa28f1b0f931ea59 not found: ID does not exist"
Jul 16 17:39:59.174708 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.174661    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c9d797bcd-rrbvh" podStartSLOduration=1.6277455440000002 podStartE2EDuration="2.174646513s" totalImagesPullingTime="546.900969ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:39:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:39:59.173909368 +0000 UTC m=+637.728966824" watchObservedRunningTime="2026-07-16 17:39:59.174646513 +0000 UTC m=+637.729703952"
Jul 16 17:39:59.190202 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.190163    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptdps"]
Jul 16 17:39:59.196363 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.196338    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptdps"]
Jul 16 17:39:59.204471 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.204446    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qbv78"]
Jul 16 17:39:59.204635 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.204615    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-qbv78" podUID="899bd437-8bd8-4234-ab33-7a46ac0083ad" containerName="authorino" containerID="cri-o://264af0fcaa241f1c5d62e938b0a3c90a6a4f9a5124d9bc147381a6f8e9874c6b" gracePeriod=30
Jul 16 17:39:59.230455 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.230422    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-778649574-jw99j"]
Jul 16 17:39:59.235813 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.235784    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-778649574-jw99j"]
Jul 16 17:39:59.504172 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.504143    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qbv78"
Jul 16 17:39:59.661286 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.661250    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvhds\" (UniqueName: \"kubernetes.io/projected/899bd437-8bd8-4234-ab33-7a46ac0083ad-kube-api-access-jvhds\") pod \"899bd437-8bd8-4234-ab33-7a46ac0083ad\" (UID: \"899bd437-8bd8-4234-ab33-7a46ac0083ad\") "
Jul 16 17:39:59.663347 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.663322    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/899bd437-8bd8-4234-ab33-7a46ac0083ad-kube-api-access-jvhds" (OuterVolumeSpecName: "kube-api-access-jvhds") pod "899bd437-8bd8-4234-ab33-7a46ac0083ad" (UID: "899bd437-8bd8-4234-ab33-7a46ac0083ad"). InnerVolumeSpecName "kube-api-access-jvhds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:39:59.763097 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.762981    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvhds\" (UniqueName: \"kubernetes.io/projected/899bd437-8bd8-4234-ab33-7a46ac0083ad-kube-api-access-jvhds\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:39:59.965987 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.965944    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3d925fe-2aae-4b2f-a77f-5302f06144be" path="/var/lib/kubelet/pods/c3d925fe-2aae-4b2f-a77f-5302f06144be/volumes"
Jul 16 17:39:59.966410 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:39:59.966392    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2fe0af4-e8b0-4400-9893-72e6676e62d0" path="/var/lib/kubelet/pods/e2fe0af4-e8b0-4400-9893-72e6676e62d0/volumes"
Jul 16 17:40:00.161702 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:00.161623    2580 generic.go:356] "Generic (PLEG): container finished" podID="899bd437-8bd8-4234-ab33-7a46ac0083ad" containerID="264af0fcaa241f1c5d62e938b0a3c90a6a4f9a5124d9bc147381a6f8e9874c6b" exitCode=0
Jul 16 17:40:00.161702 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:00.161662    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qbv78" event={"ID":"899bd437-8bd8-4234-ab33-7a46ac0083ad","Type":"ContainerDied","Data":"264af0fcaa241f1c5d62e938b0a3c90a6a4f9a5124d9bc147381a6f8e9874c6b"}
Jul 16 17:40:00.161702 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:00.161704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qbv78" event={"ID":"899bd437-8bd8-4234-ab33-7a46ac0083ad","Type":"ContainerDied","Data":"23568d379b93e40c29e1a9776931335cbb9abdb11e84b15888bf8e84b6c4f374"}
Jul 16 17:40:00.162214 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:00.161723    2580 scope.go:117] "RemoveContainer" containerID="264af0fcaa241f1c5d62e938b0a3c90a6a4f9a5124d9bc147381a6f8e9874c6b"
Jul 16 17:40:00.162214 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:00.161670    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qbv78"
Jul 16 17:40:00.170444 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:00.170426    2580 scope.go:117] "RemoveContainer" containerID="264af0fcaa241f1c5d62e938b0a3c90a6a4f9a5124d9bc147381a6f8e9874c6b"
Jul 16 17:40:00.170737 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:40:00.170699    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"264af0fcaa241f1c5d62e938b0a3c90a6a4f9a5124d9bc147381a6f8e9874c6b\": container with ID starting with 264af0fcaa241f1c5d62e938b0a3c90a6a4f9a5124d9bc147381a6f8e9874c6b not found: ID does not exist" containerID="264af0fcaa241f1c5d62e938b0a3c90a6a4f9a5124d9bc147381a6f8e9874c6b"
Jul 16 17:40:00.170737 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:00.170728    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"264af0fcaa241f1c5d62e938b0a3c90a6a4f9a5124d9bc147381a6f8e9874c6b"} err="failed to get container status \"264af0fcaa241f1c5d62e938b0a3c90a6a4f9a5124d9bc147381a6f8e9874c6b\": rpc error: code = NotFound desc = could not find container \"264af0fcaa241f1c5d62e938b0a3c90a6a4f9a5124d9bc147381a6f8e9874c6b\": container with ID starting with 264af0fcaa241f1c5d62e938b0a3c90a6a4f9a5124d9bc147381a6f8e9874c6b not found: ID does not exist"
Jul 16 17:40:00.185254 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:00.185218    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qbv78"]
Jul 16 17:40:00.191302 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:00.191272    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qbv78"]
Jul 16 17:40:01.966582 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:01.966550    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="899bd437-8bd8-4234-ab33-7a46ac0083ad" path="/var/lib/kubelet/pods/899bd437-8bd8-4234-ab33-7a46ac0083ad/volumes"
Jul 16 17:40:04.188026 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.187988    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:04.289702 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.289662    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:04.379584 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.379524    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:04.383561 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.383529    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-fmm4f"]
Jul 16 17:40:04.383922 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.383909    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899bd437-8bd8-4234-ab33-7a46ac0083ad" containerName="authorino"
Jul 16 17:40:04.383978 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.383924    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="899bd437-8bd8-4234-ab33-7a46ac0083ad" containerName="authorino"
Jul 16 17:40:04.383978 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.383946    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d925fe-2aae-4b2f-a77f-5302f06144be" containerName="authorino"
Jul 16 17:40:04.383978 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.383952    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d925fe-2aae-4b2f-a77f-5302f06144be" containerName="authorino"
Jul 16 17:40:04.384111 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.384012    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d925fe-2aae-4b2f-a77f-5302f06144be" containerName="authorino"
Jul 16 17:40:04.384111 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.384023    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="899bd437-8bd8-4234-ab33-7a46ac0083ad" containerName="authorino"
Jul 16 17:40:04.408967 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.408922    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-fmm4f"]
Jul 16 17:40:04.409157 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.409026    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f"
Jul 16 17:40:04.413527 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.413497    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 17:40:04.413705 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.413497    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 17:40:04.413705 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.413566    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9vnw5\""
Jul 16 17:40:04.606811 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.606771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtjrs\" (UniqueName: \"kubernetes.io/projected/9509e1bc-b090-4d1b-95d0-3624d0605c63-kube-api-access-gtjrs\") pod \"maas-controller-6b9cdc9cfb-fmm4f\" (UID: \"9509e1bc-b090-4d1b-95d0-3624d0605c63\") " pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f"
Jul 16 17:40:04.607008 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.606833    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9509e1bc-b090-4d1b-95d0-3624d0605c63-webhook-cert\") pod \"maas-controller-6b9cdc9cfb-fmm4f\" (UID: \"9509e1bc-b090-4d1b-95d0-3624d0605c63\") " pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f"
Jul 16 17:40:04.708371 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.708331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtjrs\" (UniqueName: \"kubernetes.io/projected/9509e1bc-b090-4d1b-95d0-3624d0605c63-kube-api-access-gtjrs\") pod \"maas-controller-6b9cdc9cfb-fmm4f\" (UID: \"9509e1bc-b090-4d1b-95d0-3624d0605c63\") " pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f"
Jul 16 17:40:04.708555 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.708389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9509e1bc-b090-4d1b-95d0-3624d0605c63-webhook-cert\") pod \"maas-controller-6b9cdc9cfb-fmm4f\" (UID: \"9509e1bc-b090-4d1b-95d0-3624d0605c63\") " pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f"
Jul 16 17:40:04.710977 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.710940    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9509e1bc-b090-4d1b-95d0-3624d0605c63-webhook-cert\") pod \"maas-controller-6b9cdc9cfb-fmm4f\" (UID: \"9509e1bc-b090-4d1b-95d0-3624d0605c63\") " pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f"
Jul 16 17:40:04.719289 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.719254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtjrs\" (UniqueName: \"kubernetes.io/projected/9509e1bc-b090-4d1b-95d0-3624d0605c63-kube-api-access-gtjrs\") pod \"maas-controller-6b9cdc9cfb-fmm4f\" (UID: \"9509e1bc-b090-4d1b-95d0-3624d0605c63\") " pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f"
Jul 16 17:40:04.719463 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.719438    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f"
Jul 16 17:40:04.864439 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:04.864412    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-fmm4f"]
Jul 16 17:40:04.866354 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:40:04.866322    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9509e1bc_b090_4d1b_95d0_3624d0605c63.slice/crio-b63f95ab3880a370739f48de7fcf1fd28414b0dd9e65ced1d8a5ce76233394b0 WatchSource:0}: Error finding container b63f95ab3880a370739f48de7fcf1fd28414b0dd9e65ced1d8a5ce76233394b0: Status 404 returned error can't find the container with id b63f95ab3880a370739f48de7fcf1fd28414b0dd9e65ced1d8a5ce76233394b0
Jul 16 17:40:05.190251 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:05.190156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f" event={"ID":"9509e1bc-b090-4d1b-95d0-3624d0605c63","Type":"ContainerStarted","Data":"b63f95ab3880a370739f48de7fcf1fd28414b0dd9e65ced1d8a5ce76233394b0"}
Jul 16 17:40:07.561747 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:07.561702    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:07.654249 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:07.654150    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:08.215160 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:08.215125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f" event={"ID":"9509e1bc-b090-4d1b-95d0-3624d0605c63","Type":"ContainerStarted","Data":"50544124ff999a09e211a33c10449f74d7f50768271ef19d364f679dab187e4b"}
Jul 16 17:40:08.215303 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:08.215226    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f"
Jul 16 17:40:08.257751 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:08.257696    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f" podStartSLOduration=1.755741475 podStartE2EDuration="4.257678119s" totalImagesPullingTime="2.501936644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:40:08.255057567 +0000 UTC m=+646.810114998" watchObservedRunningTime="2026-07-16 17:40:08.257678119 +0000 UTC m=+646.812735587"
Jul 16 17:40:19.223306 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:19.223269    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f"
Jul 16 17:40:38.341005 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:38.340970    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:38.426947 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:38.426899    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:38.892589 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:38.892555    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:39.347824 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.347769    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:39.539071 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.539019    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:39.647636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.647534    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:39.669799 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.669765    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fk4hx"]
Jul 16 17:40:39.673392 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.673368    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk4hx"
Jul 16 17:40:39.677363 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.677343    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-srwcz\""
Jul 16 17:40:39.677842 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.677824    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 16 17:40:39.694552 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.694518    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fk4hx"]
Jul 16 17:40:39.832545 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.832506    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npn5p\" (UniqueName: \"kubernetes.io/projected/7a8d5018-7fb2-46ba-8638-e0a330471f06-kube-api-access-npn5p\") pod \"payload-pre-processing-7677b774bb-fk4hx\" (UID: \"7a8d5018-7fb2-46ba-8638-e0a330471f06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fk4hx"
Jul 16 17:40:39.832720 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.832655    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a8d5018-7fb2-46ba-8638-e0a330471f06-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fk4hx\" (UID: \"7a8d5018-7fb2-46ba-8638-e0a330471f06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fk4hx"
Jul 16 17:40:39.933805 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.933710    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a8d5018-7fb2-46ba-8638-e0a330471f06-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fk4hx\" (UID: \"7a8d5018-7fb2-46ba-8638-e0a330471f06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fk4hx"
Jul 16 17:40:39.933805 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.933773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npn5p\" (UniqueName: \"kubernetes.io/projected/7a8d5018-7fb2-46ba-8638-e0a330471f06-kube-api-access-npn5p\") pod \"payload-pre-processing-7677b774bb-fk4hx\" (UID: \"7a8d5018-7fb2-46ba-8638-e0a330471f06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fk4hx"
Jul 16 17:40:39.934583 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.934558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a8d5018-7fb2-46ba-8638-e0a330471f06-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fk4hx\" (UID: \"7a8d5018-7fb2-46ba-8638-e0a330471f06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fk4hx"
Jul 16 17:40:39.944647 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.944616    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npn5p\" (UniqueName: \"kubernetes.io/projected/7a8d5018-7fb2-46ba-8638-e0a330471f06-kube-api-access-npn5p\") pod \"payload-pre-processing-7677b774bb-fk4hx\" (UID: \"7a8d5018-7fb2-46ba-8638-e0a330471f06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fk4hx"
Jul 16 17:40:39.983779 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:39.983736    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk4hx"
Jul 16 17:40:40.133727 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:40.133688    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fk4hx"]
Jul 16 17:40:40.135776 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:40:40.135742    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8d5018_7fb2_46ba_8638_e0a330471f06.slice/crio-5229fc1718f058bb31d20c90136cb07a58663ecb9dc6bfcd3be9059ea1f26990 WatchSource:0}: Error finding container 5229fc1718f058bb31d20c90136cb07a58663ecb9dc6bfcd3be9059ea1f26990: Status 404 returned error can't find the container with id 5229fc1718f058bb31d20c90136cb07a58663ecb9dc6bfcd3be9059ea1f26990
Jul 16 17:40:40.137864 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:40.137842    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:40:40.371703 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:40.371668    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk4hx" event={"ID":"7a8d5018-7fb2-46ba-8638-e0a330471f06","Type":"ContainerStarted","Data":"5229fc1718f058bb31d20c90136cb07a58663ecb9dc6bfcd3be9059ea1f26990"}
Jul 16 17:40:42.391820 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:42.391776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk4hx" event={"ID":"7a8d5018-7fb2-46ba-8638-e0a330471f06","Type":"ContainerStarted","Data":"e06b1e92bc7404385c5ef2b799b4819cb1494a377f02e09d434cd0422f84bb54"}
Jul 16 17:40:42.392413 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:42.391868    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk4hx"
Jul 16 17:40:42.412483 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:42.412430    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk4hx" podStartSLOduration=1.727743799 podStartE2EDuration="3.412410169s" totalImagesPullingTime="1.68466637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:40:42.411332616 +0000 UTC m=+680.966390076" watchObservedRunningTime="2026-07-16 17:40:42.412410169 +0000 UTC m=+680.967467607"
Jul 16 17:40:49.948946 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:49.948914    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:50.660446 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:50.660419    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:53.399088 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:40:53.399024    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fk4hx"
Jul 16 17:41:06.759089 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.759057    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"]
Jul 16 17:41:06.762849 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.762832    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.766179 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.766156    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jzc82\""
Jul 16 17:41:06.766408 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.766394    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 16 17:41:06.766732 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.766719    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 17:41:06.767339 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.767322    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 17:41:06.774590 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.774565    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"]
Jul 16 17:41:06.894259 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.894216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08459113-f863-433a-a89e-2df36bcc31d9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.894500 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.894278    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcjc6\" (UniqueName: \"kubernetes.io/projected/08459113-f863-433a-a89e-2df36bcc31d9-kube-api-access-mcjc6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.894500 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.894298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08459113-f863-433a-a89e-2df36bcc31d9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.894500 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.894381    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08459113-f863-433a-a89e-2df36bcc31d9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.894500 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.894407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08459113-f863-433a-a89e-2df36bcc31d9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.894500 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.894423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08459113-f863-433a-a89e-2df36bcc31d9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.995859 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.995819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08459113-f863-433a-a89e-2df36bcc31d9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.996072 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.995878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcjc6\" (UniqueName: \"kubernetes.io/projected/08459113-f863-433a-a89e-2df36bcc31d9-kube-api-access-mcjc6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.996072 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.995906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08459113-f863-433a-a89e-2df36bcc31d9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.996072 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.995976    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08459113-f863-433a-a89e-2df36bcc31d9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.996072 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.996006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08459113-f863-433a-a89e-2df36bcc31d9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.996072 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.996028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08459113-f863-433a-a89e-2df36bcc31d9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.996318 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.996280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08459113-f863-433a-a89e-2df36bcc31d9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.996404 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.996383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08459113-f863-433a-a89e-2df36bcc31d9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.996487 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.996465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08459113-f863-433a-a89e-2df36bcc31d9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.998184 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.998163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08459113-f863-433a-a89e-2df36bcc31d9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:06.998349 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:06.998331    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08459113-f863-433a-a89e-2df36bcc31d9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:07.006472 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:07.006450    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcjc6\" (UniqueName: \"kubernetes.io/projected/08459113-f863-433a-a89e-2df36bcc31d9-kube-api-access-mcjc6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6\" (UID: \"08459113-f863-433a-a89e-2df36bcc31d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:07.074682 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:07.074594    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:07.215020 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:07.214988    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"]
Jul 16 17:41:07.216837 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:41:07.216809    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08459113_f863_433a_a89e_2df36bcc31d9.slice/crio-98e2e3467ee5e0251165c279d2471f9b3b1e3ae65d7b2906c1dc474c44e122ca WatchSource:0}: Error finding container 98e2e3467ee5e0251165c279d2471f9b3b1e3ae65d7b2906c1dc474c44e122ca: Status 404 returned error can't find the container with id 98e2e3467ee5e0251165c279d2471f9b3b1e3ae65d7b2906c1dc474c44e122ca
Jul 16 17:41:07.240151 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:07.240113    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:07.522002 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:07.521924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6" event={"ID":"08459113-f863-433a-a89e-2df36bcc31d9","Type":"ContainerStarted","Data":"98e2e3467ee5e0251165c279d2471f9b3b1e3ae65d7b2906c1dc474c44e122ca"}
Jul 16 17:41:09.533681 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:09.533643    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6" event={"ID":"08459113-f863-433a-a89e-2df36bcc31d9","Type":"ContainerStarted","Data":"0a03987e7d2918d20fd29b49b1985e2dd07047722f5f53b23e4868ef4f5e118e"}
Jul 16 17:41:09.569511 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:09.569450    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6" podStartSLOduration=1.816595391 podStartE2EDuration="3.569432294s" totalImagesPullingTime="1.752836903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:09.567250345 +0000 UTC m=+708.122307784" watchObservedRunningTime="2026-07-16 17:41:09.569432294 +0000 UTC m=+708.124489731"
Jul 16 17:41:17.075712 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:17.075613    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:17.075712 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:17.075700    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:17.090977 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:17.090937    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:17.583709 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:17.583669    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6"
Jul 16 17:41:17.704052 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:17.704005    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:20.911788 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:20.911737    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:28.453636 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.453602    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"]
Jul 16 17:41:28.456431 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.456407    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.459576 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.459549    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 16 17:41:28.479670 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.479629    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"]
Jul 16 17:41:28.509466 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.509432    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a79eda6a-902d-4034-8ad1-3160a9af15e2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.509648 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.509486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a79eda6a-902d-4034-8ad1-3160a9af15e2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.509648 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.509530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnjrb\" (UniqueName: \"kubernetes.io/projected/a79eda6a-902d-4034-8ad1-3160a9af15e2-kube-api-access-xnjrb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.509648 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.509549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a79eda6a-902d-4034-8ad1-3160a9af15e2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.509648 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.509580    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a79eda6a-902d-4034-8ad1-3160a9af15e2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.509648 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.509604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a79eda6a-902d-4034-8ad1-3160a9af15e2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.540433 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.540403    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:28.610859 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.610820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnjrb\" (UniqueName: \"kubernetes.io/projected/a79eda6a-902d-4034-8ad1-3160a9af15e2-kube-api-access-xnjrb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.610859 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.610861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a79eda6a-902d-4034-8ad1-3160a9af15e2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.611153 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.610926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a79eda6a-902d-4034-8ad1-3160a9af15e2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.611153 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.610980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a79eda6a-902d-4034-8ad1-3160a9af15e2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.611153 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.611099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a79eda6a-902d-4034-8ad1-3160a9af15e2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.611318 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.611164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a79eda6a-902d-4034-8ad1-3160a9af15e2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.611374 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.611346    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a79eda6a-902d-4034-8ad1-3160a9af15e2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.611432 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.611410    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a79eda6a-902d-4034-8ad1-3160a9af15e2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.611534 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.611515    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a79eda6a-902d-4034-8ad1-3160a9af15e2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.613215 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.613195    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a79eda6a-902d-4034-8ad1-3160a9af15e2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.613520 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.613503    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a79eda6a-902d-4034-8ad1-3160a9af15e2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.634796 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.634763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnjrb\" (UniqueName: \"kubernetes.io/projected/a79eda6a-902d-4034-8ad1-3160a9af15e2-kube-api-access-xnjrb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vxgl\" (UID: \"a79eda6a-902d-4034-8ad1-3160a9af15e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.768367 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.768328    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:28.922135 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:28.922110    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"]
Jul 16 17:41:28.924203 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:41:28.924168    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79eda6a_902d_4034_8ad1_3160a9af15e2.slice/crio-6df4d834cd6b490a00ae026b9e69dcb42d5ebec5d14975c6dad464ab0a439393 WatchSource:0}: Error finding container 6df4d834cd6b490a00ae026b9e69dcb42d5ebec5d14975c6dad464ab0a439393: Status 404 returned error can't find the container with id 6df4d834cd6b490a00ae026b9e69dcb42d5ebec5d14975c6dad464ab0a439393
Jul 16 17:41:29.630886 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:29.630850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl" event={"ID":"a79eda6a-902d-4034-8ad1-3160a9af15e2","Type":"ContainerStarted","Data":"667d4ddd12bdfc144a01f7067c617a3c28dc5ead8e3a8ff908cdaa0817776a75"}
Jul 16 17:41:29.631294 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:29.630901    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl" event={"ID":"a79eda6a-902d-4034-8ad1-3160a9af15e2","Type":"ContainerStarted","Data":"6df4d834cd6b490a00ae026b9e69dcb42d5ebec5d14975c6dad464ab0a439393"}
Jul 16 17:41:29.662335 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:29.662279    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl" podStartSLOduration=1.414284606 podStartE2EDuration="1.662262183s" totalImagesPullingTime="247.977577ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:29.660474209 +0000 UTC m=+728.215531661" watchObservedRunningTime="2026-07-16 17:41:29.662262183 +0000 UTC m=+728.217319611"
Jul 16 17:41:30.581656 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:30.581610    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:33.261460 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:33.261425    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:38.768986 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:38.768947    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:38.769487 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:38.769009    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:38.781374 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:38.781341    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:39.692356 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:39.692325    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vxgl"
Jul 16 17:41:41.668837 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:41.668796    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:52.037051 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:52.036989    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:52.103290 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:41:52.103259    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:04.757568 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.757534    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"]
Jul 16 17:42:04.760156 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.760136    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.763245 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.763217    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 16 17:42:04.773965 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.773927    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"]
Jul 16 17:42:04.810390 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.810354    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:04.866439 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.866390    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.866642 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.866487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfhsj\" (UniqueName: \"kubernetes.io/projected/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-kube-api-access-vfhsj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.866642 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.866529    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.866642 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.866574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.866642 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.866588    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.866642 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.866619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.967487 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.967441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.967683 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.967507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfhsj\" (UniqueName: \"kubernetes.io/projected/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-kube-api-access-vfhsj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.967683 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.967547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.967683 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.967600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.967683 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.967621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.967683 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.967647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.967941 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.967888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.968118 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.968085    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.968118 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.968102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.969885 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.969859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.970168 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.970149    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:04.984113 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:04.984079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfhsj\" (UniqueName: \"kubernetes.io/projected/dd4060ca-643e-4c2c-a1d5-b31aa0c705b7-kube-api-access-vfhsj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pt7gd\" (UID: \"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:05.072150 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:05.072068    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:05.217308 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:05.217280    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"]
Jul 16 17:42:05.219468 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:42:05.219437    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd4060ca_643e_4c2c_a1d5_b31aa0c705b7.slice/crio-2e7a7745f19101ced844694a00b574d3b48a77d2398b7049e59af88da074e66c WatchSource:0}: Error finding container 2e7a7745f19101ced844694a00b574d3b48a77d2398b7049e59af88da074e66c: Status 404 returned error can't find the container with id 2e7a7745f19101ced844694a00b574d3b48a77d2398b7049e59af88da074e66c
Jul 16 17:42:05.824789 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:05.824752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd" event={"ID":"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7","Type":"ContainerStarted","Data":"bf251a2e5152b4e7c314609f4c34a40a3380490e65ebe6498535e6013bd5e5e5"}
Jul 16 17:42:05.825319 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:05.824815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd" event={"ID":"dd4060ca-643e-4c2c-a1d5-b31aa0c705b7","Type":"ContainerStarted","Data":"2e7a7745f19101ced844694a00b574d3b48a77d2398b7049e59af88da074e66c"}
Jul 16 17:42:05.852632 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:05.852577    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd" podStartSLOduration=1.62813783 podStartE2EDuration="1.852556528s" totalImagesPullingTime="224.418698ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:42:05.849148712 +0000 UTC m=+764.404206148" watchObservedRunningTime="2026-07-16 17:42:05.852556528 +0000 UTC m=+764.407613965"
Jul 16 17:42:08.101695 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:08.101654    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:15.072768 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:15.072724    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:15.073207 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:15.072801    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:15.085328 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:15.085298    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:15.898972 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:15.898934    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pt7gd"
Jul 16 17:42:52.204424 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:52.204338    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:52.279097 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:42:52.279061    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:17.418237 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:17.418196    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:17.533649 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:17.533593    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:18.672632 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:18.672593    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:18.781395 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:18.781348    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c9d797bcd-rrbvh"]
Jul 16 17:43:18.781670 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:18.781640    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7c9d797bcd-rrbvh" podUID="7bff2a06-6ad4-4a2f-b29f-04161691ee44" containerName="authorino" containerID="cri-o://13c60257193a3112ad811fbcb383ce7e6ffadc31aee52b0ccec204c3f438486c" gracePeriod=30
Jul 16 17:43:18.804325 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:18.804286    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:19.033493 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.033463    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c9d797bcd-rrbvh"
Jul 16 17:43:19.107258 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.107220    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7bff2a06-6ad4-4a2f-b29f-04161691ee44-tls-cert\") pod \"7bff2a06-6ad4-4a2f-b29f-04161691ee44\" (UID: \"7bff2a06-6ad4-4a2f-b29f-04161691ee44\") "
Jul 16 17:43:19.107432 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.107346    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dshm4\" (UniqueName: \"kubernetes.io/projected/7bff2a06-6ad4-4a2f-b29f-04161691ee44-kube-api-access-dshm4\") pod \"7bff2a06-6ad4-4a2f-b29f-04161691ee44\" (UID: \"7bff2a06-6ad4-4a2f-b29f-04161691ee44\") "
Jul 16 17:43:19.109378 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.109343    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bff2a06-6ad4-4a2f-b29f-04161691ee44-kube-api-access-dshm4" (OuterVolumeSpecName: "kube-api-access-dshm4") pod "7bff2a06-6ad4-4a2f-b29f-04161691ee44" (UID: "7bff2a06-6ad4-4a2f-b29f-04161691ee44"). InnerVolumeSpecName "kube-api-access-dshm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:43:19.118195 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.118166    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bff2a06-6ad4-4a2f-b29f-04161691ee44-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7bff2a06-6ad4-4a2f-b29f-04161691ee44" (UID: "7bff2a06-6ad4-4a2f-b29f-04161691ee44"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:43:19.207533 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.207499    2580 generic.go:356] "Generic (PLEG): container finished" podID="7bff2a06-6ad4-4a2f-b29f-04161691ee44" containerID="13c60257193a3112ad811fbcb383ce7e6ffadc31aee52b0ccec204c3f438486c" exitCode=0
Jul 16 17:43:19.207715 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.207543    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c9d797bcd-rrbvh"
Jul 16 17:43:19.207715 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.207577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c9d797bcd-rrbvh" event={"ID":"7bff2a06-6ad4-4a2f-b29f-04161691ee44","Type":"ContainerDied","Data":"13c60257193a3112ad811fbcb383ce7e6ffadc31aee52b0ccec204c3f438486c"}
Jul 16 17:43:19.207715 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.207618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c9d797bcd-rrbvh" event={"ID":"7bff2a06-6ad4-4a2f-b29f-04161691ee44","Type":"ContainerDied","Data":"bf4bad323440ae310948218bd0a64e55a5b8c04152c38ca9b6beb6d1fa0189df"}
Jul 16 17:43:19.207715 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.207636    2580 scope.go:117] "RemoveContainer" containerID="13c60257193a3112ad811fbcb383ce7e6ffadc31aee52b0ccec204c3f438486c"
Jul 16 17:43:19.208265 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.208241    2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7bff2a06-6ad4-4a2f-b29f-04161691ee44-tls-cert\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:43:19.208378 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.208267    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dshm4\" (UniqueName: \"kubernetes.io/projected/7bff2a06-6ad4-4a2f-b29f-04161691ee44-kube-api-access-dshm4\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:43:19.217384 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.217368    2580 scope.go:117] "RemoveContainer" containerID="13c60257193a3112ad811fbcb383ce7e6ffadc31aee52b0ccec204c3f438486c"
Jul 16 17:43:19.217629 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:43:19.217611    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13c60257193a3112ad811fbcb383ce7e6ffadc31aee52b0ccec204c3f438486c\": container with ID starting with 13c60257193a3112ad811fbcb383ce7e6ffadc31aee52b0ccec204c3f438486c not found: ID does not exist" containerID="13c60257193a3112ad811fbcb383ce7e6ffadc31aee52b0ccec204c3f438486c"
Jul 16 17:43:19.217668 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.217637    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13c60257193a3112ad811fbcb383ce7e6ffadc31aee52b0ccec204c3f438486c"} err="failed to get container status \"13c60257193a3112ad811fbcb383ce7e6ffadc31aee52b0ccec204c3f438486c\": rpc error: code = NotFound desc = could not find container \"13c60257193a3112ad811fbcb383ce7e6ffadc31aee52b0ccec204c3f438486c\": container with ID starting with 13c60257193a3112ad811fbcb383ce7e6ffadc31aee52b0ccec204c3f438486c not found: ID does not exist"
Jul 16 17:43:19.245276 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.245243    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c9d797bcd-rrbvh"]
Jul 16 17:43:19.252621 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.252594    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c9d797bcd-rrbvh"]
Jul 16 17:43:19.967565 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:19.967523    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bff2a06-6ad4-4a2f-b29f-04161691ee44" path="/var/lib/kubelet/pods/7bff2a06-6ad4-4a2f-b29f-04161691ee44/volumes"
Jul 16 17:43:56.348683 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:56.348642    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:56.450182 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:43:56.450140    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:44:06.800122 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:06.800083    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-fmm4f"]
Jul 16 17:44:06.800686 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:06.800354    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f" podUID="9509e1bc-b090-4d1b-95d0-3624d0605c63" containerName="manager" containerID="cri-o://50544124ff999a09e211a33c10449f74d7f50768271ef19d364f679dab187e4b" gracePeriod=30
Jul 16 17:44:07.058770 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.058709    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f"
Jul 16 17:44:07.188256 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.188221    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtjrs\" (UniqueName: \"kubernetes.io/projected/9509e1bc-b090-4d1b-95d0-3624d0605c63-kube-api-access-gtjrs\") pod \"9509e1bc-b090-4d1b-95d0-3624d0605c63\" (UID: \"9509e1bc-b090-4d1b-95d0-3624d0605c63\") "
Jul 16 17:44:07.188446 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.188280    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9509e1bc-b090-4d1b-95d0-3624d0605c63-webhook-cert\") pod \"9509e1bc-b090-4d1b-95d0-3624d0605c63\" (UID: \"9509e1bc-b090-4d1b-95d0-3624d0605c63\") "
Jul 16 17:44:07.190480 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.190448    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9509e1bc-b090-4d1b-95d0-3624d0605c63-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9509e1bc-b090-4d1b-95d0-3624d0605c63" (UID: "9509e1bc-b090-4d1b-95d0-3624d0605c63"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:44:07.190590 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.190461    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9509e1bc-b090-4d1b-95d0-3624d0605c63-kube-api-access-gtjrs" (OuterVolumeSpecName: "kube-api-access-gtjrs") pod "9509e1bc-b090-4d1b-95d0-3624d0605c63" (UID: "9509e1bc-b090-4d1b-95d0-3624d0605c63"). InnerVolumeSpecName "kube-api-access-gtjrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:44:07.289051 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.288997    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9509e1bc-b090-4d1b-95d0-3624d0605c63-webhook-cert\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:44:07.289051 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.289028    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtjrs\" (UniqueName: \"kubernetes.io/projected/9509e1bc-b090-4d1b-95d0-3624d0605c63-kube-api-access-gtjrs\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:44:07.451072 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.450968    2580 generic.go:356] "Generic (PLEG): container finished" podID="9509e1bc-b090-4d1b-95d0-3624d0605c63" containerID="50544124ff999a09e211a33c10449f74d7f50768271ef19d364f679dab187e4b" exitCode=0
Jul 16 17:44:07.451072 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.451020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f" event={"ID":"9509e1bc-b090-4d1b-95d0-3624d0605c63","Type":"ContainerDied","Data":"50544124ff999a09e211a33c10449f74d7f50768271ef19d364f679dab187e4b"}
Jul 16 17:44:07.451072 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.451031    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f"
Jul 16 17:44:07.451345 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.451102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b9cdc9cfb-fmm4f" event={"ID":"9509e1bc-b090-4d1b-95d0-3624d0605c63","Type":"ContainerDied","Data":"b63f95ab3880a370739f48de7fcf1fd28414b0dd9e65ced1d8a5ce76233394b0"}
Jul 16 17:44:07.451345 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.451125    2580 scope.go:117] "RemoveContainer" containerID="50544124ff999a09e211a33c10449f74d7f50768271ef19d364f679dab187e4b"
Jul 16 17:44:07.460231 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.460212    2580 scope.go:117] "RemoveContainer" containerID="50544124ff999a09e211a33c10449f74d7f50768271ef19d364f679dab187e4b"
Jul 16 17:44:07.460464 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:44:07.460444    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50544124ff999a09e211a33c10449f74d7f50768271ef19d364f679dab187e4b\": container with ID starting with 50544124ff999a09e211a33c10449f74d7f50768271ef19d364f679dab187e4b not found: ID does not exist" containerID="50544124ff999a09e211a33c10449f74d7f50768271ef19d364f679dab187e4b"
Jul 16 17:44:07.460503 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.460473    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50544124ff999a09e211a33c10449f74d7f50768271ef19d364f679dab187e4b"} err="failed to get container status \"50544124ff999a09e211a33c10449f74d7f50768271ef19d364f679dab187e4b\": rpc error: code = NotFound desc = could not find container \"50544124ff999a09e211a33c10449f74d7f50768271ef19d364f679dab187e4b\": container with ID starting with 50544124ff999a09e211a33c10449f74d7f50768271ef19d364f679dab187e4b not found: ID does not exist"
Jul 16 17:44:07.479582 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.479552    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-fmm4f"]
Jul 16 17:44:07.482861 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.482838    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-fmm4f"]
Jul 16 17:44:07.966295 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:07.966257    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9509e1bc-b090-4d1b-95d0-3624d0605c63" path="/var/lib/kubelet/pods/9509e1bc-b090-4d1b-95d0-3624d0605c63/volumes"
Jul 16 17:44:21.867086 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:21.867053    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:44:21.869244 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:44:21.869224    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:45:00.163456 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:00.163420    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737065-l7wb8"]
Jul 16 17:45:00.165049 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:00.163863    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bff2a06-6ad4-4a2f-b29f-04161691ee44" containerName="authorino"
Jul 16 17:45:00.165049 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:00.163875    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bff2a06-6ad4-4a2f-b29f-04161691ee44" containerName="authorino"
Jul 16 17:45:00.165049 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:00.163904    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9509e1bc-b090-4d1b-95d0-3624d0605c63" containerName="manager"
Jul 16 17:45:00.165049 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:00.163910    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9509e1bc-b090-4d1b-95d0-3624d0605c63" containerName="manager"
Jul 16 17:45:00.165049 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:00.163970    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bff2a06-6ad4-4a2f-b29f-04161691ee44" containerName="authorino"
Jul 16 17:45:00.165049 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:00.163978    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9509e1bc-b090-4d1b-95d0-3624d0605c63" containerName="manager"
Jul 16 17:45:00.165855 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:00.165839    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737065-l7wb8"
Jul 16 17:45:00.168949 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:00.168927    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 17:45:00.175174 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:00.175148    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737065-l7wb8"]
Jul 16 17:45:00.176902 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:00.176880    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737065-l7wb8"
Jul 16 17:45:00.318731 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:00.318707    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737065-l7wb8"]
Jul 16 17:45:00.320301 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:45:00.320263    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6289e5ac_7aed_47aa_92c9_89660aed6e64.slice/crio-6a446c42098d334eedcc43c85bc89272be13a58af17604615fc79d5e9cfbcd0d WatchSource:0}: Error finding container 6a446c42098d334eedcc43c85bc89272be13a58af17604615fc79d5e9cfbcd0d: Status 404 returned error can't find the container with id 6a446c42098d334eedcc43c85bc89272be13a58af17604615fc79d5e9cfbcd0d
Jul 16 17:45:00.719553 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:00.719517    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737065-l7wb8" event={"ID":"6289e5ac-7aed-47aa-92c9-89660aed6e64","Type":"ContainerStarted","Data":"6a446c42098d334eedcc43c85bc89272be13a58af17604615fc79d5e9cfbcd0d"}
Jul 16 17:45:02.735596 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:02.735560    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737065-l7wb8" event={"ID":"6289e5ac-7aed-47aa-92c9-89660aed6e64","Type":"ContainerStarted","Data":"c4c14b3cc68404d9938f98aa65c248d3f2fa6a75c63c592c6688f555a1fae097"}
Jul 16 17:45:02.773622 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:02.773566    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737065-l7wb8" podStartSLOduration=0.984365112 podStartE2EDuration="2.773546274s" totalImagesPullingTime="1.789181162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:45:02.772203596 +0000 UTC m=+941.327261035" watchObservedRunningTime="2026-07-16 17:45:02.773546274 +0000 UTC m=+941.328603711"
Jul 16 17:45:03.742287 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:03.742241    2580 generic.go:356] "Generic (PLEG): container finished" podID="6289e5ac-7aed-47aa-92c9-89660aed6e64" containerID="c4c14b3cc68404d9938f98aa65c248d3f2fa6a75c63c592c6688f555a1fae097" exitCode=0
Jul 16 17:45:03.742664 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:03.742326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737065-l7wb8" event={"ID":"6289e5ac-7aed-47aa-92c9-89660aed6e64","Type":"ContainerDied","Data":"c4c14b3cc68404d9938f98aa65c248d3f2fa6a75c63c592c6688f555a1fae097"}
Jul 16 17:45:04.878106 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:04.878070    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737065-l7wb8"
Jul 16 17:45:05.754245 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:05.754213    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737065-l7wb8"
Jul 16 17:45:05.754245 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:05.754224    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737065-l7wb8" event={"ID":"6289e5ac-7aed-47aa-92c9-89660aed6e64","Type":"ContainerDied","Data":"6a446c42098d334eedcc43c85bc89272be13a58af17604615fc79d5e9cfbcd0d"}
Jul 16 17:45:05.754509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:05.754300    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a446c42098d334eedcc43c85bc89272be13a58af17604615fc79d5e9cfbcd0d"
Jul 16 17:45:08.402803 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.402771    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-6dt2j"]
Jul 16 17:45:08.403205 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.403185    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6289e5ac-7aed-47aa-92c9-89660aed6e64" containerName="cleanup"
Jul 16 17:45:08.403205 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.403197    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6289e5ac-7aed-47aa-92c9-89660aed6e64" containerName="cleanup"
Jul 16 17:45:08.403278 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.403272    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6289e5ac-7aed-47aa-92c9-89660aed6e64" containerName="cleanup"
Jul 16 17:45:08.405283 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.405267    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j"
Jul 16 17:45:08.409106 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.409085    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9vnw5\""
Jul 16 17:45:08.410345 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.410327    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 17:45:08.410437 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.410386    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 17:45:08.423734 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.423705    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-6dt2j"]
Jul 16 17:45:08.466009 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.465969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/358da0a0-587b-4701-9372-e54c9b84bc9c-webhook-cert\") pod \"maas-controller-6b9cdc9cfb-6dt2j\" (UID: \"358da0a0-587b-4701-9372-e54c9b84bc9c\") " pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j"
Jul 16 17:45:08.466190 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.466113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcp8b\" (UniqueName: \"kubernetes.io/projected/358da0a0-587b-4701-9372-e54c9b84bc9c-kube-api-access-xcp8b\") pod \"maas-controller-6b9cdc9cfb-6dt2j\" (UID: \"358da0a0-587b-4701-9372-e54c9b84bc9c\") " pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j"
Jul 16 17:45:08.567561 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.567524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/358da0a0-587b-4701-9372-e54c9b84bc9c-webhook-cert\") pod \"maas-controller-6b9cdc9cfb-6dt2j\" (UID: \"358da0a0-587b-4701-9372-e54c9b84bc9c\") " pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j"
Jul 16 17:45:08.567799 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.567621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcp8b\" (UniqueName: \"kubernetes.io/projected/358da0a0-587b-4701-9372-e54c9b84bc9c-kube-api-access-xcp8b\") pod \"maas-controller-6b9cdc9cfb-6dt2j\" (UID: \"358da0a0-587b-4701-9372-e54c9b84bc9c\") " pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j"
Jul 16 17:45:08.570095 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.570066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/358da0a0-587b-4701-9372-e54c9b84bc9c-webhook-cert\") pod \"maas-controller-6b9cdc9cfb-6dt2j\" (UID: \"358da0a0-587b-4701-9372-e54c9b84bc9c\") " pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j"
Jul 16 17:45:08.582759 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.582734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcp8b\" (UniqueName: \"kubernetes.io/projected/358da0a0-587b-4701-9372-e54c9b84bc9c-kube-api-access-xcp8b\") pod \"maas-controller-6b9cdc9cfb-6dt2j\" (UID: \"358da0a0-587b-4701-9372-e54c9b84bc9c\") " pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j"
Jul 16 17:45:08.715758 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.715719    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j"
Jul 16 17:45:08.857076 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:08.857048    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-6dt2j"]
Jul 16 17:45:08.859058 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:45:08.859006    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358da0a0_587b_4701_9372_e54c9b84bc9c.slice/crio-4b15816fb2fb691a515dcd4a44698ad3b19ddc50958fa41f17296ea626fe5b17 WatchSource:0}: Error finding container 4b15816fb2fb691a515dcd4a44698ad3b19ddc50958fa41f17296ea626fe5b17: Status 404 returned error can't find the container with id 4b15816fb2fb691a515dcd4a44698ad3b19ddc50958fa41f17296ea626fe5b17
Jul 16 17:45:09.777122 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:09.777076    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j" event={"ID":"358da0a0-587b-4701-9372-e54c9b84bc9c","Type":"ContainerStarted","Data":"f781e46aeda39e46bfb72b995e220a1d4ccccb61925ac3a5505a4f2485866a9d"}
Jul 16 17:45:09.777495 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:09.777228    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j"
Jul 16 17:45:09.777495 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:09.777273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j" event={"ID":"358da0a0-587b-4701-9372-e54c9b84bc9c","Type":"ContainerStarted","Data":"4b15816fb2fb691a515dcd4a44698ad3b19ddc50958fa41f17296ea626fe5b17"}
Jul 16 17:45:09.800217 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:09.800159    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j" podStartSLOduration=1.444813306 podStartE2EDuration="1.800143172s" totalImagesPullingTime="355.329866ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:45:09.797841143 +0000 UTC m=+948.352898607" watchObservedRunningTime="2026-07-16 17:45:09.800143172 +0000 UTC m=+948.355200609"
Jul 16 17:45:20.785744 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:20.785715    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j"
Jul 16 17:45:25.438434 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.438395    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:25.563542 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.563504    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-6dt2j"]
Jul 16 17:45:25.563762 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.563726    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j" podUID="358da0a0-587b-4701-9372-e54c9b84bc9c" containerName="manager" containerID="cri-o://f781e46aeda39e46bfb72b995e220a1d4ccccb61925ac3a5505a4f2485866a9d" gracePeriod=30
Jul 16 17:45:25.814021 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.813991    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j"
Jul 16 17:45:25.864538 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.864503    2580 generic.go:356] "Generic (PLEG): container finished" podID="358da0a0-587b-4701-9372-e54c9b84bc9c" containerID="f781e46aeda39e46bfb72b995e220a1d4ccccb61925ac3a5505a4f2485866a9d" exitCode=0
Jul 16 17:45:25.864737 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.864557    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j"
Jul 16 17:45:25.864737 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.864592    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j" event={"ID":"358da0a0-587b-4701-9372-e54c9b84bc9c","Type":"ContainerDied","Data":"f781e46aeda39e46bfb72b995e220a1d4ccccb61925ac3a5505a4f2485866a9d"}
Jul 16 17:45:25.864737 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.864656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b9cdc9cfb-6dt2j" event={"ID":"358da0a0-587b-4701-9372-e54c9b84bc9c","Type":"ContainerDied","Data":"4b15816fb2fb691a515dcd4a44698ad3b19ddc50958fa41f17296ea626fe5b17"}
Jul 16 17:45:25.864737 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.864677    2580 scope.go:117] "RemoveContainer" containerID="f781e46aeda39e46bfb72b995e220a1d4ccccb61925ac3a5505a4f2485866a9d"
Jul 16 17:45:25.873140 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.873125    2580 scope.go:117] "RemoveContainer" containerID="f781e46aeda39e46bfb72b995e220a1d4ccccb61925ac3a5505a4f2485866a9d"
Jul 16 17:45:25.873436 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:45:25.873414    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f781e46aeda39e46bfb72b995e220a1d4ccccb61925ac3a5505a4f2485866a9d\": container with ID starting with f781e46aeda39e46bfb72b995e220a1d4ccccb61925ac3a5505a4f2485866a9d not found: ID does not exist" containerID="f781e46aeda39e46bfb72b995e220a1d4ccccb61925ac3a5505a4f2485866a9d"
Jul 16 17:45:25.873507 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.873449    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f781e46aeda39e46bfb72b995e220a1d4ccccb61925ac3a5505a4f2485866a9d"} err="failed to get container status \"f781e46aeda39e46bfb72b995e220a1d4ccccb61925ac3a5505a4f2485866a9d\": rpc error: code = NotFound desc = could not find container \"f781e46aeda39e46bfb72b995e220a1d4ccccb61925ac3a5505a4f2485866a9d\": container with ID starting with f781e46aeda39e46bfb72b995e220a1d4ccccb61925ac3a5505a4f2485866a9d not found: ID does not exist"
Jul 16 17:45:25.932316 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.932278    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcp8b\" (UniqueName: \"kubernetes.io/projected/358da0a0-587b-4701-9372-e54c9b84bc9c-kube-api-access-xcp8b\") pod \"358da0a0-587b-4701-9372-e54c9b84bc9c\" (UID: \"358da0a0-587b-4701-9372-e54c9b84bc9c\") "
Jul 16 17:45:25.932481 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.932348    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/358da0a0-587b-4701-9372-e54c9b84bc9c-webhook-cert\") pod \"358da0a0-587b-4701-9372-e54c9b84bc9c\" (UID: \"358da0a0-587b-4701-9372-e54c9b84bc9c\") "
Jul 16 17:45:25.934389 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.934360    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358da0a0-587b-4701-9372-e54c9b84bc9c-kube-api-access-xcp8b" (OuterVolumeSpecName: "kube-api-access-xcp8b") pod "358da0a0-587b-4701-9372-e54c9b84bc9c" (UID: "358da0a0-587b-4701-9372-e54c9b84bc9c"). InnerVolumeSpecName "kube-api-access-xcp8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:45:25.934389 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:25.934372    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/358da0a0-587b-4701-9372-e54c9b84bc9c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "358da0a0-587b-4701-9372-e54c9b84bc9c" (UID: "358da0a0-587b-4701-9372-e54c9b84bc9c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:45:26.033898 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:26.033808    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcp8b\" (UniqueName: \"kubernetes.io/projected/358da0a0-587b-4701-9372-e54c9b84bc9c-kube-api-access-xcp8b\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:45:26.033898 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:26.033841    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/358da0a0-587b-4701-9372-e54c9b84bc9c-webhook-cert\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:45:26.189509 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:26.189476    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-6dt2j"]
Jul 16 17:45:26.204357 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:26.198344    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-6dt2j"]
Jul 16 17:45:27.091726 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.091693    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-rhhvv"]
Jul 16 17:45:27.092145 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.092131    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="358da0a0-587b-4701-9372-e54c9b84bc9c" containerName="manager"
Jul 16 17:45:27.092193 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.092146    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="358da0a0-587b-4701-9372-e54c9b84bc9c" containerName="manager"
Jul 16 17:45:27.092228 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.092218    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="358da0a0-587b-4701-9372-e54c9b84bc9c" containerName="manager"
Jul 16 17:45:27.096621 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.096603    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b9cdc9cfb-rhhvv"
Jul 16 17:45:27.100951 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.100929    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 17:45:27.101085 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.100949    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 17:45:27.101085 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.100937    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9vnw5\""
Jul 16 17:45:27.108021 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.107998    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-rhhvv"]
Jul 16 17:45:27.145487 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.145453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e-webhook-cert\") pod \"maas-controller-6b9cdc9cfb-rhhvv\" (UID: \"2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e\") " pod="opendatahub/maas-controller-6b9cdc9cfb-rhhvv"
Jul 16 17:45:27.145696 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.145511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpl7v\" (UniqueName: \"kubernetes.io/projected/2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e-kube-api-access-gpl7v\") pod \"maas-controller-6b9cdc9cfb-rhhvv\" (UID: \"2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e\") " pod="opendatahub/maas-controller-6b9cdc9cfb-rhhvv"
Jul 16 17:45:27.246911 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.246868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e-webhook-cert\") pod \"maas-controller-6b9cdc9cfb-rhhvv\" (UID: \"2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e\") " pod="opendatahub/maas-controller-6b9cdc9cfb-rhhvv"
Jul 16 17:45:27.247148 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.246944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpl7v\" (UniqueName: \"kubernetes.io/projected/2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e-kube-api-access-gpl7v\") pod \"maas-controller-6b9cdc9cfb-rhhvv\" (UID: \"2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e\") " pod="opendatahub/maas-controller-6b9cdc9cfb-rhhvv"
Jul 16 17:45:27.249498 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.249473    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e-webhook-cert\") pod \"maas-controller-6b9cdc9cfb-rhhvv\" (UID: \"2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e\") " pod="opendatahub/maas-controller-6b9cdc9cfb-rhhvv"
Jul 16 17:45:27.258410 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.258376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpl7v\" (UniqueName: \"kubernetes.io/projected/2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e-kube-api-access-gpl7v\") pod \"maas-controller-6b9cdc9cfb-rhhvv\" (UID: \"2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e\") " pod="opendatahub/maas-controller-6b9cdc9cfb-rhhvv"
Jul 16 17:45:27.340639 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.340606    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:27.406948 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.406856    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b9cdc9cfb-rhhvv"
Jul 16 17:45:27.545858 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.545835    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b9cdc9cfb-rhhvv"]
Jul 16 17:45:27.548120 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:45:27.548088    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f50d48f_b65f_4ff4_aaaa_6828e3c9fa2e.slice/crio-2e49579281781e3310894a7b5170e7e395609c349b99be005db7770247f577f0 WatchSource:0}: Error finding container 2e49579281781e3310894a7b5170e7e395609c349b99be005db7770247f577f0: Status 404 returned error can't find the container with id 2e49579281781e3310894a7b5170e7e395609c349b99be005db7770247f577f0
Jul 16 17:45:27.880007 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.879967    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b9cdc9cfb-rhhvv" event={"ID":"2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e","Type":"ContainerStarted","Data":"2e49579281781e3310894a7b5170e7e395609c349b99be005db7770247f577f0"}
Jul 16 17:45:27.966217 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:27.966183    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="358da0a0-587b-4701-9372-e54c9b84bc9c" path="/var/lib/kubelet/pods/358da0a0-587b-4701-9372-e54c9b84bc9c/volumes"
Jul 16 17:45:28.886386 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:28.886352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b9cdc9cfb-rhhvv" event={"ID":"2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e","Type":"ContainerStarted","Data":"5fc7db44f4be2f1e6c76b5217038105e5ee9c6038bdbbfa216fea25ba19bd7b8"}
Jul 16 17:45:28.886765 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:28.886418    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b9cdc9cfb-rhhvv"
Jul 16 17:45:28.917551 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:28.917497    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b9cdc9cfb-rhhvv" podStartSLOduration=1.548924486 podStartE2EDuration="1.917483717s" totalImagesPullingTime="368.559231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:45:28.916560105 +0000 UTC m=+967.471617543" watchObservedRunningTime="2026-07-16 17:45:28.917483717 +0000 UTC m=+967.472541174"
Jul 16 17:45:39.893610 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:45:39.893572    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b9cdc9cfb-rhhvv"
Jul 16 17:46:01.645066 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:46:01.644961    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:46:01.731672 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:46:01.731645    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:46:01.885846 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:46:01.885806    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:46:08.887449 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:46:08.887411    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:46:09.038387 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:46:09.038331    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:46:09.149766 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:46:09.149657    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:46:09.306272 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:46:09.306240    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:46:15.999199 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:46:15.999163    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:46:16.079374 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:46:16.079340    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:47:07.098415 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:47:07.098373    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:47:07.193077 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:47:07.193018    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:47:24.149648 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:47:24.149607    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:49:21.899211 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:49:21.899172    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:49:21.903123 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:49:21.903099    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:49:35.034368 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:49:35.034334    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:50:06.205150 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:50:06.205117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:50:06.279661 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:50:06.279626    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:51:50.641913 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:51:50.641825    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:51:52.213005 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:51:52.212964    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:54:21.940359 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:54:21.940331    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:54:21.944669 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:54:21.944643    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:54:55.453303 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:54:55.453232    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:55:50.172826 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:55:50.172788    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:23.580012 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:23.579978    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:31.222146 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:31.222111    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:39.517911 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:39.517870    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:44.843644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:44.843558    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:48.125772 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:48.125732    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:48.231848 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:48.231809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:48.721240 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:48.721209    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:55.656429 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:55.656385    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:55.863472 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:55.863442    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:56.083644 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:56.083608    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:56.189102 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:56.189012    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:57.195704 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.195655    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:57.341677 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.341638    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"]
Jul 16 17:57:57.346645 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.346606    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:57:57.351930 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.351902    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8b0f3b27-serving-cert\""
Jul 16 17:57:57.352083 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.351976    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nsr52\""
Jul 16 17:57:57.364895 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.364869    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"]
Jul 16 17:57:57.369959 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.369932    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:57.485386 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.485349    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:57.530677 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.530629    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7gdw\" (UniqueName: \"kubernetes.io/projected/a3a67fa9-3454-4984-80d3-17528127bca3-kube-api-access-q7gdw\") pod \"maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6\" (UID: \"a3a67fa9-3454-4984-80d3-17528127bca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:57:57.530845 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.530769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a67fa9-3454-4984-80d3-17528127bca3-maas-api-tls\") pod \"maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6\" (UID: \"a3a67fa9-3454-4984-80d3-17528127bca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:57:57.530845 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.530808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a67fa9-3454-4984-80d3-17528127bca3-openshift-service-ca\") pod \"maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6\" (UID: \"a3a67fa9-3454-4984-80d3-17528127bca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:57:57.632569 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.632525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7gdw\" (UniqueName: \"kubernetes.io/projected/a3a67fa9-3454-4984-80d3-17528127bca3-kube-api-access-q7gdw\") pod \"maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6\" (UID: \"a3a67fa9-3454-4984-80d3-17528127bca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:57:57.632730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.632647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a67fa9-3454-4984-80d3-17528127bca3-maas-api-tls\") pod \"maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6\" (UID: \"a3a67fa9-3454-4984-80d3-17528127bca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:57:57.632730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.632688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a67fa9-3454-4984-80d3-17528127bca3-openshift-service-ca\") pod \"maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6\" (UID: \"a3a67fa9-3454-4984-80d3-17528127bca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:57:57.633519 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.633485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a67fa9-3454-4984-80d3-17528127bca3-openshift-service-ca\") pod \"maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6\" (UID: \"a3a67fa9-3454-4984-80d3-17528127bca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:57:57.635219 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.635197    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a67fa9-3454-4984-80d3-17528127bca3-maas-api-tls\") pod \"maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6\" (UID: \"a3a67fa9-3454-4984-80d3-17528127bca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:57:57.643837 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.643804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7gdw\" (UniqueName: \"kubernetes.io/projected/a3a67fa9-3454-4984-80d3-17528127bca3-kube-api-access-q7gdw\") pod \"maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6\" (UID: \"a3a67fa9-3454-4984-80d3-17528127bca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:57:57.658491 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.658459    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:57:57.810860 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.810836    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"]
Jul 16 17:57:57.813857 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:57:57.813829    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a67fa9_3454_4984_80d3_17528127bca3.slice/crio-cb5e1c307d27e00e31b79552fb40bf22e8abdf38755fa35cbe41da7c1f417181 WatchSource:0}: Error finding container cb5e1c307d27e00e31b79552fb40bf22e8abdf38755fa35cbe41da7c1f417181: Status 404 returned error can't find the container with id cb5e1c307d27e00e31b79552fb40bf22e8abdf38755fa35cbe41da7c1f417181
Jul 16 17:57:57.815239 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:57.815219    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:57:58.598367 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:58.598315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6" event={"ID":"a3a67fa9-3454-4984-80d3-17528127bca3","Type":"ContainerStarted","Data":"cb5e1c307d27e00e31b79552fb40bf22e8abdf38755fa35cbe41da7c1f417181"}
Jul 16 17:57:58.601329 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:58.601304    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:58.775176 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:58.775134    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:59.604645 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:59.604604    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6" event={"ID":"a3a67fa9-3454-4984-80d3-17528127bca3","Type":"ContainerStarted","Data":"308f4f1182c305639c48db8294bc75b5c16b5c03dfe69c4e32bd1d55b5f58644"}
Jul 16 17:57:59.605096 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:59.604764    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:57:59.636354 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:59.636305    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6" podStartSLOduration=1.009182051 podStartE2EDuration="2.636288443s" totalImagesPullingTime="1.627106392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:57:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:57:59.633746729 +0000 UTC m=+1718.188804227" watchObservedRunningTime="2026-07-16 17:57:59.636288443 +0000 UTC m=+1718.191345880"
Jul 16 17:57:59.898951 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:57:59.898917    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:05.614518 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:05.614486    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:58:12.298025 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.297989    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"]
Jul 16 17:58:12.298456 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.298233    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6" podUID="a3a67fa9-3454-4984-80d3-17528127bca3" containerName="maas-api" containerID="cri-o://308f4f1182c305639c48db8294bc75b5c16b5c03dfe69c4e32bd1d55b5f58644" gracePeriod=30
Jul 16 17:58:12.324711 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.324680    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:12.548737 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.548671    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:58:12.668172 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.668131    2580 generic.go:356] "Generic (PLEG): container finished" podID="a3a67fa9-3454-4984-80d3-17528127bca3" containerID="308f4f1182c305639c48db8294bc75b5c16b5c03dfe69c4e32bd1d55b5f58644" exitCode=0
Jul 16 17:58:12.668374 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.668188    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"
Jul 16 17:58:12.668374 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.668222    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6" event={"ID":"a3a67fa9-3454-4984-80d3-17528127bca3","Type":"ContainerDied","Data":"308f4f1182c305639c48db8294bc75b5c16b5c03dfe69c4e32bd1d55b5f58644"}
Jul 16 17:58:12.668374 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.668275    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6" event={"ID":"a3a67fa9-3454-4984-80d3-17528127bca3","Type":"ContainerDied","Data":"cb5e1c307d27e00e31b79552fb40bf22e8abdf38755fa35cbe41da7c1f417181"}
Jul 16 17:58:12.668374 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.668299    2580 scope.go:117] "RemoveContainer" containerID="308f4f1182c305639c48db8294bc75b5c16b5c03dfe69c4e32bd1d55b5f58644"
Jul 16 17:58:12.676937 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.676916    2580 scope.go:117] "RemoveContainer" containerID="308f4f1182c305639c48db8294bc75b5c16b5c03dfe69c4e32bd1d55b5f58644"
Jul 16 17:58:12.677216 ip-10-0-130-51 kubenswrapper[2580]: E0716 17:58:12.677198    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"308f4f1182c305639c48db8294bc75b5c16b5c03dfe69c4e32bd1d55b5f58644\": container with ID starting with 308f4f1182c305639c48db8294bc75b5c16b5c03dfe69c4e32bd1d55b5f58644 not found: ID does not exist" containerID="308f4f1182c305639c48db8294bc75b5c16b5c03dfe69c4e32bd1d55b5f58644"
Jul 16 17:58:12.677277 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.677223    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"308f4f1182c305639c48db8294bc75b5c16b5c03dfe69c4e32bd1d55b5f58644"} err="failed to get container status \"308f4f1182c305639c48db8294bc75b5c16b5c03dfe69c4e32bd1d55b5f58644\": rpc error: code = NotFound desc = could not find container \"308f4f1182c305639c48db8294bc75b5c16b5c03dfe69c4e32bd1d55b5f58644\": container with ID starting with 308f4f1182c305639c48db8294bc75b5c16b5c03dfe69c4e32bd1d55b5f58644 not found: ID does not exist"
Jul 16 17:58:12.678484 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.678466    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a67fa9-3454-4984-80d3-17528127bca3-maas-api-tls\") pod \"a3a67fa9-3454-4984-80d3-17528127bca3\" (UID: \"a3a67fa9-3454-4984-80d3-17528127bca3\") "
Jul 16 17:58:12.678571 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.678536    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7gdw\" (UniqueName: \"kubernetes.io/projected/a3a67fa9-3454-4984-80d3-17528127bca3-kube-api-access-q7gdw\") pod \"a3a67fa9-3454-4984-80d3-17528127bca3\" (UID: \"a3a67fa9-3454-4984-80d3-17528127bca3\") "
Jul 16 17:58:12.678626 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.678590    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a67fa9-3454-4984-80d3-17528127bca3-openshift-service-ca\") pod \"a3a67fa9-3454-4984-80d3-17528127bca3\" (UID: \"a3a67fa9-3454-4984-80d3-17528127bca3\") "
Jul 16 17:58:12.678925 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.678902    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3a67fa9-3454-4984-80d3-17528127bca3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a3a67fa9-3454-4984-80d3-17528127bca3" (UID: "a3a67fa9-3454-4984-80d3-17528127bca3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:58:12.680614 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.680595    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3a67fa9-3454-4984-80d3-17528127bca3-kube-api-access-q7gdw" (OuterVolumeSpecName: "kube-api-access-q7gdw") pod "a3a67fa9-3454-4984-80d3-17528127bca3" (UID: "a3a67fa9-3454-4984-80d3-17528127bca3"). InnerVolumeSpecName "kube-api-access-q7gdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:58:12.680683 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.680622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3a67fa9-3454-4984-80d3-17528127bca3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a3a67fa9-3454-4984-80d3-17528127bca3" (UID: "a3a67fa9-3454-4984-80d3-17528127bca3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:58:12.779454 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.779416    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a67fa9-3454-4984-80d3-17528127bca3-openshift-service-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:58:12.779454 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.779443    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a67fa9-3454-4984-80d3-17528127bca3-maas-api-tls\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:58:12.779454 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.779453    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7gdw\" (UniqueName: \"kubernetes.io/projected/a3a67fa9-3454-4984-80d3-17528127bca3-kube-api-access-q7gdw\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 17:58:12.994708 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:12.994675    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"]
Jul 16 17:58:13.000856 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:13.000828    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8b0f3b27-5955d4cbbd-qvcz6"]
Jul 16 17:58:13.966418 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:13.966385    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3a67fa9-3454-4984-80d3-17528127bca3" path="/var/lib/kubelet/pods/a3a67fa9-3454-4984-80d3-17528127bca3/volumes"
Jul 16 17:58:17.615953 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:17.615910    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:17.857230 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:17.857190    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:17.969325 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:17.969292    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:24.177894 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:24.177864    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:25.476134 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:25.476099    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:25.580419 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:25.580384    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:25.806228 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:25.806151    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:25.935475 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:25.935437    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:26.040698 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:26.040656    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:26.128240 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:26.128142    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:27.394222 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:27.394180    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:27.526867 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:27.526833    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:27.932396 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:27.932365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:28.090950 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:28.090915    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:28.193913 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:28.193839    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:58:29.843541 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:58:29.843515    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:06.148102 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:06.148071    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:06.235538 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:06.235504    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:21.341548 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:21.341513    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:21.442600 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:21.442566    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:21.976083 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:21.976053    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:59:21.981413 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:21.981387    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 17:59:32.018499 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:32.018461    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:32.095537 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:32.095494    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:32.171706 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:32.171671    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:38.777413 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:38.777375    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:39.791006 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:39.790968    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:39.896244 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:39.896208    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:40.080707 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:40.080628    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:40.187171 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:40.187138    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:41.336729 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.336688    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:41.431325 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.431295    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:41.539991 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.539960    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"]
Jul 16 17:59:41.540530 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.540494    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3a67fa9-3454-4984-80d3-17528127bca3" containerName="maas-api"
Jul 16 17:59:41.540530 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.540519    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3a67fa9-3454-4984-80d3-17528127bca3" containerName="maas-api"
Jul 16 17:59:41.540730 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.540681    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3a67fa9-3454-4984-80d3-17528127bca3" containerName="maas-api"
Jul 16 17:59:41.543825 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.543805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 17:59:41.546916 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.546880    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nsr52\""
Jul 16 17:59:41.547136 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.547115    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-41fe79b5-serving-cert\""
Jul 16 17:59:41.555798 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.555769    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"]
Jul 16 17:59:41.601081 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.600981    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:41.629286 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.629244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-258fl\" (UniqueName: \"kubernetes.io/projected/7ae37305-eced-4a2b-abf3-84d603f854d7-kube-api-access-258fl\") pod \"maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh\" (UID: \"7ae37305-eced-4a2b-abf3-84d603f854d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 17:59:41.629286 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.629288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ae37305-eced-4a2b-abf3-84d603f854d7-openshift-service-ca\") pod \"maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh\" (UID: \"7ae37305-eced-4a2b-abf3-84d603f854d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 17:59:41.629504 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.629328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ae37305-eced-4a2b-abf3-84d603f854d7-maas-api-tls\") pod \"maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh\" (UID: \"7ae37305-eced-4a2b-abf3-84d603f854d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 17:59:41.730263 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.730229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-258fl\" (UniqueName: \"kubernetes.io/projected/7ae37305-eced-4a2b-abf3-84d603f854d7-kube-api-access-258fl\") pod \"maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh\" (UID: \"7ae37305-eced-4a2b-abf3-84d603f854d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 17:59:41.730263 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.730268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ae37305-eced-4a2b-abf3-84d603f854d7-openshift-service-ca\") pod \"maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh\" (UID: \"7ae37305-eced-4a2b-abf3-84d603f854d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 17:59:41.730498 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.730312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ae37305-eced-4a2b-abf3-84d603f854d7-maas-api-tls\") pod \"maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh\" (UID: \"7ae37305-eced-4a2b-abf3-84d603f854d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 17:59:41.731007 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.730981    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ae37305-eced-4a2b-abf3-84d603f854d7-openshift-service-ca\") pod \"maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh\" (UID: \"7ae37305-eced-4a2b-abf3-84d603f854d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 17:59:41.732680 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.732659    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ae37305-eced-4a2b-abf3-84d603f854d7-maas-api-tls\") pod \"maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh\" (UID: \"7ae37305-eced-4a2b-abf3-84d603f854d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 17:59:41.741064 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.741010    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:41.743572 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.743553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-258fl\" (UniqueName: \"kubernetes.io/projected/7ae37305-eced-4a2b-abf3-84d603f854d7-kube-api-access-258fl\") pod \"maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh\" (UID: \"7ae37305-eced-4a2b-abf3-84d603f854d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 17:59:41.859322 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:41.859217    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 17:59:42.213201 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:42.213174    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"]
Jul 16 17:59:42.215201 ip-10-0-130-51 kubenswrapper[2580]: W0716 17:59:42.215175    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ae37305_eced_4a2b_abf3_84d603f854d7.slice/crio-089b6bb3cca8e37ece94d38d3d25a5b0bb56f860f5f2e002fd1b292cda7a740b WatchSource:0}: Error finding container 089b6bb3cca8e37ece94d38d3d25a5b0bb56f860f5f2e002fd1b292cda7a740b: Status 404 returned error can't find the container with id 089b6bb3cca8e37ece94d38d3d25a5b0bb56f860f5f2e002fd1b292cda7a740b
Jul 16 17:59:42.264840 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:42.264809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:42.361579 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:42.361544    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:43.122921 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:43.122885    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh" event={"ID":"7ae37305-eced-4a2b-abf3-84d603f854d7","Type":"ContainerStarted","Data":"2084cacee594c3e36ac71c50799ba1aba0940961f764a3ea46cdc62f8eb33d6a"}
Jul 16 17:59:43.123128 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:43.122941    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh" event={"ID":"7ae37305-eced-4a2b-abf3-84d603f854d7","Type":"ContainerStarted","Data":"089b6bb3cca8e37ece94d38d3d25a5b0bb56f860f5f2e002fd1b292cda7a740b"}
Jul 16 17:59:43.123128 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:43.122992    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 17:59:43.143830 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:43.143777    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh" podStartSLOduration=1.77727952 podStartE2EDuration="2.143762077s" totalImagesPullingTime="366.482557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:59:43.142299864 +0000 UTC m=+1821.697357338" watchObservedRunningTime="2026-07-16 17:59:43.143762077 +0000 UTC m=+1821.698819491"
Jul 16 17:59:43.321888 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:43.321857    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:49.132341 ip-10-0-130-51 kubenswrapper[2580]: I0716 17:59:49.132309    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 18:00:46.905507 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:46.905421    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"]
Jul 16 18:00:46.906113 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:46.905739    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh" podUID="7ae37305-eced-4a2b-abf3-84d603f854d7" containerName="maas-api" containerID="cri-o://2084cacee594c3e36ac71c50799ba1aba0940961f764a3ea46cdc62f8eb33d6a" gracePeriod=30
Jul 16 18:00:46.939055 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:46.938997    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:00:47.156893 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.156822    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 18:00:47.265400 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.265371    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ae37305-eced-4a2b-abf3-84d603f854d7-maas-api-tls\") pod \"7ae37305-eced-4a2b-abf3-84d603f854d7\" (UID: \"7ae37305-eced-4a2b-abf3-84d603f854d7\") "
Jul 16 18:00:47.265569 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.265416    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ae37305-eced-4a2b-abf3-84d603f854d7-openshift-service-ca\") pod \"7ae37305-eced-4a2b-abf3-84d603f854d7\" (UID: \"7ae37305-eced-4a2b-abf3-84d603f854d7\") "
Jul 16 18:00:47.265569 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.265529    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-258fl\" (UniqueName: \"kubernetes.io/projected/7ae37305-eced-4a2b-abf3-84d603f854d7-kube-api-access-258fl\") pod \"7ae37305-eced-4a2b-abf3-84d603f854d7\" (UID: \"7ae37305-eced-4a2b-abf3-84d603f854d7\") "
Jul 16 18:00:47.265875 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.265847    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ae37305-eced-4a2b-abf3-84d603f854d7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7ae37305-eced-4a2b-abf3-84d603f854d7" (UID: "7ae37305-eced-4a2b-abf3-84d603f854d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:00:47.267491 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.267463    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ae37305-eced-4a2b-abf3-84d603f854d7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7ae37305-eced-4a2b-abf3-84d603f854d7" (UID: "7ae37305-eced-4a2b-abf3-84d603f854d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:00:47.267601 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.267495    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ae37305-eced-4a2b-abf3-84d603f854d7-kube-api-access-258fl" (OuterVolumeSpecName: "kube-api-access-258fl") pod "7ae37305-eced-4a2b-abf3-84d603f854d7" (UID: "7ae37305-eced-4a2b-abf3-84d603f854d7"). InnerVolumeSpecName "kube-api-access-258fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:00:47.366203 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.366172    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-258fl\" (UniqueName: \"kubernetes.io/projected/7ae37305-eced-4a2b-abf3-84d603f854d7-kube-api-access-258fl\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:00:47.366203 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.366198    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ae37305-eced-4a2b-abf3-84d603f854d7-maas-api-tls\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:00:47.366203 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.366207    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ae37305-eced-4a2b-abf3-84d603f854d7-openshift-service-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:00:47.438605 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.438513    2580 generic.go:356] "Generic (PLEG): container finished" podID="7ae37305-eced-4a2b-abf3-84d603f854d7" containerID="2084cacee594c3e36ac71c50799ba1aba0940961f764a3ea46cdc62f8eb33d6a" exitCode=0
Jul 16 18:00:47.438605 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.438557    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh" event={"ID":"7ae37305-eced-4a2b-abf3-84d603f854d7","Type":"ContainerDied","Data":"2084cacee594c3e36ac71c50799ba1aba0940961f764a3ea46cdc62f8eb33d6a"}
Jul 16 18:00:47.438605 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.438569    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"
Jul 16 18:00:47.438605 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.438601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh" event={"ID":"7ae37305-eced-4a2b-abf3-84d603f854d7","Type":"ContainerDied","Data":"089b6bb3cca8e37ece94d38d3d25a5b0bb56f860f5f2e002fd1b292cda7a740b"}
Jul 16 18:00:47.438922 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.438623    2580 scope.go:117] "RemoveContainer" containerID="2084cacee594c3e36ac71c50799ba1aba0940961f764a3ea46cdc62f8eb33d6a"
Jul 16 18:00:47.447576 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.447540    2580 scope.go:117] "RemoveContainer" containerID="2084cacee594c3e36ac71c50799ba1aba0940961f764a3ea46cdc62f8eb33d6a"
Jul 16 18:00:47.447854 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:00:47.447830    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2084cacee594c3e36ac71c50799ba1aba0940961f764a3ea46cdc62f8eb33d6a\": container with ID starting with 2084cacee594c3e36ac71c50799ba1aba0940961f764a3ea46cdc62f8eb33d6a not found: ID does not exist" containerID="2084cacee594c3e36ac71c50799ba1aba0940961f764a3ea46cdc62f8eb33d6a"
Jul 16 18:00:47.447929 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.447868    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2084cacee594c3e36ac71c50799ba1aba0940961f764a3ea46cdc62f8eb33d6a"} err="failed to get container status \"2084cacee594c3e36ac71c50799ba1aba0940961f764a3ea46cdc62f8eb33d6a\": rpc error: code = NotFound desc = could not find container \"2084cacee594c3e36ac71c50799ba1aba0940961f764a3ea46cdc62f8eb33d6a\": container with ID starting with 2084cacee594c3e36ac71c50799ba1aba0940961f764a3ea46cdc62f8eb33d6a not found: ID does not exist"
Jul 16 18:00:47.466478 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.466445    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"]
Jul 16 18:00:47.472249 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.472224    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-41fe79b5-559bdbdb9c-2kshh"]
Jul 16 18:00:47.966078 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:47.966026    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ae37305-eced-4a2b-abf3-84d603f854d7" path="/var/lib/kubelet/pods/7ae37305-eced-4a2b-abf3-84d603f854d7/volumes"
Jul 16 18:00:49.476401 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:49.476339    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:00:49.575802 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:49.575768    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:00:52.085244 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:52.085213    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:00:53.407986 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:53.407958    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:00:53.526109 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:53.526058    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:00:59.804128 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:00:59.804083    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:01:00.327780 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:01:00.327739    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:01:00.431390 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:01:00.431352    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:01:00.595410 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:01:00.595316    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:01:00.676611 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:01:00.676576    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:01:01.806116 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:01:01.806077    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:01:01.931824 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:01:01.931788    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:01:02.027867 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:01:02.027830    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:01:02.183840 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:01:02.183743    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:01:02.592272 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:01:02.592236    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:01:02.745828 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:01:02.745797    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:01:04.286365 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:01:04.286327    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:16.244695 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:02:16.244587    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:21.377211 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:02:21.377175    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:21.559598 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:02:21.559567    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:21.665436 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:02:21.665343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:28.073461 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:02:28.073429    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:29.493848 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:02:29.493814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:29.586660 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:02:29.586623    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:31.285337 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:02:31.285303    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:38.638802 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:02:38.638767    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:38.745657 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:02:38.745616    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:38.846373 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:02:38.846340    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:38.953281 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:02:38.953193    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:39.391964 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:02:39.391933    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:05.445989 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:05.445949    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:07.212175 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:07.212140    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:12.727286 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:12.727253    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:12.836147 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:12.836110    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:12.926870 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:12.926833    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:28.921805 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:28.921767    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:35.365277 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:35.365244    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:35.468706 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:35.468668    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:35.566587 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:35.566550    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:46.281975 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:46.281898    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:47.236993 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:47.236955    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:54.661080 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:54.661026    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:54.725503 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:54.725463    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:54.817549 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:54.817523    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:54.916881 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:54.916791    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:55.016694 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:55.016657    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:55.919956 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:55.919925    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:56.015394 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:56.015357    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:56.120882 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:56.120850    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:58.043409 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:03:58.043372    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:05.077018 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:05.076980    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:05.178201 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:05.178166    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:05.848840 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:05.848800    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:05.957944 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:05.957906    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:12.676957 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:12.676921    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:12.750628 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:12.750599    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:12.970909 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:12.970857    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:13.342702 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:13.342582    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:13.530659 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:13.530617    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:16.955191 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:16.955151    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:17.064811 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.064762    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:17.102053 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.102000    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"]
Jul 16 18:04:17.102801 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.102779    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ae37305-eced-4a2b-abf3-84d603f854d7" containerName="maas-api"
Jul 16 18:04:17.102935 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.102810    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ae37305-eced-4a2b-abf3-84d603f854d7" containerName="maas-api"
Jul 16 18:04:17.103064 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.102994    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ae37305-eced-4a2b-abf3-84d603f854d7" containerName="maas-api"
Jul 16 18:04:17.106654 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.106627    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:17.109901 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.109875    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2ef0185a-serving-cert\""
Jul 16 18:04:17.110024 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.109979    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nsr52\""
Jul 16 18:04:17.130349 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.130315    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"]
Jul 16 18:04:17.131715 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.131690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pkjr\" (UniqueName: \"kubernetes.io/projected/e2dc634a-e8a7-45d6-9260-7c2049490ea6-kube-api-access-6pkjr\") pod \"maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb\" (UID: \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:17.131838 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.131722    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2dc634a-e8a7-45d6-9260-7c2049490ea6-maas-api-tls\") pod \"maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb\" (UID: \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:17.131838 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.131809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2dc634a-e8a7-45d6-9260-7c2049490ea6-openshift-service-ca\") pod \"maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb\" (UID: \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:17.199539 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.199502    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:17.232595 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.232499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pkjr\" (UniqueName: \"kubernetes.io/projected/e2dc634a-e8a7-45d6-9260-7c2049490ea6-kube-api-access-6pkjr\") pod \"maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb\" (UID: \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:17.232595 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.232546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2dc634a-e8a7-45d6-9260-7c2049490ea6-maas-api-tls\") pod \"maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb\" (UID: \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:17.232595 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.232584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2dc634a-e8a7-45d6-9260-7c2049490ea6-openshift-service-ca\") pod \"maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb\" (UID: \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:17.232823 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:04:17.232699    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-serving-cert: secret "maas-api-e2e-mt-2ef0185a-serving-cert" not found
Jul 16 18:04:17.232823 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:04:17.232775    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2dc634a-e8a7-45d6-9260-7c2049490ea6-maas-api-tls podName:e2dc634a-e8a7-45d6-9260-7c2049490ea6 nodeName:}" failed. No retries permitted until 2026-07-16 18:04:17.732758425 +0000 UTC m=+2096.287815840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e2dc634a-e8a7-45d6-9260-7c2049490ea6-maas-api-tls") pod "maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb" (UID: "e2dc634a-e8a7-45d6-9260-7c2049490ea6") : secret "maas-api-e2e-mt-2ef0185a-serving-cert" not found
Jul 16 18:04:17.233276 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.233240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2dc634a-e8a7-45d6-9260-7c2049490ea6-openshift-service-ca\") pod \"maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb\" (UID: \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:17.243587 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.243552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pkjr\" (UniqueName: \"kubernetes.io/projected/e2dc634a-e8a7-45d6-9260-7c2049490ea6-kube-api-access-6pkjr\") pod \"maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb\" (UID: \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:17.494189 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.494098    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:17.737017 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.736980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2dc634a-e8a7-45d6-9260-7c2049490ea6-maas-api-tls\") pod \"maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb\" (UID: \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:17.739474 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:17.739443    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2dc634a-e8a7-45d6-9260-7c2049490ea6-maas-api-tls\") pod \"maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb\" (UID: \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:18.014425 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:18.014390    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:18.017371 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:18.017347    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:18.124805 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:18.124772    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:18.176351 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:18.176319    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"]
Jul 16 18:04:18.177373 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:04:18.177347    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2dc634a_e8a7_45d6_9260_7c2049490ea6.slice/crio-7b46f43aa7a93461e069c50815311adbbd1e499de661c48890112eac514024af WatchSource:0}: Error finding container 7b46f43aa7a93461e069c50815311adbbd1e499de661c48890112eac514024af: Status 404 returned error can't find the container with id 7b46f43aa7a93461e069c50815311adbbd1e499de661c48890112eac514024af
Jul 16 18:04:18.178775 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:18.178757    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 18:04:18.488550 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:18.488510    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb" event={"ID":"e2dc634a-e8a7-45d6-9260-7c2049490ea6","Type":"ContainerStarted","Data":"7b46f43aa7a93461e069c50815311adbbd1e499de661c48890112eac514024af"}
Jul 16 18:04:19.495440 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:19.495397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb" event={"ID":"e2dc634a-e8a7-45d6-9260-7c2049490ea6","Type":"ContainerStarted","Data":"295369aedb7e602b49331d62a23f2a80c49c4c2362ce1220c4069f454285ac14"}
Jul 16 18:04:19.495875 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:19.495526    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:19.518345 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:19.518289    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb" podStartSLOduration=1.9506878520000002 podStartE2EDuration="2.51827029s" totalImagesPullingTime="567.582438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:04:19.515534833 +0000 UTC m=+2098.070592274" watchObservedRunningTime="2026-07-16 18:04:19.51827029 +0000 UTC m=+2098.073327767"
Jul 16 18:04:21.639025 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:21.638989    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:22.008823 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:22.008797    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 18:04:22.015275 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:22.015253    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 18:04:22.498969 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:22.498935    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:22.597862 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:22.597825    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:23.091873 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:23.091834    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:25.507833 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:25.507798    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:30.362202 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:30.362166    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:30.468853 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:30.468817    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:40.953892 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:40.953859    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"]
Jul 16 18:04:40.954296 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:40.954063    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb" podUID="e2dc634a-e8a7-45d6-9260-7c2049490ea6" containerName="maas-api" containerID="cri-o://295369aedb7e602b49331d62a23f2a80c49c4c2362ce1220c4069f454285ac14" gracePeriod=30
Jul 16 18:04:40.982424 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:40.982398    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:41.199184 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.199156    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:41.255189 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.255159    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2dc634a-e8a7-45d6-9260-7c2049490ea6-maas-api-tls\") pod \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\" (UID: \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\") "
Jul 16 18:04:41.255377 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.255210    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2dc634a-e8a7-45d6-9260-7c2049490ea6-openshift-service-ca\") pod \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\" (UID: \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\") "
Jul 16 18:04:41.255377 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.255313    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pkjr\" (UniqueName: \"kubernetes.io/projected/e2dc634a-e8a7-45d6-9260-7c2049490ea6-kube-api-access-6pkjr\") pod \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\" (UID: \"e2dc634a-e8a7-45d6-9260-7c2049490ea6\") "
Jul 16 18:04:41.255625 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.255583    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2dc634a-e8a7-45d6-9260-7c2049490ea6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e2dc634a-e8a7-45d6-9260-7c2049490ea6" (UID: "e2dc634a-e8a7-45d6-9260-7c2049490ea6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:04:41.255749 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.255714    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2dc634a-e8a7-45d6-9260-7c2049490ea6-openshift-service-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:04:41.257412 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.257386    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2dc634a-e8a7-45d6-9260-7c2049490ea6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e2dc634a-e8a7-45d6-9260-7c2049490ea6" (UID: "e2dc634a-e8a7-45d6-9260-7c2049490ea6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:04:41.257524 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.257435    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2dc634a-e8a7-45d6-9260-7c2049490ea6-kube-api-access-6pkjr" (OuterVolumeSpecName: "kube-api-access-6pkjr") pod "e2dc634a-e8a7-45d6-9260-7c2049490ea6" (UID: "e2dc634a-e8a7-45d6-9260-7c2049490ea6"). InnerVolumeSpecName "kube-api-access-6pkjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:04:41.356446 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.356410    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2dc634a-e8a7-45d6-9260-7c2049490ea6-maas-api-tls\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:04:41.356446 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.356440    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pkjr\" (UniqueName: \"kubernetes.io/projected/e2dc634a-e8a7-45d6-9260-7c2049490ea6-kube-api-access-6pkjr\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:04:41.605096 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.604981    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2dc634a-e8a7-45d6-9260-7c2049490ea6" containerID="295369aedb7e602b49331d62a23f2a80c49c4c2362ce1220c4069f454285ac14" exitCode=0
Jul 16 18:04:41.605096 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.605026    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"
Jul 16 18:04:41.605096 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.605070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb" event={"ID":"e2dc634a-e8a7-45d6-9260-7c2049490ea6","Type":"ContainerDied","Data":"295369aedb7e602b49331d62a23f2a80c49c4c2362ce1220c4069f454285ac14"}
Jul 16 18:04:41.605375 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.605134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb" event={"ID":"e2dc634a-e8a7-45d6-9260-7c2049490ea6","Type":"ContainerDied","Data":"7b46f43aa7a93461e069c50815311adbbd1e499de661c48890112eac514024af"}
Jul 16 18:04:41.605375 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.605164    2580 scope.go:117] "RemoveContainer" containerID="295369aedb7e602b49331d62a23f2a80c49c4c2362ce1220c4069f454285ac14"
Jul 16 18:04:41.614523 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.614507    2580 scope.go:117] "RemoveContainer" containerID="295369aedb7e602b49331d62a23f2a80c49c4c2362ce1220c4069f454285ac14"
Jul 16 18:04:41.614763 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:04:41.614745    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"295369aedb7e602b49331d62a23f2a80c49c4c2362ce1220c4069f454285ac14\": container with ID starting with 295369aedb7e602b49331d62a23f2a80c49c4c2362ce1220c4069f454285ac14 not found: ID does not exist" containerID="295369aedb7e602b49331d62a23f2a80c49c4c2362ce1220c4069f454285ac14"
Jul 16 18:04:41.614803 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.614769    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"295369aedb7e602b49331d62a23f2a80c49c4c2362ce1220c4069f454285ac14"} err="failed to get container status \"295369aedb7e602b49331d62a23f2a80c49c4c2362ce1220c4069f454285ac14\": rpc error: code = NotFound desc = could not find container \"295369aedb7e602b49331d62a23f2a80c49c4c2362ce1220c4069f454285ac14\": container with ID starting with 295369aedb7e602b49331d62a23f2a80c49c4c2362ce1220c4069f454285ac14 not found: ID does not exist"
Jul 16 18:04:41.632625 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.632601    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"]
Jul 16 18:04:41.637985 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.637964    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2ef0185a-5f4cd8c8b9-59kkb"]
Jul 16 18:04:41.965858 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:41.965820    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2dc634a-e8a7-45d6-9260-7c2049490ea6" path="/var/lib/kubelet/pods/e2dc634a-e8a7-45d6-9260-7c2049490ea6/volumes"
Jul 16 18:04:46.150775 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:46.150744    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:46.594876 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:46.594845    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:47.985932 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:47.985889    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:48.071196 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:48.071145    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:53.788527 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:53.788484    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:53.891219 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:53.891173    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:54.173768 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:54.173684    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:54.472947 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:54.472915    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:54.648943 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:54.648905    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:54.821114 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:54.820998    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:54.996871 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:04:54.996835    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:02.386014 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:02.385977    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:02.492897 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:02.492858    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:02.593904 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:02.593857    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:02.895133 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:02.895092    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:09.752838 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:09.752803    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:09.866093 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:09.866031    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:16.950617 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:16.950525    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:17.374774 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:17.374742    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:17.951387 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:17.951347    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:20.132436 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:20.132402    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:20.247003 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:20.246970    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:20.344919 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:20.344868    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:20.845664 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:20.845626    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:20.947062 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:20.947010    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:21.090835 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:21.090792    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:24.709806 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:24.709773    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:50.380715 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:50.380677    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:50.484074 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:50.484017    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:57.184300 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.184269    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"]
Jul 16 18:05:57.186518 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.184677    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2dc634a-e8a7-45d6-9260-7c2049490ea6" containerName="maas-api"
Jul 16 18:05:57.186518 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.184688    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2dc634a-e8a7-45d6-9260-7c2049490ea6" containerName="maas-api"
Jul 16 18:05:57.186518 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.184756    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2dc634a-e8a7-45d6-9260-7c2049490ea6" containerName="maas-api"
Jul 16 18:05:57.187528 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.187507    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.190504 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.190482    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e4fca909\"/\"kube-root-ca.crt\""
Jul 16 18:05:57.190704 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.190680    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e4fca909\"/\"e2e-lifecycle-model-e4fca909-kserve-self-signed-certs\""
Jul 16 18:05:57.190808 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.190725    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e4fca909\"/\"default-dockercfg-mprb2\""
Jul 16 18:05:57.190808 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.190791    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e4fca909\"/\"openshift-service-ca.crt\""
Jul 16 18:05:57.201795 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.201769    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"]
Jul 16 18:05:57.211144 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.211106    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:57.278516 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.278470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-home\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.278516 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.278526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-dshm\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.278767 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.278633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-tmp-dir\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.278767 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.278667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7skq\" (UniqueName: \"kubernetes.io/projected/c45a9cbf-8f9c-4127-b037-e51deda36d02-kube-api-access-x7skq\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.278842 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.278801    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-model-cache\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.278883 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.278852    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45a9cbf-8f9c-4127-b037-e51deda36d02-tls-certs\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.380321 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.380280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-tmp-dir\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.380321 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.380315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7skq\" (UniqueName: \"kubernetes.io/projected/c45a9cbf-8f9c-4127-b037-e51deda36d02-kube-api-access-x7skq\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.380590 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.380373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-model-cache\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.380590 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.380406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45a9cbf-8f9c-4127-b037-e51deda36d02-tls-certs\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.380590 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.380443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-home\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.380590 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.380464    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-dshm\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.380799 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.380750    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-tmp-dir\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.380799 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.380784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-model-cache\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.380869 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.380841    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-home\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.382778 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.382756    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-dshm\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.382956 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.382928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45a9cbf-8f9c-4127-b037-e51deda36d02-tls-certs\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.398457 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.398425    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7skq\" (UniqueName: \"kubernetes.io/projected/c45a9cbf-8f9c-4127-b037-e51deda36d02-kube-api-access-x7skq\") pod \"e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") " pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.497213 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.497179    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:05:57.638239 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.638217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"]
Jul 16 18:05:57.640423 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:05:57.640391    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc45a9cbf_8f9c_4127_b037_e51deda36d02.slice/crio-b0e8a1e6f6124f92fd02646158119578713833f0cd89d39513fcf771a605a3c5 WatchSource:0}: Error finding container b0e8a1e6f6124f92fd02646158119578713833f0cd89d39513fcf771a605a3c5: Status 404 returned error can't find the container with id b0e8a1e6f6124f92fd02646158119578713833f0cd89d39513fcf771a605a3c5
Jul 16 18:05:57.982353 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.982317    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb" event={"ID":"c45a9cbf-8f9c-4127-b037-e51deda36d02","Type":"ContainerStarted","Data":"fa22f1671159cd876c664a1ee36cb9e894e80eb35a3d3a32940de9fa1a6cbdd2"}
Jul 16 18:05:57.982520 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:57.982361    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb" event={"ID":"c45a9cbf-8f9c-4127-b037-e51deda36d02","Type":"ContainerStarted","Data":"b0e8a1e6f6124f92fd02646158119578713833f0cd89d39513fcf771a605a3c5"}
Jul 16 18:05:58.005683 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:05:58.005636    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb" podStartSLOduration=1.005619986 podStartE2EDuration="1.005619986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:05:58.004257362 +0000 UTC m=+2196.559314829" watchObservedRunningTime="2026-07-16 18:05:58.005619986 +0000 UTC m=+2196.560677474"
Jul 16 18:06:02.406162 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:06:02.406121    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:02.469096 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:06:02.469051    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:07.497701 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:06:07.497659    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:06:07.498149 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:06:07.497779    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:06:07.510077 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:06:07.510027    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:06:08.041486 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:06:08.041459    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:06:49.583907 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:06:49.583834    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:54.801779 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:06:54.801746    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:57.722671 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:06:57.722632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:02.685200 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:02.685165    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"]
Jul 16 18:07:02.751392 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:02.751358    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:17.705851 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:17.705779    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb" podUID="c45a9cbf-8f9c-4127-b037-e51deda36d02" containerName="main" containerID="cri-o://fa22f1671159cd876c664a1ee36cb9e894e80eb35a3d3a32940de9fa1a6cbdd2" gracePeriod=45
Jul 16 18:07:17.963028 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:17.962967    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:07:18.059709 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.059675    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-model-cache\") pod \"c45a9cbf-8f9c-4127-b037-e51deda36d02\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") "
Jul 16 18:07:18.059893 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.059738    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45a9cbf-8f9c-4127-b037-e51deda36d02-tls-certs\") pod \"c45a9cbf-8f9c-4127-b037-e51deda36d02\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") "
Jul 16 18:07:18.059893 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.059769    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-dshm\") pod \"c45a9cbf-8f9c-4127-b037-e51deda36d02\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") "
Jul 16 18:07:18.059893 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.059809    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7skq\" (UniqueName: \"kubernetes.io/projected/c45a9cbf-8f9c-4127-b037-e51deda36d02-kube-api-access-x7skq\") pod \"c45a9cbf-8f9c-4127-b037-e51deda36d02\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") "
Jul 16 18:07:18.060073 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.059961    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-home\") pod \"c45a9cbf-8f9c-4127-b037-e51deda36d02\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") "
Jul 16 18:07:18.060073 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.059970    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-model-cache" (OuterVolumeSpecName: "model-cache") pod "c45a9cbf-8f9c-4127-b037-e51deda36d02" (UID: "c45a9cbf-8f9c-4127-b037-e51deda36d02"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:07:18.060073 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.060012    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-tmp-dir\") pod \"c45a9cbf-8f9c-4127-b037-e51deda36d02\" (UID: \"c45a9cbf-8f9c-4127-b037-e51deda36d02\") "
Jul 16 18:07:18.060231 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.060210    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-home" (OuterVolumeSpecName: "home") pod "c45a9cbf-8f9c-4127-b037-e51deda36d02" (UID: "c45a9cbf-8f9c-4127-b037-e51deda36d02"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:07:18.060316 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.060298    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c45a9cbf-8f9c-4127-b037-e51deda36d02" (UID: "c45a9cbf-8f9c-4127-b037-e51deda36d02"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:07:18.060498 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.060481    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-home\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:07:18.060547 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.060501    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-tmp-dir\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:07:18.060547 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.060511    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-model-cache\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:07:18.061979 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.061956    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c45a9cbf-8f9c-4127-b037-e51deda36d02-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c45a9cbf-8f9c-4127-b037-e51deda36d02" (UID: "c45a9cbf-8f9c-4127-b037-e51deda36d02"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:07:18.062295 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.062277    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45a9cbf-8f9c-4127-b037-e51deda36d02-kube-api-access-x7skq" (OuterVolumeSpecName: "kube-api-access-x7skq") pod "c45a9cbf-8f9c-4127-b037-e51deda36d02" (UID: "c45a9cbf-8f9c-4127-b037-e51deda36d02"). InnerVolumeSpecName "kube-api-access-x7skq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:07:18.062295 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.062279    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-dshm" (OuterVolumeSpecName: "dshm") pod "c45a9cbf-8f9c-4127-b037-e51deda36d02" (UID: "c45a9cbf-8f9c-4127-b037-e51deda36d02"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:07:18.161441 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.161402    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45a9cbf-8f9c-4127-b037-e51deda36d02-tls-certs\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:07:18.161441 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.161433    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45a9cbf-8f9c-4127-b037-e51deda36d02-dshm\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:07:18.161441 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.161443    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7skq\" (UniqueName: \"kubernetes.io/projected/c45a9cbf-8f9c-4127-b037-e51deda36d02-kube-api-access-x7skq\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:07:18.391241 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.391157    2580 generic.go:356] "Generic (PLEG): container finished" podID="c45a9cbf-8f9c-4127-b037-e51deda36d02" containerID="fa22f1671159cd876c664a1ee36cb9e894e80eb35a3d3a32940de9fa1a6cbdd2" exitCode=0
Jul 16 18:07:18.391241 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.391204    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"
Jul 16 18:07:18.391423 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.391242    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb" event={"ID":"c45a9cbf-8f9c-4127-b037-e51deda36d02","Type":"ContainerDied","Data":"fa22f1671159cd876c664a1ee36cb9e894e80eb35a3d3a32940de9fa1a6cbdd2"}
Jul 16 18:07:18.391423 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.391292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb" event={"ID":"c45a9cbf-8f9c-4127-b037-e51deda36d02","Type":"ContainerDied","Data":"b0e8a1e6f6124f92fd02646158119578713833f0cd89d39513fcf771a605a3c5"}
Jul 16 18:07:18.391423 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.391316    2580 scope.go:117] "RemoveContainer" containerID="fa22f1671159cd876c664a1ee36cb9e894e80eb35a3d3a32940de9fa1a6cbdd2"
Jul 16 18:07:18.400423 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.400401    2580 scope.go:117] "RemoveContainer" containerID="fa22f1671159cd876c664a1ee36cb9e894e80eb35a3d3a32940de9fa1a6cbdd2"
Jul 16 18:07:18.400705 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:07:18.400689    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa22f1671159cd876c664a1ee36cb9e894e80eb35a3d3a32940de9fa1a6cbdd2\": container with ID starting with fa22f1671159cd876c664a1ee36cb9e894e80eb35a3d3a32940de9fa1a6cbdd2 not found: ID does not exist" containerID="fa22f1671159cd876c664a1ee36cb9e894e80eb35a3d3a32940de9fa1a6cbdd2"
Jul 16 18:07:18.400764 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.400714    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa22f1671159cd876c664a1ee36cb9e894e80eb35a3d3a32940de9fa1a6cbdd2"} err="failed to get container status \"fa22f1671159cd876c664a1ee36cb9e894e80eb35a3d3a32940de9fa1a6cbdd2\": rpc error: code = NotFound desc = could not find container \"fa22f1671159cd876c664a1ee36cb9e894e80eb35a3d3a32940de9fa1a6cbdd2\": container with ID starting with fa22f1671159cd876c664a1ee36cb9e894e80eb35a3d3a32940de9fa1a6cbdd2 not found: ID does not exist"
Jul 16 18:07:18.418129 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.418097    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"]
Jul 16 18:07:18.423263 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:18.423238    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e4fca909/e2e-lifecycle-model-e4fca909-kserve-68684c5667-cqvmb"]
Jul 16 18:07:19.966695 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:19.966650    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c45a9cbf-8f9c-4127-b037-e51deda36d02" path="/var/lib/kubelet/pods/c45a9cbf-8f9c-4127-b037-e51deda36d02/volumes"
Jul 16 18:07:39.128139 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:39.128094    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:40.864010 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:40.863972    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:47.440662 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:47.440626    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:47.522658 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:47.522623    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:47.804747 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:47.804714    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:48.058418 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:48.058333    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:48.436480 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:48.436387    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:48.540145 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:48.540106    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:49.213105 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:49.213072    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:49.312213 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:49.312172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:49.413544 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:49.413505    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:50.372009 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:50.371974    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:50.465437 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:50.465395    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:50.595016 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:50.594988    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:52.259474 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:52.259431    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:58.820545 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:58.820497    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:58.921747 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:58.921655    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:59.550540 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:07:59.550505    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:06.966099 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:06.966064    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:07.041098 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:07.041059    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:07.154125 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:07.154090    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:07.246739 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:07.246652    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:17.770067 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:17.769966    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:18.144403 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:18.144316    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:39.227122 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:39.227088    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:46.791925 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:46.791893    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:46.870762 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:46.870727    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:47.276128 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:47.276096    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:47.684219 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:47.684127    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:48.364897 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:48.364862    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:50.415241 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:50.415207    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:50.503446 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:50.503414    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:50.586911 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:50.586878    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:50.704518 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:50.704433    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:51.221162 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:51.221130    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:51.322507 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:51.322473    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:54.967533 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:54.967500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:55.315190 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:55.315111    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:55.683772 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:55.683685    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:55.869154 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:08:55.869117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:01.193197 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:01.193160    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:01.304464 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:01.304416    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:01.402566 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:01.402523    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:01.503739 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:01.503688    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:02.012221 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:02.012185    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:02.114799 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:02.114763    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:05.749408 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:05.749373    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:12.337221 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:12.337183    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:12.436773 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:12.436739    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:15.934138 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:15.934102    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"]
Jul 16 18:09:15.934527 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:15.934514    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45a9cbf-8f9c-4127-b037-e51deda36d02" containerName="main"
Jul 16 18:09:15.934527 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:15.934528    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45a9cbf-8f9c-4127-b037-e51deda36d02" containerName="main"
Jul 16 18:09:15.934606 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:15.934585    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c45a9cbf-8f9c-4127-b037-e51deda36d02" containerName="main"
Jul 16 18:09:15.937456 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:15.937434    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:15.941900 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:15.941884    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1fa554\"/\"kube-root-ca.crt\""
Jul 16 18:09:15.941900 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:15.941888    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1fa554\"/\"test-model-1fa554-kserve-self-signed-certs\""
Jul 16 18:09:15.942073 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:15.941896    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1fa554\"/\"openshift-service-ca.crt\""
Jul 16 18:09:15.942073 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:15.941888    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1fa554\"/\"default-dockercfg-r9s8f\""
Jul 16 18:09:15.950523 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:15.950459    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"]
Jul 16 18:09:15.962415 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:15.962362    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:16.024351 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.024311    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1450887a-4440-4dc0-bddc-7dce0889d2df-tls-certs\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.024551 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.024356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ztkq\" (UniqueName: \"kubernetes.io/projected/1450887a-4440-4dc0-bddc-7dce0889d2df-kube-api-access-7ztkq\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.024551 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.024399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-model-cache\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.024551 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.024467    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-tmp-dir\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.024551 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.024493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-dshm\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.024551 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.024534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-home\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.125722 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.125691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-home\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.125896 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.125764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1450887a-4440-4dc0-bddc-7dce0889d2df-tls-certs\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.125896 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.125787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztkq\" (UniqueName: \"kubernetes.io/projected/1450887a-4440-4dc0-bddc-7dce0889d2df-kube-api-access-7ztkq\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.125896 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.125813    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-model-cache\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.125896 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.125871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-tmp-dir\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.126133 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.125897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-dshm\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.126241 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.126217    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-home\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.126383 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.126365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-tmp-dir\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.126383 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.126371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-model-cache\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.128245 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.128215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-dshm\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.128460 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.128441    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1450887a-4440-4dc0-bddc-7dce0889d2df-tls-certs\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.136102 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.136073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ztkq\" (UniqueName: \"kubernetes.io/projected/1450887a-4440-4dc0-bddc-7dce0889d2df-kube-api-access-7ztkq\") pod \"test-model-1fa554-kserve-5864b7f6bf-h95tw\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") " pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.247169 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.247126    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:16.396694 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.396666    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"]
Jul 16 18:09:16.398590 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:09:16.398565    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1450887a_4440_4dc0_bddc_7dce0889d2df.slice/crio-4db51a1d36255879dd3720c7b778792bef4f28e77531c6fc21f0c2f0e5b9f0fd WatchSource:0}: Error finding container 4db51a1d36255879dd3720c7b778792bef4f28e77531c6fc21f0c2f0e5b9f0fd: Status 404 returned error can't find the container with id 4db51a1d36255879dd3720c7b778792bef4f28e77531c6fc21f0c2f0e5b9f0fd
Jul 16 18:09:16.975679 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.975641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw" event={"ID":"1450887a-4440-4dc0-bddc-7dce0889d2df","Type":"ContainerStarted","Data":"edc29e488ee4a9a9fa7e1b1a7167c3a852f58bd48a1703e583047a48970bf8c3"}
Jul 16 18:09:16.975679 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.975681    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw" event={"ID":"1450887a-4440-4dc0-bddc-7dce0889d2df","Type":"ContainerStarted","Data":"4db51a1d36255879dd3720c7b778792bef4f28e77531c6fc21f0c2f0e5b9f0fd"}
Jul 16 18:09:16.998311 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:16.998260    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw" podStartSLOduration=1.998244229 podStartE2EDuration="1.998244229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:09:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:09:16.99609308 +0000 UTC m=+2395.551150517" watchObservedRunningTime="2026-07-16 18:09:16.998244229 +0000 UTC m=+2395.553301666"
Jul 16 18:09:22.043453 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:22.043424    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 18:09:22.051701 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:22.051677    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 18:09:23.012091 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:23.012061    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:23.113348 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:23.113316    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:26.247300 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:26.247259    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:26.247692 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:26.247325    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:26.260143 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:26.260115    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:27.036807 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:27.036776    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:09:42.678283 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:09:42.678246    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:04.694368 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:04.694270    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"]
Jul 16 18:10:04.697732 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:04.697705    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:05.779774 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:05.779730    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:06.249234 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:06.249200    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:15.953097 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:15.953057    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:19.714709 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:19.714668    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw" podUID="1450887a-4440-4dc0-bddc-7dce0889d2df" containerName="main" containerID="cri-o://edc29e488ee4a9a9fa7e1b1a7167c3a852f58bd48a1703e583047a48970bf8c3" gracePeriod=45
Jul 16 18:10:19.964286 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:19.964252    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:10:20.063541 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.063454    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-home\") pod \"1450887a-4440-4dc0-bddc-7dce0889d2df\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") "
Jul 16 18:10:20.063541 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.063502    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ztkq\" (UniqueName: \"kubernetes.io/projected/1450887a-4440-4dc0-bddc-7dce0889d2df-kube-api-access-7ztkq\") pod \"1450887a-4440-4dc0-bddc-7dce0889d2df\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") "
Jul 16 18:10:20.063752 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.063586    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-model-cache\") pod \"1450887a-4440-4dc0-bddc-7dce0889d2df\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") "
Jul 16 18:10:20.063752 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.063632    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-dshm\") pod \"1450887a-4440-4dc0-bddc-7dce0889d2df\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") "
Jul 16 18:10:20.063752 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.063676    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-tmp-dir\") pod \"1450887a-4440-4dc0-bddc-7dce0889d2df\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") "
Jul 16 18:10:20.063752 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.063706    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1450887a-4440-4dc0-bddc-7dce0889d2df-tls-certs\") pod \"1450887a-4440-4dc0-bddc-7dce0889d2df\" (UID: \"1450887a-4440-4dc0-bddc-7dce0889d2df\") "
Jul 16 18:10:20.063752 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.063726    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-home" (OuterVolumeSpecName: "home") pod "1450887a-4440-4dc0-bddc-7dce0889d2df" (UID: "1450887a-4440-4dc0-bddc-7dce0889d2df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:10:20.064016 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.063933    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-model-cache" (OuterVolumeSpecName: "model-cache") pod "1450887a-4440-4dc0-bddc-7dce0889d2df" (UID: "1450887a-4440-4dc0-bddc-7dce0889d2df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:10:20.064016 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.063969    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1450887a-4440-4dc0-bddc-7dce0889d2df" (UID: "1450887a-4440-4dc0-bddc-7dce0889d2df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:10:20.064204 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.064186    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-model-cache\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:10:20.064307 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.064289    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-tmp-dir\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:10:20.064371 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.064315    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-home\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:10:20.065874 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.065853    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-dshm" (OuterVolumeSpecName: "dshm") pod "1450887a-4440-4dc0-bddc-7dce0889d2df" (UID: "1450887a-4440-4dc0-bddc-7dce0889d2df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:10:20.065945 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.065877    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1450887a-4440-4dc0-bddc-7dce0889d2df-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1450887a-4440-4dc0-bddc-7dce0889d2df" (UID: "1450887a-4440-4dc0-bddc-7dce0889d2df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:10:20.065995 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.065976    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1450887a-4440-4dc0-bddc-7dce0889d2df-kube-api-access-7ztkq" (OuterVolumeSpecName: "kube-api-access-7ztkq") pod "1450887a-4440-4dc0-bddc-7dce0889d2df" (UID: "1450887a-4440-4dc0-bddc-7dce0889d2df"). InnerVolumeSpecName "kube-api-access-7ztkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:10:20.165409 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.165368    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ztkq\" (UniqueName: \"kubernetes.io/projected/1450887a-4440-4dc0-bddc-7dce0889d2df-kube-api-access-7ztkq\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:10:20.165409 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.165402    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1450887a-4440-4dc0-bddc-7dce0889d2df-dshm\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:10:20.165409 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.165416    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1450887a-4440-4dc0-bddc-7dce0889d2df-tls-certs\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:10:20.301972 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.301935    2580 generic.go:356] "Generic (PLEG): container finished" podID="1450887a-4440-4dc0-bddc-7dce0889d2df" containerID="edc29e488ee4a9a9fa7e1b1a7167c3a852f58bd48a1703e583047a48970bf8c3" exitCode=0
Jul 16 18:10:20.302185 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.301984    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"
Jul 16 18:10:20.302185 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.302018    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw" event={"ID":"1450887a-4440-4dc0-bddc-7dce0889d2df","Type":"ContainerDied","Data":"edc29e488ee4a9a9fa7e1b1a7167c3a852f58bd48a1703e583047a48970bf8c3"}
Jul 16 18:10:20.302185 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.302084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw" event={"ID":"1450887a-4440-4dc0-bddc-7dce0889d2df","Type":"ContainerDied","Data":"4db51a1d36255879dd3720c7b778792bef4f28e77531c6fc21f0c2f0e5b9f0fd"}
Jul 16 18:10:20.302185 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.302102    2580 scope.go:117] "RemoveContainer" containerID="edc29e488ee4a9a9fa7e1b1a7167c3a852f58bd48a1703e583047a48970bf8c3"
Jul 16 18:10:20.311865 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.311844    2580 scope.go:117] "RemoveContainer" containerID="edc29e488ee4a9a9fa7e1b1a7167c3a852f58bd48a1703e583047a48970bf8c3"
Jul 16 18:10:20.312139 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:10:20.312118    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edc29e488ee4a9a9fa7e1b1a7167c3a852f58bd48a1703e583047a48970bf8c3\": container with ID starting with edc29e488ee4a9a9fa7e1b1a7167c3a852f58bd48a1703e583047a48970bf8c3 not found: ID does not exist" containerID="edc29e488ee4a9a9fa7e1b1a7167c3a852f58bd48a1703e583047a48970bf8c3"
Jul 16 18:10:20.312218 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.312148    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edc29e488ee4a9a9fa7e1b1a7167c3a852f58bd48a1703e583047a48970bf8c3"} err="failed to get container status \"edc29e488ee4a9a9fa7e1b1a7167c3a852f58bd48a1703e583047a48970bf8c3\": rpc error: code = NotFound desc = could not find container \"edc29e488ee4a9a9fa7e1b1a7167c3a852f58bd48a1703e583047a48970bf8c3\": container with ID starting with edc29e488ee4a9a9fa7e1b1a7167c3a852f58bd48a1703e583047a48970bf8c3 not found: ID does not exist"
Jul 16 18:10:20.324276 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.324205    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"]
Jul 16 18:10:20.331024 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:20.330998    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-1fa554/test-model-1fa554-kserve-5864b7f6bf-h95tw"]
Jul 16 18:10:21.078190 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:21.078156    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:21.485021 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:21.484986    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:21.966708 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:21.966677    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1450887a-4440-4dc0-bddc-7dce0889d2df" path="/var/lib/kubelet/pods/1450887a-4440-4dc0-bddc-7dce0889d2df/volumes"
Jul 16 18:10:27.951177 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:27.951117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:28.016106 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.016068    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:28.233962 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.233933    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:28.469934 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.469898    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:28.593939 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.593858    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c084-ccgml"]
Jul 16 18:10:28.594304 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.594291    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1450887a-4440-4dc0-bddc-7dce0889d2df" containerName="main"
Jul 16 18:10:28.594352 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.594306    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1450887a-4440-4dc0-bddc-7dce0889d2df" containerName="main"
Jul 16 18:10:28.594392 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.594377    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1450887a-4440-4dc0-bddc-7dce0889d2df" containerName="main"
Jul 16 18:10:28.599283 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.599264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c084-ccgml"
Jul 16 18:10:28.602051 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.602015    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 18:10:28.606173 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.606137    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c084-ccgml"]
Jul 16 18:10:28.753751 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.753711    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45bff916-7bbb-431e-9bde-ae3fcaaef04e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-36c084-ccgml\" (UID: \"45bff916-7bbb-431e-9bde-ae3fcaaef04e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c084-ccgml"
Jul 16 18:10:28.854599 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.854499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45bff916-7bbb-431e-9bde-ae3fcaaef04e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-36c084-ccgml\" (UID: \"45bff916-7bbb-431e-9bde-ae3fcaaef04e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c084-ccgml"
Jul 16 18:10:28.855176 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.855154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45bff916-7bbb-431e-9bde-ae3fcaaef04e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-36c084-ccgml\" (UID: \"45bff916-7bbb-431e-9bde-ae3fcaaef04e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c084-ccgml"
Jul 16 18:10:28.911602 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:28.911568    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c084-ccgml"
Jul 16 18:10:29.046245 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:29.046220    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c084-ccgml"]
Jul 16 18:10:29.048342 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:10:29.048313    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45bff916_7bbb_431e_9bde_ae3fcaaef04e.slice/crio-62b874642ceb416052394fa6e31fbab7a1f8948d8b6564b17bfda4c345d68518 WatchSource:0}: Error finding container 62b874642ceb416052394fa6e31fbab7a1f8948d8b6564b17bfda4c345d68518: Status 404 returned error can't find the container with id 62b874642ceb416052394fa6e31fbab7a1f8948d8b6564b17bfda4c345d68518
Jul 16 18:10:29.347852 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:29.347819    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c084-ccgml" event={"ID":"45bff916-7bbb-431e-9bde-ae3fcaaef04e","Type":"ContainerStarted","Data":"62b874642ceb416052394fa6e31fbab7a1f8948d8b6564b17bfda4c345d68518"}
Jul 16 18:10:30.354449 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:30.354409    2580 generic.go:356] "Generic (PLEG): container finished" podID="45bff916-7bbb-431e-9bde-ae3fcaaef04e" containerID="47ac4aa5a0775ad64340af33370409df5b4f41d2efa69990de5288230ebe9283" exitCode=0
Jul 16 18:10:30.354831 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:30.354460    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c084-ccgml" event={"ID":"45bff916-7bbb-431e-9bde-ae3fcaaef04e","Type":"ContainerDied","Data":"47ac4aa5a0775ad64340af33370409df5b4f41d2efa69990de5288230ebe9283"}
Jul 16 18:10:31.493671 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:31.493643    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c084-ccgml"
Jul 16 18:10:31.584554 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:31.584521    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45bff916-7bbb-431e-9bde-ae3fcaaef04e-maas-api-service-ca\") pod \"45bff916-7bbb-431e-9bde-ae3fcaaef04e\" (UID: \"45bff916-7bbb-431e-9bde-ae3fcaaef04e\") "
Jul 16 18:10:31.584854 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:31.584829    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45bff916-7bbb-431e-9bde-ae3fcaaef04e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "45bff916-7bbb-431e-9bde-ae3fcaaef04e" (UID: "45bff916-7bbb-431e-9bde-ae3fcaaef04e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:10:31.686104 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:31.685991    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45bff916-7bbb-431e-9bde-ae3fcaaef04e-maas-api-service-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:10:32.366215 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:32.366138    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c084-ccgml"
Jul 16 18:10:32.366215 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:32.366150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-36c084-ccgml" event={"ID":"45bff916-7bbb-431e-9bde-ae3fcaaef04e","Type":"ContainerDied","Data":"62b874642ceb416052394fa6e31fbab7a1f8948d8b6564b17bfda4c345d68518"}
Jul 16 18:10:32.366388 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:32.366217    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62b874642ceb416052394fa6e31fbab7a1f8948d8b6564b17bfda4c345d68518"
Jul 16 18:10:38.669623 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:38.669590    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:43.825480 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:43.825448    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:44.224154 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:44.224119    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:51.460430 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:51.460382    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:51.563051 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:51.562993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:51.761471 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:51.761382    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:51.836237 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:51.836199    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:52.135008 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:52.134930    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:52.380860 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:52.380826    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:52.806004 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:52.805971    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:53.268490 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:53.268457    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:53.514347 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:53.514300    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:56.212541 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:56.212508    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:56.351715 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:56.351675    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:56.580637 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:56.580547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:56.671821 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:56.671790    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:57.145870 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:57.145837    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:57.244642 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:10:57.244603    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:00.751426 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:00.751392    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:01.246270 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:01.246238    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:01.652786 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:01.652708    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:01.954927 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:01.954897    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:04.833857 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:04.833811    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:05.118492 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:05.118411    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:05.225480 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:05.225445    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:05.854678 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:05.854643    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:05.953593 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:05.953538    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:09.271225 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:09.271180    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:17.557154 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:17.557073    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b"]
Jul 16 18:11:17.557513 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:17.557492    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45bff916-7bbb-431e-9bde-ae3fcaaef04e" containerName="revoke-keys"
Jul 16 18:11:17.557513 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:17.557504    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="45bff916-7bbb-431e-9bde-ae3fcaaef04e" containerName="revoke-keys"
Jul 16 18:11:17.557587 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:17.557577    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="45bff916-7bbb-431e-9bde-ae3fcaaef04e" containerName="revoke-keys"
Jul 16 18:11:17.560773 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:17.560754    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b"
Jul 16 18:11:17.583184 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:11:17.583138    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-revoke-keys-e2e-api-a-0baa98-m272b\" is forbidden: User \"system:node:ip-10-0-130-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-130-51.ec2.internal' and this object" podUID="b49c7609-da5d-4e90-857e-91499a128aa1" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b"
Jul 16 18:11:17.583184 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:17.583181    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 18:11:17.595721 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:17.595685    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b"]
Jul 16 18:11:17.632308 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:17.632275    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b49c7609-da5d-4e90-857e-91499a128aa1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0baa98-m272b\" (UID: \"b49c7609-da5d-4e90-857e-91499a128aa1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b"
Jul 16 18:11:17.733514 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:17.733469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b49c7609-da5d-4e90-857e-91499a128aa1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0baa98-m272b\" (UID: \"b49c7609-da5d-4e90-857e-91499a128aa1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b"
Jul 16 18:11:17.734152 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:17.734133    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b49c7609-da5d-4e90-857e-91499a128aa1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0baa98-m272b\" (UID: \"b49c7609-da5d-4e90-857e-91499a128aa1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b"
Jul 16 18:11:17.871004 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:17.870914    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b"
Jul 16 18:11:18.006078 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:18.006028    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b"]
Jul 16 18:11:18.008410 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:11:18.008377    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49c7609_da5d_4e90_857e_91499a128aa1.slice/crio-2b165a2c27dab2b59d28067a0d48055f625ca8378a99ded4bf14a4dc80dd0bdf WatchSource:0}: Error finding container 2b165a2c27dab2b59d28067a0d48055f625ca8378a99ded4bf14a4dc80dd0bdf: Status 404 returned error can't find the container with id 2b165a2c27dab2b59d28067a0d48055f625ca8378a99ded4bf14a4dc80dd0bdf
Jul 16 18:11:18.238707 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:18.238671    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:18.338426 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:18.338395    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:18.607079 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:18.607044    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b" event={"ID":"b49c7609-da5d-4e90-857e-91499a128aa1","Type":"ContainerStarted","Data":"dd7ab13fb82fc7b9d10bb2ca14af7015bb78732d2cbf53bc44ed3377be7ffa9b"}
Jul 16 18:11:18.607483 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:18.607103    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b" event={"ID":"b49c7609-da5d-4e90-857e-91499a128aa1","Type":"ContainerStarted","Data":"2b165a2c27dab2b59d28067a0d48055f625ca8378a99ded4bf14a4dc80dd0bdf"}
Jul 16 18:11:18.626444 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:18.626389    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b" podStartSLOduration=1.62637375 podStartE2EDuration="1.62637375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:11:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:11:18.625378086 +0000 UTC m=+2517.180435524" watchObservedRunningTime="2026-07-16 18:11:18.62637375 +0000 UTC m=+2517.181431186"
Jul 16 18:11:19.613540 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:19.613503    2580 generic.go:356] "Generic (PLEG): container finished" podID="b49c7609-da5d-4e90-857e-91499a128aa1" containerID="dd7ab13fb82fc7b9d10bb2ca14af7015bb78732d2cbf53bc44ed3377be7ffa9b" exitCode=0
Jul 16 18:11:19.613989 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:19.613593    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b" event={"ID":"b49c7609-da5d-4e90-857e-91499a128aa1","Type":"ContainerDied","Data":"dd7ab13fb82fc7b9d10bb2ca14af7015bb78732d2cbf53bc44ed3377be7ffa9b"}
Jul 16 18:11:20.755798 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:20.755771    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b"
Jul 16 18:11:20.865302 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:20.865269    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b49c7609-da5d-4e90-857e-91499a128aa1-maas-api-service-ca\") pod \"b49c7609-da5d-4e90-857e-91499a128aa1\" (UID: \"b49c7609-da5d-4e90-857e-91499a128aa1\") "
Jul 16 18:11:20.865632 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:20.865609    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b49c7609-da5d-4e90-857e-91499a128aa1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b49c7609-da5d-4e90-857e-91499a128aa1" (UID: "b49c7609-da5d-4e90-857e-91499a128aa1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:11:20.966275 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:20.966243    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b49c7609-da5d-4e90-857e-91499a128aa1-maas-api-service-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:11:21.630973 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:21.630945    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b"
Jul 16 18:11:21.631151 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:21.630983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0baa98-m272b" event={"ID":"b49c7609-da5d-4e90-857e-91499a128aa1","Type":"ContainerDied","Data":"2b165a2c27dab2b59d28067a0d48055f625ca8378a99ded4bf14a4dc80dd0bdf"}
Jul 16 18:11:21.631151 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:21.631080    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b165a2c27dab2b59d28067a0d48055f625ca8378a99ded4bf14a4dc80dd0bdf"
Jul 16 18:11:26.769045 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:26.768996    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:26.869410 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:26.869373    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:32.716381 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:32.716333    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:37.872750 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:37.872715    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:38.267460 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:38.267426    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:44.914071 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:44.914009    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:45.012732 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.012697    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:45.196610 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.196522    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:45.428728 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.428683    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:45.545087 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.545053    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9"]
Jul 16 18:11:45.545542 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.545527    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b49c7609-da5d-4e90-857e-91499a128aa1" containerName="revoke-keys"
Jul 16 18:11:45.545597 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.545544    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b49c7609-da5d-4e90-857e-91499a128aa1" containerName="revoke-keys"
Jul 16 18:11:45.545633 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.545612    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b49c7609-da5d-4e90-857e-91499a128aa1" containerName="revoke-keys"
Jul 16 18:11:45.548589 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.548573    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9"
Jul 16 18:11:45.551392 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.551373    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 18:11:45.557584 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.557559    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9"]
Jul 16 18:11:45.703453 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.703410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4961839-e536-4536-a0ad-f3a7b4fa3253-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9\" (UID: \"a4961839-e536-4536-a0ad-f3a7b4fa3253\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9"
Jul 16 18:11:45.804742 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.804655    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4961839-e536-4536-a0ad-f3a7b4fa3253-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9\" (UID: \"a4961839-e536-4536-a0ad-f3a7b4fa3253\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9"
Jul 16 18:11:45.805318 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.805300    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4961839-e536-4536-a0ad-f3a7b4fa3253-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9\" (UID: \"a4961839-e536-4536-a0ad-f3a7b4fa3253\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9"
Jul 16 18:11:45.860557 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:45.860528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9"
Jul 16 18:11:46.001061 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:46.001020    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9"]
Jul 16 18:11:46.002933 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:11:46.002904    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4961839_e536_4536_a0ad_f3a7b4fa3253.slice/crio-9ff3e9dd520c589a809f78f1cf535266e7d70d8ff7d7096031117395ba03468c WatchSource:0}: Error finding container 9ff3e9dd520c589a809f78f1cf535266e7d70d8ff7d7096031117395ba03468c: Status 404 returned error can't find the container with id 9ff3e9dd520c589a809f78f1cf535266e7d70d8ff7d7096031117395ba03468c
Jul 16 18:11:46.762781 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:46.762749    2580 generic.go:356] "Generic (PLEG): container finished" podID="a4961839-e536-4536-a0ad-f3a7b4fa3253" containerID="454af6f9c6b60d75607e17bbc16528d44d218964332d1b60291207e86fcf5d4c" exitCode=0
Jul 16 18:11:46.762939 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:46.762839    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9" event={"ID":"a4961839-e536-4536-a0ad-f3a7b4fa3253","Type":"ContainerDied","Data":"454af6f9c6b60d75607e17bbc16528d44d218964332d1b60291207e86fcf5d4c"}
Jul 16 18:11:46.762939 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:46.762911    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9" event={"ID":"a4961839-e536-4536-a0ad-f3a7b4fa3253","Type":"ContainerStarted","Data":"9ff3e9dd520c589a809f78f1cf535266e7d70d8ff7d7096031117395ba03468c"}
Jul 16 18:11:47.899329 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:47.899304    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9"
Jul 16 18:11:48.026927 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:48.026834    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4961839-e536-4536-a0ad-f3a7b4fa3253-maas-api-service-ca\") pod \"a4961839-e536-4536-a0ad-f3a7b4fa3253\" (UID: \"a4961839-e536-4536-a0ad-f3a7b4fa3253\") "
Jul 16 18:11:48.027253 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:48.027228    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4961839-e536-4536-a0ad-f3a7b4fa3253-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4961839-e536-4536-a0ad-f3a7b4fa3253" (UID: "a4961839-e536-4536-a0ad-f3a7b4fa3253"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:11:48.128436 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:48.128401    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4961839-e536-4536-a0ad-f3a7b4fa3253-maas-api-service-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:11:48.774739 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:48.774707    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9"
Jul 16 18:11:48.774922 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:48.774751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9" event={"ID":"a4961839-e536-4536-a0ad-f3a7b4fa3253","Type":"ContainerDied","Data":"9ff3e9dd520c589a809f78f1cf535266e7d70d8ff7d7096031117395ba03468c"}
Jul 16 18:11:48.774922 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:11:48.774804    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ff3e9dd520c589a809f78f1cf535266e7d70d8ff7d7096031117395ba03468c"
Jul 16 18:12:00.642840 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:00.642800    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:05.818144 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:05.818103    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:06.254495 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:06.254459    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:12.765100 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:12.765069    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:12.941318 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:12.941287    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:13.085781 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:13.085694    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:13.323661 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:13.323625    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:13.689572 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:13.689509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:14.019221 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:14.019171    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:14.116570 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:14.116531    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:17.180694 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:17.180665    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:17.299623 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:17.299590    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:17.415931 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:17.415900    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:17.538658 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:17.538618    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:17.983548 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:17.983515    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:18.108250 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:18.108215    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:21.683005 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:21.682965    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:22.029383 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:22.029347    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:22.473317 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:22.473277    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:22.654761 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:22.654711    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:25.173625 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:25.173591    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:25.300490 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:25.300456    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:25.459997 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:25.459969    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:25.944316 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:25.944205    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:26.217562 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:26.217528    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:26.364822 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:26.364787    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:29.687937 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:29.687898    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:39.289924 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:39.289889    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:39.396846 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:39.396809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:48.548823 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:48.548731    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:49.750441 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:49.750403    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:54.962100 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:54.962066    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"]
Jul 16 18:12:54.962536 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:54.962520    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4961839-e536-4536-a0ad-f3a7b4fa3253" containerName="revoke-keys"
Jul 16 18:12:54.962579 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:54.962540    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4961839-e536-4536-a0ad-f3a7b4fa3253" containerName="revoke-keys"
Jul 16 18:12:54.962613 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:54.962598    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4961839-e536-4536-a0ad-f3a7b4fa3253" containerName="revoke-keys"
Jul 16 18:12:54.965679 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:54.965662    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:54.974462 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:54.974434    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7c2a35\"/\"default-dockercfg-hsk5x\""
Jul 16 18:12:54.975119 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:54.975096    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7c2a35\"/\"auth-test-model-7c2a35-kserve-self-signed-certs\""
Jul 16 18:12:54.975913 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:54.975894    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7c2a35\"/\"kube-root-ca.crt\""
Jul 16 18:12:54.980416 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:54.980392    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"]
Jul 16 18:12:54.985092 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:54.985027    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7c2a35\"/\"openshift-service-ca.crt\""
Jul 16 18:12:55.013649 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.013616    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:55.080763 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.080730    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-home\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.080763 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.080769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-dshm\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.080978 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.080871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-tmp-dir\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.080978 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.080933    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n897k\" (UniqueName: \"kubernetes.io/projected/b7903a60-9a8a-4216-b608-50fae6e995ae-kube-api-access-n897k\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.081067 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.080985    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-model-cache\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.081067 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.081024    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7903a60-9a8a-4216-b608-50fae6e995ae-tls-certs\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.182599 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.182560    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-tmp-dir\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.182769 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.182642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n897k\" (UniqueName: \"kubernetes.io/projected/b7903a60-9a8a-4216-b608-50fae6e995ae-kube-api-access-n897k\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.182769 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.182675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-model-cache\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.182769 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.182704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7903a60-9a8a-4216-b608-50fae6e995ae-tls-certs\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.182769 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.182743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-home\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.182769 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.182764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-dshm\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.183049 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.183010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-tmp-dir\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.183093 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.183063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-model-cache\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.183171 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.183150    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-home\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.185176 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.185154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-dshm\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.185312 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.185290    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7903a60-9a8a-4216-b608-50fae6e995ae-tls-certs\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.200818 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.200791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n897k\" (UniqueName: \"kubernetes.io/projected/b7903a60-9a8a-4216-b608-50fae6e995ae-kube-api-access-n897k\") pod \"auth-test-model-7c2a35-kserve-69554f76d7-qtkmr\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") " pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.276333 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.276241    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:12:55.426617 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:55.426593    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"]
Jul 16 18:12:55.428157 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:12:55.428128    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7903a60_9a8a_4216_b608_50fae6e995ae.slice/crio-9a73c7036a07e8f99c9a73e81e8097ed1d8dae91bcdcbb13f8823939780a9269 WatchSource:0}: Error finding container 9a73c7036a07e8f99c9a73e81e8097ed1d8dae91bcdcbb13f8823939780a9269: Status 404 returned error can't find the container with id 9a73c7036a07e8f99c9a73e81e8097ed1d8dae91bcdcbb13f8823939780a9269
Jul 16 18:12:56.116523 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:56.116482    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr" event={"ID":"b7903a60-9a8a-4216-b608-50fae6e995ae","Type":"ContainerStarted","Data":"98a9c07e015cc4b6de73c257769ee75803df204aed413e19fcb07a6e7cc3971b"}
Jul 16 18:12:56.116890 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:56.116533    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr" event={"ID":"b7903a60-9a8a-4216-b608-50fae6e995ae","Type":"ContainerStarted","Data":"9a73c7036a07e8f99c9a73e81e8097ed1d8dae91bcdcbb13f8823939780a9269"}
Jul 16 18:12:56.158539 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:12:56.158489    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr" podStartSLOduration=2.158472041 podStartE2EDuration="2.158472041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:12:56.155627965 +0000 UTC m=+2614.710685402" watchObservedRunningTime="2026-07-16 18:12:56.158472041 +0000 UTC m=+2614.713529480"
Jul 16 18:13:05.276821 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:05.276771    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:13:05.277258 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:05.276851    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:13:05.289424 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:05.289387    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:13:06.187828 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:06.187792    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:13:21.958676 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:21.958636    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"]
Jul 16 18:13:21.963144 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:21.963105    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:21.969696 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:21.969673    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d3e547\"/\"auth-test-model-d3e547-kserve-self-signed-certs\""
Jul 16 18:13:21.969847 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:21.969714    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d3e547\"/\"openshift-service-ca.crt\""
Jul 16 18:13:21.969847 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:21.969742    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d3e547\"/\"kube-root-ca.crt\""
Jul 16 18:13:21.969847 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:21.969674    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d3e547\"/\"default-dockercfg-6ngds\""
Jul 16 18:13:21.976253 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:21.976230    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"]
Jul 16 18:13:22.059972 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.059937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-model-cache\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.060162 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.060013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-dshm\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.060162 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.060073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-tmp-dir\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.060162 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.060149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fxkd\" (UniqueName: \"kubernetes.io/projected/a72c650b-38ca-4d5f-8389-c7ef27e35448-kube-api-access-5fxkd\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.060290 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.060181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-home\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.060290 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.060199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a72c650b-38ca-4d5f-8389-c7ef27e35448-tls-certs\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.065393 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.065368    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:22.161741 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.161697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fxkd\" (UniqueName: \"kubernetes.io/projected/a72c650b-38ca-4d5f-8389-c7ef27e35448-kube-api-access-5fxkd\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.161741 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.161740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-home\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.162021 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.161761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a72c650b-38ca-4d5f-8389-c7ef27e35448-tls-certs\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.162021 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.161815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-model-cache\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.162021 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.161846    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-dshm\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.162021 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.161877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-tmp-dir\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.162279 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.162222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-home\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.162321 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.162271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-model-cache\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.162359 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.162340    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-tmp-dir\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.164087 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.164068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-dshm\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.164356 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.164339    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a72c650b-38ca-4d5f-8389-c7ef27e35448-tls-certs\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.172815 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.172783    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fxkd\" (UniqueName: \"kubernetes.io/projected/a72c650b-38ca-4d5f-8389-c7ef27e35448-kube-api-access-5fxkd\") pod \"auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") " pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.273345 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.273248    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:22.426249 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:22.426214    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"]
Jul 16 18:13:22.433255 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:13:22.433225    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda72c650b_38ca_4d5f_8389_c7ef27e35448.slice/crio-c56254a92717458d4bb9a66440f7e7e4850aa041a0926b6043adf4f613d0259e WatchSource:0}: Error finding container c56254a92717458d4bb9a66440f7e7e4850aa041a0926b6043adf4f613d0259e: Status 404 returned error can't find the container with id c56254a92717458d4bb9a66440f7e7e4850aa041a0926b6043adf4f613d0259e
Jul 16 18:13:23.261291 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:23.261244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx" event={"ID":"a72c650b-38ca-4d5f-8389-c7ef27e35448","Type":"ContainerStarted","Data":"520903c758dacaf1f0dc77fabecab87a017b32b0d4b7db184056045b88bcb405"}
Jul 16 18:13:23.261291 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:23.261292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx" event={"ID":"a72c650b-38ca-4d5f-8389-c7ef27e35448","Type":"ContainerStarted","Data":"c56254a92717458d4bb9a66440f7e7e4850aa041a0926b6043adf4f613d0259e"}
Jul 16 18:13:23.284926 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:23.284879    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx" podStartSLOduration=2.284863559 podStartE2EDuration="2.284863559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:13:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:13:23.283363919 +0000 UTC m=+2641.838421356" watchObservedRunningTime="2026-07-16 18:13:23.284863559 +0000 UTC m=+2641.839921041"
Jul 16 18:13:26.025813 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:26.025771    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:32.273513 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:32.273470    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:32.273914 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:32.273530    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:32.286194 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:32.286162    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:13:32.319601 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:13:32.319570    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:14:22.077228 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:14:22.077197    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 18:14:22.087183 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:14:22.087158    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 18:14:46.253890 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:14:46.253854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:15:00.167479 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:00.167440    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m"]
Jul 16 18:15:00.170724 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:00.170705    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m"
Jul 16 18:15:00.174880 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:00.174857    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 18:15:00.181446 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:00.181425    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m"
Jul 16 18:15:00.192057 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:00.192010    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m"]
Jul 16 18:15:00.324176 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:00.324150    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m"]
Jul 16 18:15:00.326222 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:15:00.326190    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9caadcfd_abd5_4a0c_a68c_75c8c593efde.slice/crio-5a53dbf65d3bc6ff378a22290b7ddd2159729911cc62717f4b9847bdda5ff719 WatchSource:0}: Error finding container 5a53dbf65d3bc6ff378a22290b7ddd2159729911cc62717f4b9847bdda5ff719: Status 404 returned error can't find the container with id 5a53dbf65d3bc6ff378a22290b7ddd2159729911cc62717f4b9847bdda5ff719
Jul 16 18:15:00.768118 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:00.768010    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m" event={"ID":"9caadcfd-abd5-4a0c-a68c-75c8c593efde","Type":"ContainerStarted","Data":"5bbf01fd1b799f7524b60c1ac8df50a844c66e6a31759a5af866b398c43c23bb"}
Jul 16 18:15:00.768118 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:00.768081    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m" event={"ID":"9caadcfd-abd5-4a0c-a68c-75c8c593efde","Type":"ContainerStarted","Data":"5a53dbf65d3bc6ff378a22290b7ddd2159729911cc62717f4b9847bdda5ff719"}
Jul 16 18:15:00.791467 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:00.791409    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m" podStartSLOduration=0.791393075 podStartE2EDuration="791.393075ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:15:00.789297214 +0000 UTC m=+2739.344354650" watchObservedRunningTime="2026-07-16 18:15:00.791393075 +0000 UTC m=+2739.346450538"
Jul 16 18:15:01.775275 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:01.775233    2580 generic.go:356] "Generic (PLEG): container finished" podID="9caadcfd-abd5-4a0c-a68c-75c8c593efde" containerID="5bbf01fd1b799f7524b60c1ac8df50a844c66e6a31759a5af866b398c43c23bb" exitCode=0
Jul 16 18:15:01.775683 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:01.775310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m" event={"ID":"9caadcfd-abd5-4a0c-a68c-75c8c593efde","Type":"ContainerDied","Data":"5bbf01fd1b799f7524b60c1ac8df50a844c66e6a31759a5af866b398c43c23bb"}
Jul 16 18:15:02.917979 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:02.917942    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m"
Jul 16 18:15:03.786366 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:03.786336    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m"
Jul 16 18:15:03.786559 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:03.786383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m" event={"ID":"9caadcfd-abd5-4a0c-a68c-75c8c593efde","Type":"ContainerDied","Data":"5a53dbf65d3bc6ff378a22290b7ddd2159729911cc62717f4b9847bdda5ff719"}
Jul 16 18:15:03.786559 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:03.786434    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a53dbf65d3bc6ff378a22290b7ddd2159729911cc62717f4b9847bdda5ff719"
Jul 16 18:15:27.134096 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:27.134063    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"]
Jul 16 18:15:27.159179 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:27.159146    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:15:28.228688 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:28.228648    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"]
Jul 16 18:15:28.251013 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:28.250981    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:15:40.937123 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:40.937087    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:15:42.154710 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.154661    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr" podUID="b7903a60-9a8a-4216-b608-50fae6e995ae" containerName="main" containerID="cri-o://98a9c07e015cc4b6de73c257769ee75803df204aed413e19fcb07a6e7cc3971b" gracePeriod=45
Jul 16 18:15:42.413674 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.413610    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:15:42.499405 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.499374    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-home\") pod \"b7903a60-9a8a-4216-b608-50fae6e995ae\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") "
Jul 16 18:15:42.499592 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.499415    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-model-cache\") pod \"b7903a60-9a8a-4216-b608-50fae6e995ae\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") "
Jul 16 18:15:42.499592 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.499476    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n897k\" (UniqueName: \"kubernetes.io/projected/b7903a60-9a8a-4216-b608-50fae6e995ae-kube-api-access-n897k\") pod \"b7903a60-9a8a-4216-b608-50fae6e995ae\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") "
Jul 16 18:15:42.499592 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.499501    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-tmp-dir\") pod \"b7903a60-9a8a-4216-b608-50fae6e995ae\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") "
Jul 16 18:15:42.499739 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.499644    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-dshm\") pod \"b7903a60-9a8a-4216-b608-50fae6e995ae\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") "
Jul 16 18:15:42.499739 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.499696    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7903a60-9a8a-4216-b608-50fae6e995ae-tls-certs\") pod \"b7903a60-9a8a-4216-b608-50fae6e995ae\" (UID: \"b7903a60-9a8a-4216-b608-50fae6e995ae\") "
Jul 16 18:15:42.499739 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.499704    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-home" (OuterVolumeSpecName: "home") pod "b7903a60-9a8a-4216-b608-50fae6e995ae" (UID: "b7903a60-9a8a-4216-b608-50fae6e995ae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:15:42.499894 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.499748    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b7903a60-9a8a-4216-b608-50fae6e995ae" (UID: "b7903a60-9a8a-4216-b608-50fae6e995ae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:15:42.499894 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.499716    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-model-cache" (OuterVolumeSpecName: "model-cache") pod "b7903a60-9a8a-4216-b608-50fae6e995ae" (UID: "b7903a60-9a8a-4216-b608-50fae6e995ae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:15:42.500093 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.500071    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-home\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:15:42.500093 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.500089    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-model-cache\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:15:42.500093 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.500100    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-tmp-dir\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:15:42.501756 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.501721    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7903a60-9a8a-4216-b608-50fae6e995ae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b7903a60-9a8a-4216-b608-50fae6e995ae" (UID: "b7903a60-9a8a-4216-b608-50fae6e995ae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:15:42.501756 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.501745    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-dshm" (OuterVolumeSpecName: "dshm") pod "b7903a60-9a8a-4216-b608-50fae6e995ae" (UID: "b7903a60-9a8a-4216-b608-50fae6e995ae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:15:42.501900 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.501757    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7903a60-9a8a-4216-b608-50fae6e995ae-kube-api-access-n897k" (OuterVolumeSpecName: "kube-api-access-n897k") pod "b7903a60-9a8a-4216-b608-50fae6e995ae" (UID: "b7903a60-9a8a-4216-b608-50fae6e995ae"). InnerVolumeSpecName "kube-api-access-n897k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:15:42.601132 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.601078    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n897k\" (UniqueName: \"kubernetes.io/projected/b7903a60-9a8a-4216-b608-50fae6e995ae-kube-api-access-n897k\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:15:42.601132 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.601123    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7903a60-9a8a-4216-b608-50fae6e995ae-dshm\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:15:42.601132 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.601133    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7903a60-9a8a-4216-b608-50fae6e995ae-tls-certs\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:15:42.996220 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.996184    2580 generic.go:356] "Generic (PLEG): container finished" podID="b7903a60-9a8a-4216-b608-50fae6e995ae" containerID="98a9c07e015cc4b6de73c257769ee75803df204aed413e19fcb07a6e7cc3971b" exitCode=0
Jul 16 18:15:42.996392 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.996224    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"
Jul 16 18:15:42.996392 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.996263    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr" event={"ID":"b7903a60-9a8a-4216-b608-50fae6e995ae","Type":"ContainerDied","Data":"98a9c07e015cc4b6de73c257769ee75803df204aed413e19fcb07a6e7cc3971b"}
Jul 16 18:15:42.996392 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.996305    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr" event={"ID":"b7903a60-9a8a-4216-b608-50fae6e995ae","Type":"ContainerDied","Data":"9a73c7036a07e8f99c9a73e81e8097ed1d8dae91bcdcbb13f8823939780a9269"}
Jul 16 18:15:42.996392 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:42.996324    2580 scope.go:117] "RemoveContainer" containerID="98a9c07e015cc4b6de73c257769ee75803df204aed413e19fcb07a6e7cc3971b"
Jul 16 18:15:43.006248 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.006228    2580 scope.go:117] "RemoveContainer" containerID="98a9c07e015cc4b6de73c257769ee75803df204aed413e19fcb07a6e7cc3971b"
Jul 16 18:15:43.006520 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:15:43.006500    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98a9c07e015cc4b6de73c257769ee75803df204aed413e19fcb07a6e7cc3971b\": container with ID starting with 98a9c07e015cc4b6de73c257769ee75803df204aed413e19fcb07a6e7cc3971b not found: ID does not exist" containerID="98a9c07e015cc4b6de73c257769ee75803df204aed413e19fcb07a6e7cc3971b"
Jul 16 18:15:43.006567 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.006528    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a9c07e015cc4b6de73c257769ee75803df204aed413e19fcb07a6e7cc3971b"} err="failed to get container status \"98a9c07e015cc4b6de73c257769ee75803df204aed413e19fcb07a6e7cc3971b\": rpc error: code = NotFound desc = could not find container \"98a9c07e015cc4b6de73c257769ee75803df204aed413e19fcb07a6e7cc3971b\": container with ID starting with 98a9c07e015cc4b6de73c257769ee75803df204aed413e19fcb07a6e7cc3971b not found: ID does not exist"
Jul 16 18:15:43.023161 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.023129    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"]
Jul 16 18:15:43.025120 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.025097    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7c2a35/auth-test-model-7c2a35-kserve-69554f76d7-qtkmr"]
Jul 16 18:15:43.251534 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.251445    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx" podUID="a72c650b-38ca-4d5f-8389-c7ef27e35448" containerName="main" containerID="cri-o://520903c758dacaf1f0dc77fabecab87a017b32b0d4b7db184056045b88bcb405" gracePeriod=45
Jul 16 18:15:43.500702 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.500673    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:15:43.507548 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.507481    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-home\") pod \"a72c650b-38ca-4d5f-8389-c7ef27e35448\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") "
Jul 16 18:15:43.507548 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.507527    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fxkd\" (UniqueName: \"kubernetes.io/projected/a72c650b-38ca-4d5f-8389-c7ef27e35448-kube-api-access-5fxkd\") pod \"a72c650b-38ca-4d5f-8389-c7ef27e35448\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") "
Jul 16 18:15:43.507735 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.507568    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a72c650b-38ca-4d5f-8389-c7ef27e35448-tls-certs\") pod \"a72c650b-38ca-4d5f-8389-c7ef27e35448\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") "
Jul 16 18:15:43.507735 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.507612    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-model-cache\") pod \"a72c650b-38ca-4d5f-8389-c7ef27e35448\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") "
Jul 16 18:15:43.507735 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.507641    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-tmp-dir\") pod \"a72c650b-38ca-4d5f-8389-c7ef27e35448\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") "
Jul 16 18:15:43.507735 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.507671    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-dshm\") pod \"a72c650b-38ca-4d5f-8389-c7ef27e35448\" (UID: \"a72c650b-38ca-4d5f-8389-c7ef27e35448\") "
Jul 16 18:15:43.507735 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.507706    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-home" (OuterVolumeSpecName: "home") pod "a72c650b-38ca-4d5f-8389-c7ef27e35448" (UID: "a72c650b-38ca-4d5f-8389-c7ef27e35448"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:15:43.507972 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.507897    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a72c650b-38ca-4d5f-8389-c7ef27e35448" (UID: "a72c650b-38ca-4d5f-8389-c7ef27e35448"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:15:43.507972 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.507921    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-model-cache" (OuterVolumeSpecName: "model-cache") pod "a72c650b-38ca-4d5f-8389-c7ef27e35448" (UID: "a72c650b-38ca-4d5f-8389-c7ef27e35448"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:15:43.508106 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.508012    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-home\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:15:43.508106 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.508023    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-model-cache\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:15:43.508106 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.508054    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-tmp-dir\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:15:43.509850 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.509826    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a72c650b-38ca-4d5f-8389-c7ef27e35448-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a72c650b-38ca-4d5f-8389-c7ef27e35448" (UID: "a72c650b-38ca-4d5f-8389-c7ef27e35448"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:15:43.509950 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.509859    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-dshm" (OuterVolumeSpecName: "dshm") pod "a72c650b-38ca-4d5f-8389-c7ef27e35448" (UID: "a72c650b-38ca-4d5f-8389-c7ef27e35448"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:15:43.509950 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.509870    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a72c650b-38ca-4d5f-8389-c7ef27e35448-kube-api-access-5fxkd" (OuterVolumeSpecName: "kube-api-access-5fxkd") pod "a72c650b-38ca-4d5f-8389-c7ef27e35448" (UID: "a72c650b-38ca-4d5f-8389-c7ef27e35448"). InnerVolumeSpecName "kube-api-access-5fxkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:15:43.608525 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.608479    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fxkd\" (UniqueName: \"kubernetes.io/projected/a72c650b-38ca-4d5f-8389-c7ef27e35448-kube-api-access-5fxkd\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:15:43.608525 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.608515    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a72c650b-38ca-4d5f-8389-c7ef27e35448-tls-certs\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:15:43.608525 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.608528    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a72c650b-38ca-4d5f-8389-c7ef27e35448-dshm\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:15:43.966623 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:43.966582    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7903a60-9a8a-4216-b608-50fae6e995ae" path="/var/lib/kubelet/pods/b7903a60-9a8a-4216-b608-50fae6e995ae/volumes"
Jul 16 18:15:44.002451 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:44.002415    2580 generic.go:356] "Generic (PLEG): container finished" podID="a72c650b-38ca-4d5f-8389-c7ef27e35448" containerID="520903c758dacaf1f0dc77fabecab87a017b32b0d4b7db184056045b88bcb405" exitCode=0
Jul 16 18:15:44.002614 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:44.002456    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"
Jul 16 18:15:44.002614 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:44.002486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx" event={"ID":"a72c650b-38ca-4d5f-8389-c7ef27e35448","Type":"ContainerDied","Data":"520903c758dacaf1f0dc77fabecab87a017b32b0d4b7db184056045b88bcb405"}
Jul 16 18:15:44.002614 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:44.002527    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx" event={"ID":"a72c650b-38ca-4d5f-8389-c7ef27e35448","Type":"ContainerDied","Data":"c56254a92717458d4bb9a66440f7e7e4850aa041a0926b6043adf4f613d0259e"}
Jul 16 18:15:44.002614 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:44.002543    2580 scope.go:117] "RemoveContainer" containerID="520903c758dacaf1f0dc77fabecab87a017b32b0d4b7db184056045b88bcb405"
Jul 16 18:15:44.011364 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:44.011348    2580 scope.go:117] "RemoveContainer" containerID="520903c758dacaf1f0dc77fabecab87a017b32b0d4b7db184056045b88bcb405"
Jul 16 18:15:44.011664 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:15:44.011637    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"520903c758dacaf1f0dc77fabecab87a017b32b0d4b7db184056045b88bcb405\": container with ID starting with 520903c758dacaf1f0dc77fabecab87a017b32b0d4b7db184056045b88bcb405 not found: ID does not exist" containerID="520903c758dacaf1f0dc77fabecab87a017b32b0d4b7db184056045b88bcb405"
Jul 16 18:15:44.011771 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:44.011670    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"520903c758dacaf1f0dc77fabecab87a017b32b0d4b7db184056045b88bcb405"} err="failed to get container status \"520903c758dacaf1f0dc77fabecab87a017b32b0d4b7db184056045b88bcb405\": rpc error: code = NotFound desc = could not find container \"520903c758dacaf1f0dc77fabecab87a017b32b0d4b7db184056045b88bcb405\": container with ID starting with 520903c758dacaf1f0dc77fabecab87a017b32b0d4b7db184056045b88bcb405 not found: ID does not exist"
Jul 16 18:15:44.023272 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:44.023242    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"]
Jul 16 18:15:44.026884 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:44.026862    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/auth-test-model-d3e547-kserve-64c6bd6cbc-xhmgx"]
Jul 16 18:15:45.967030 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:45.966995    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a72c650b-38ca-4d5f-8389-c7ef27e35448" path="/var/lib/kubelet/pods/a72c650b-38ca-4d5f-8389-c7ef27e35448/volumes"
Jul 16 18:15:52.382578 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:52.382541    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:15:52.481984 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:15:52.481949    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:02.421086 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:02.421028    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:02.521224 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:02.521187    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:04.254269 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.254238    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"]
Jul 16 18:16:04.254681 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.254645    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9caadcfd-abd5-4a0c-a68c-75c8c593efde" containerName="cleanup"
Jul 16 18:16:04.254681 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.254657    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9caadcfd-abd5-4a0c-a68c-75c8c593efde" containerName="cleanup"
Jul 16 18:16:04.254681 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.254669    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7903a60-9a8a-4216-b608-50fae6e995ae" containerName="main"
Jul 16 18:16:04.254681 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.254674    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7903a60-9a8a-4216-b608-50fae6e995ae" containerName="main"
Jul 16 18:16:04.254816 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.254685    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a72c650b-38ca-4d5f-8389-c7ef27e35448" containerName="main"
Jul 16 18:16:04.254816 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.254691    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a72c650b-38ca-4d5f-8389-c7ef27e35448" containerName="main"
Jul 16 18:16:04.254816 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.254761    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7903a60-9a8a-4216-b608-50fae6e995ae" containerName="main"
Jul 16 18:16:04.254816 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.254771    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9caadcfd-abd5-4a0c-a68c-75c8c593efde" containerName="cleanup"
Jul 16 18:16:04.254816 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.254781    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a72c650b-38ca-4d5f-8389-c7ef27e35448" containerName="main"
Jul 16 18:16:04.257029 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.257004    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.261380 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.261354    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d3e547\"/\"default-dockercfg-6ngds\""
Jul 16 18:16:04.261534 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.261354    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d3e547\"/\"kube-root-ca.crt\""
Jul 16 18:16:04.261534 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.261353    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d3e547\"/\"openshift-service-ca.crt\""
Jul 16 18:16:04.261534 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.261431    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d3e547\"/\"sub-test-model-d3e547-kserve-self-signed-certs\""
Jul 16 18:16:04.267589 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.267562    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"]
Jul 16 18:16:04.287956 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.287923    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:04.412002 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.411956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-tmp-dir\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.412241 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.412019    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j6qb\" (UniqueName: \"kubernetes.io/projected/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-kube-api-access-8j6qb\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.412241 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.412121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-tls-certs\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.412241 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.412188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-dshm\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.412369 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.412244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-model-cache\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.412369 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.412281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-home\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.513559 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.513457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-home\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.513729 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.513622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-tmp-dir\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.513729 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.513697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j6qb\" (UniqueName: \"kubernetes.io/projected/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-kube-api-access-8j6qb\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.513848 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.513738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-tls-certs\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.513848 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.513761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-dshm\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.513848 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.513810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-model-cache\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.514015 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.513871    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-home\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.514015 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.513976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-tmp-dir\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.514231 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.514212    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-model-cache\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.516062 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.516021    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-dshm\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.516323 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.516304    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-tls-certs\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.524719 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.524688    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j6qb\" (UniqueName: \"kubernetes.io/projected/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-kube-api-access-8j6qb\") pod \"sub-test-model-d3e547-kserve-69486c6859-29h2t\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") " pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.567226 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.567180    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:04.711348 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:04.711305    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"]
Jul 16 18:16:04.715496 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:16:04.715457    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod288b51d9_9d0b_40aa_bdd6_09b6b8498b3b.slice/crio-493b7840d82c2ede149c2021426f2d39788466abd66cc48f67f3995d02b9ecc2 WatchSource:0}: Error finding container 493b7840d82c2ede149c2021426f2d39788466abd66cc48f67f3995d02b9ecc2: Status 404 returned error can't find the container with id 493b7840d82c2ede149c2021426f2d39788466abd66cc48f67f3995d02b9ecc2
Jul 16 18:16:05.115883 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:05.115782    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t" event={"ID":"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b","Type":"ContainerStarted","Data":"0c523cff9796db8a059a99390a66bd8f015dee4a5182830bd59c3dac95d914ce"}
Jul 16 18:16:05.115883 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:05.115826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t" event={"ID":"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b","Type":"ContainerStarted","Data":"493b7840d82c2ede149c2021426f2d39788466abd66cc48f67f3995d02b9ecc2"}
Jul 16 18:16:05.140655 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:05.140598    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t" podStartSLOduration=1.140576179 podStartE2EDuration="1.140576179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:16:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:16:05.138361993 +0000 UTC m=+2803.693419431" watchObservedRunningTime="2026-07-16 18:16:05.140576179 +0000 UTC m=+2803.695633630"
Jul 16 18:16:14.568142 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:14.568103    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:14.568142 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:14.568150    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:14.580552 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:14.580521    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:15.178716 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:15.178680    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:16:38.267098 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:38.267064    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:53.026367 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:53.026325    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:53.864242 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:53.864211    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"]
Jul 16 18:16:53.888867 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:16:53.888831    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:08.885404 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:08.885334    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t" podUID="288b51d9-9d0b-40aa-bdd6-09b6b8498b3b" containerName="main" containerID="cri-o://0c523cff9796db8a059a99390a66bd8f015dee4a5182830bd59c3dac95d914ce" gracePeriod=45
Jul 16 18:17:09.145066 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.144971    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:17:09.257622 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.257586    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-model-cache\") pod \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") "
Jul 16 18:17:09.257805 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.257636    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8j6qb\" (UniqueName: \"kubernetes.io/projected/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-kube-api-access-8j6qb\") pod \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") "
Jul 16 18:17:09.257805 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.257659    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-tmp-dir\") pod \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") "
Jul 16 18:17:09.257805 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.257787    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-tls-certs\") pod \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") "
Jul 16 18:17:09.257920 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.257885    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-home\") pod \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") "
Jul 16 18:17:09.257954 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.257891    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-model-cache" (OuterVolumeSpecName: "model-cache") pod "288b51d9-9d0b-40aa-bdd6-09b6b8498b3b" (UID: "288b51d9-9d0b-40aa-bdd6-09b6b8498b3b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:17:09.258001 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.257954    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "288b51d9-9d0b-40aa-bdd6-09b6b8498b3b" (UID: "288b51d9-9d0b-40aa-bdd6-09b6b8498b3b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:17:09.258001 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.257985    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-dshm\") pod \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\" (UID: \"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b\") "
Jul 16 18:17:09.258136 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.258118    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-home" (OuterVolumeSpecName: "home") pod "288b51d9-9d0b-40aa-bdd6-09b6b8498b3b" (UID: "288b51d9-9d0b-40aa-bdd6-09b6b8498b3b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:17:09.258302 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.258277    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-model-cache\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:17:09.258302 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.258298    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-tmp-dir\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:17:09.258456 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.258309    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-home\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:17:09.259944 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.259915    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-dshm" (OuterVolumeSpecName: "dshm") pod "288b51d9-9d0b-40aa-bdd6-09b6b8498b3b" (UID: "288b51d9-9d0b-40aa-bdd6-09b6b8498b3b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:17:09.259944 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.259935    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-kube-api-access-8j6qb" (OuterVolumeSpecName: "kube-api-access-8j6qb") pod "288b51d9-9d0b-40aa-bdd6-09b6b8498b3b" (UID: "288b51d9-9d0b-40aa-bdd6-09b6b8498b3b"). InnerVolumeSpecName "kube-api-access-8j6qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:17:09.260121 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.259960    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "288b51d9-9d0b-40aa-bdd6-09b6b8498b3b" (UID: "288b51d9-9d0b-40aa-bdd6-09b6b8498b3b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:17:09.359799 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.359760    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j6qb\" (UniqueName: \"kubernetes.io/projected/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-kube-api-access-8j6qb\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:17:09.359799 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.359791    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-tls-certs\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:17:09.359799 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.359801    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b-dshm\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:17:09.456262 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.456228    2580 generic.go:356] "Generic (PLEG): container finished" podID="288b51d9-9d0b-40aa-bdd6-09b6b8498b3b" containerID="0c523cff9796db8a059a99390a66bd8f015dee4a5182830bd59c3dac95d914ce" exitCode=0
Jul 16 18:17:09.456426 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.456268    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"
Jul 16 18:17:09.456426 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.456311    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t" event={"ID":"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b","Type":"ContainerDied","Data":"0c523cff9796db8a059a99390a66bd8f015dee4a5182830bd59c3dac95d914ce"}
Jul 16 18:17:09.456426 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.456358    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t" event={"ID":"288b51d9-9d0b-40aa-bdd6-09b6b8498b3b","Type":"ContainerDied","Data":"493b7840d82c2ede149c2021426f2d39788466abd66cc48f67f3995d02b9ecc2"}
Jul 16 18:17:09.456426 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.456376    2580 scope.go:117] "RemoveContainer" containerID="0c523cff9796db8a059a99390a66bd8f015dee4a5182830bd59c3dac95d914ce"
Jul 16 18:17:09.466188 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.466169    2580 scope.go:117] "RemoveContainer" containerID="0c523cff9796db8a059a99390a66bd8f015dee4a5182830bd59c3dac95d914ce"
Jul 16 18:17:09.466475 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:17:09.466454    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c523cff9796db8a059a99390a66bd8f015dee4a5182830bd59c3dac95d914ce\": container with ID starting with 0c523cff9796db8a059a99390a66bd8f015dee4a5182830bd59c3dac95d914ce not found: ID does not exist" containerID="0c523cff9796db8a059a99390a66bd8f015dee4a5182830bd59c3dac95d914ce"
Jul 16 18:17:09.466540 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.466484    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c523cff9796db8a059a99390a66bd8f015dee4a5182830bd59c3dac95d914ce"} err="failed to get container status \"0c523cff9796db8a059a99390a66bd8f015dee4a5182830bd59c3dac95d914ce\": rpc error: code = NotFound desc = could not find container \"0c523cff9796db8a059a99390a66bd8f015dee4a5182830bd59c3dac95d914ce\": container with ID starting with 0c523cff9796db8a059a99390a66bd8f015dee4a5182830bd59c3dac95d914ce not found: ID does not exist"
Jul 16 18:17:09.480144 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.480110    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"]
Jul 16 18:17:09.487679 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.487649    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/sub-test-model-d3e547-kserve-69486c6859-29h2t"]
Jul 16 18:17:09.966253 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:09.966220    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="288b51d9-9d0b-40aa-bdd6-09b6b8498b3b" path="/var/lib/kubelet/pods/288b51d9-9d0b-40aa-bdd6-09b6b8498b3b/volumes"
Jul 16 18:17:14.555592 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.555517    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"]
Jul 16 18:17:14.556012 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.555959    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="288b51d9-9d0b-40aa-bdd6-09b6b8498b3b" containerName="main"
Jul 16 18:17:14.556012 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.555974    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="288b51d9-9d0b-40aa-bdd6-09b6b8498b3b" containerName="main"
Jul 16 18:17:14.556111 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.556076    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="288b51d9-9d0b-40aa-bdd6-09b6b8498b3b" containerName="main"
Jul 16 18:17:14.560379 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.560362    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.564916 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.564892    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7c2a35\"/\"openshift-service-ca.crt\""
Jul 16 18:17:14.565056 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.564892    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7c2a35\"/\"default-dockercfg-hsk5x\""
Jul 16 18:17:14.565056 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.564892    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7c2a35\"/\"kube-root-ca.crt\""
Jul 16 18:17:14.565056 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.564892    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7c2a35\"/\"rate-test-model-7c2a35-kserve-self-signed-certs\""
Jul 16 18:17:14.569187 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.568892    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"]
Jul 16 18:17:14.575525 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.575492    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:14.711727 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.711687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-home\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.711904 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.711746    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-dshm\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.711904 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.711792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppqgq\" (UniqueName: \"kubernetes.io/projected/ac0681c8-ae29-4989-b446-a0ef721cc97f-kube-api-access-ppqgq\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.711904 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.711859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-model-cache\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.711904 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.711889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac0681c8-ae29-4989-b446-a0ef721cc97f-tls-certs\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.712074 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.711912    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-tmp-dir\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.812899 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.812809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-dshm\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.812899 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.812854    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppqgq\" (UniqueName: \"kubernetes.io/projected/ac0681c8-ae29-4989-b446-a0ef721cc97f-kube-api-access-ppqgq\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.813157 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.812907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-model-cache\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.813157 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.812946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac0681c8-ae29-4989-b446-a0ef721cc97f-tls-certs\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.813157 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.812979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-tmp-dir\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.813157 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.813087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-home\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.813386 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.813362    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-model-cache\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.813456 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.813395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-home\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.813511 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.813462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-tmp-dir\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.815177 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.815156    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-dshm\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.815549 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.815528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac0681c8-ae29-4989-b446-a0ef721cc97f-tls-certs\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.826283 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.826255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppqgq\" (UniqueName: \"kubernetes.io/projected/ac0681c8-ae29-4989-b446-a0ef721cc97f-kube-api-access-ppqgq\") pod \"rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") " pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:14.871761 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:14.871720    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:15.011694 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:15.011657    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"]
Jul 16 18:17:15.014063 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:17:15.014021    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac0681c8_ae29_4989_b446_a0ef721cc97f.slice/crio-f90a6cb0af0b5229115f212b48cad4c2aac7dae78d2ad187f3a89d7b924414dd WatchSource:0}: Error finding container f90a6cb0af0b5229115f212b48cad4c2aac7dae78d2ad187f3a89d7b924414dd: Status 404 returned error can't find the container with id f90a6cb0af0b5229115f212b48cad4c2aac7dae78d2ad187f3a89d7b924414dd
Jul 16 18:17:15.490004 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:15.489964    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh" event={"ID":"ac0681c8-ae29-4989-b446-a0ef721cc97f","Type":"ContainerStarted","Data":"59c73c918530c6c0b63801ef37d88b8d6a1364ef84a6099d5c8807cc0a09c28c"}
Jul 16 18:17:15.490192 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:15.490019    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh" event={"ID":"ac0681c8-ae29-4989-b446-a0ef721cc97f","Type":"ContainerStarted","Data":"f90a6cb0af0b5229115f212b48cad4c2aac7dae78d2ad187f3a89d7b924414dd"}
Jul 16 18:17:15.512933 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:15.512868    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh" podStartSLOduration=1.5128516410000001 podStartE2EDuration="1.512851641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:17:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:17:15.510574282 +0000 UTC m=+2874.065631742" watchObservedRunningTime="2026-07-16 18:17:15.512851641 +0000 UTC m=+2874.067909079"
Jul 16 18:17:24.872531 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:24.872490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:24.872985 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:24.872547    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:24.885229 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:24.885198    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:25.552385 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:25.552355    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:17:29.143701 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.143665    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"]
Jul 16 18:17:29.149225 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.149199    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.153338 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.153308    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d3e547\"/\"kube-root-ca.crt\""
Jul 16 18:17:29.153481 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.153316    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d3e547\"/\"rate-test-model-d3e547-kserve-self-signed-certs\""
Jul 16 18:17:29.153481 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.153358    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d3e547\"/\"default-dockercfg-6ngds\""
Jul 16 18:17:29.153481 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.153323    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d3e547\"/\"openshift-service-ca.crt\""
Jul 16 18:17:29.158890 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.158866    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"]
Jul 16 18:17:29.181668 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.181640    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:29.258439 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.258402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-tls-certs\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.258627 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.258447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-home\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.258627 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.258539    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-model-cache\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.258627 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.258601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-tmp-dir\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.258627 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.258623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-dshm\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.258833 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.258653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9nw8\" (UniqueName: \"kubernetes.io/projected/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-kube-api-access-t9nw8\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.359712 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.359672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-tmp-dir\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.359712 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.359713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-dshm\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.359961 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.359755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9nw8\" (UniqueName: \"kubernetes.io/projected/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-kube-api-access-t9nw8\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.359961 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.359850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-tls-certs\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.359961 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.359880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-home\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.359961 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.359926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-model-cache\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.360223 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.360145    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-tmp-dir\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.360289 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.360251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-home\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.360340 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.360304    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-model-cache\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.362028 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.362009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-dshm\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.362331 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.362313    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-tls-certs\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.370394 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.370368    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9nw8\" (UniqueName: \"kubernetes.io/projected/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-kube-api-access-t9nw8\") pod \"rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") " pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.459984 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.459954    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:29.598639 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:29.598611    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"]
Jul 16 18:17:29.600526 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:17:29.600496    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc8423d4_5a14_4e11_94b5_d5bf39c9d71d.slice/crio-821bb50f6650accdb04f11bf1da1177188ee61c375c2d4a32adf8b3661ffd482 WatchSource:0}: Error finding container 821bb50f6650accdb04f11bf1da1177188ee61c375c2d4a32adf8b3661ffd482: Status 404 returned error can't find the container with id 821bb50f6650accdb04f11bf1da1177188ee61c375c2d4a32adf8b3661ffd482
Jul 16 18:17:30.571919 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:30.571880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6" event={"ID":"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d","Type":"ContainerStarted","Data":"8ec9fae5cec693a29c69b8faf17a742ea6f20fc48833c2dca90cbcf7353d6251"}
Jul 16 18:17:30.572303 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:30.571930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6" event={"ID":"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d","Type":"ContainerStarted","Data":"821bb50f6650accdb04f11bf1da1177188ee61c375c2d4a32adf8b3661ffd482"}
Jul 16 18:17:30.592754 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:30.592701    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6" podStartSLOduration=1.592687185 podStartE2EDuration="1.592687185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:17:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:17:30.591077099 +0000 UTC m=+2889.146134555" watchObservedRunningTime="2026-07-16 18:17:30.592687185 +0000 UTC m=+2889.147744622"
Jul 16 18:17:39.460277 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:39.460235    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:39.460685 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:39.460300    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:39.472970 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:39.472942    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:39.635424 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:39.635390    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:17:40.220796 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:40.220764    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:40.319642 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:40.319605    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:49.575374 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:49.575341    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:49.673781 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:17:49.673745    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:10.923071 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:10.923023    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"]
Jul 16 18:18:10.946047 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:10.945984    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:12.123304 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:12.123266    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"]
Jul 16 18:18:12.313636 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:12.313606    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:25.943652 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:25.943606    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh" podUID="ac0681c8-ae29-4989-b446-a0ef721cc97f" containerName="main" containerID="cri-o://59c73c918530c6c0b63801ef37d88b8d6a1364ef84a6099d5c8807cc0a09c28c" gracePeriod=45
Jul 16 18:18:26.210012 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.209985    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:18:26.325482 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.325440    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-home\") pod \"ac0681c8-ae29-4989-b446-a0ef721cc97f\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") "
Jul 16 18:18:26.325482 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.325485    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppqgq\" (UniqueName: \"kubernetes.io/projected/ac0681c8-ae29-4989-b446-a0ef721cc97f-kube-api-access-ppqgq\") pod \"ac0681c8-ae29-4989-b446-a0ef721cc97f\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") "
Jul 16 18:18:26.325757 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.325522    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac0681c8-ae29-4989-b446-a0ef721cc97f-tls-certs\") pod \"ac0681c8-ae29-4989-b446-a0ef721cc97f\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") "
Jul 16 18:18:26.325757 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.325570    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-model-cache\") pod \"ac0681c8-ae29-4989-b446-a0ef721cc97f\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") "
Jul 16 18:18:26.325757 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.325601    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-dshm\") pod \"ac0681c8-ae29-4989-b446-a0ef721cc97f\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") "
Jul 16 18:18:26.325757 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.325648    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-tmp-dir\") pod \"ac0681c8-ae29-4989-b446-a0ef721cc97f\" (UID: \"ac0681c8-ae29-4989-b446-a0ef721cc97f\") "
Jul 16 18:18:26.325940 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.325771    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-home" (OuterVolumeSpecName: "home") pod "ac0681c8-ae29-4989-b446-a0ef721cc97f" (UID: "ac0681c8-ae29-4989-b446-a0ef721cc97f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:18:26.325940 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.325865    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-model-cache" (OuterVolumeSpecName: "model-cache") pod "ac0681c8-ae29-4989-b446-a0ef721cc97f" (UID: "ac0681c8-ae29-4989-b446-a0ef721cc97f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:18:26.326083 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.325993    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ac0681c8-ae29-4989-b446-a0ef721cc97f" (UID: "ac0681c8-ae29-4989-b446-a0ef721cc97f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:18:26.326139 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.326106    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-model-cache\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:26.326178 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.326153    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-tmp-dir\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:26.326178 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.326166    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-home\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:26.327813 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.327780    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-dshm" (OuterVolumeSpecName: "dshm") pod "ac0681c8-ae29-4989-b446-a0ef721cc97f" (UID: "ac0681c8-ae29-4989-b446-a0ef721cc97f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:18:26.327813 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.327804    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac0681c8-ae29-4989-b446-a0ef721cc97f-kube-api-access-ppqgq" (OuterVolumeSpecName: "kube-api-access-ppqgq") pod "ac0681c8-ae29-4989-b446-a0ef721cc97f" (UID: "ac0681c8-ae29-4989-b446-a0ef721cc97f"). InnerVolumeSpecName "kube-api-access-ppqgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:18:26.327959 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.327811    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac0681c8-ae29-4989-b446-a0ef721cc97f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ac0681c8-ae29-4989-b446-a0ef721cc97f" (UID: "ac0681c8-ae29-4989-b446-a0ef721cc97f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:18:26.427128 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.427082    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac0681c8-ae29-4989-b446-a0ef721cc97f-dshm\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:26.427128 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.427117    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppqgq\" (UniqueName: \"kubernetes.io/projected/ac0681c8-ae29-4989-b446-a0ef721cc97f-kube-api-access-ppqgq\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:26.427128 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.427127    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac0681c8-ae29-4989-b446-a0ef721cc97f-tls-certs\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:26.873688 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.873650    2580 generic.go:356] "Generic (PLEG): container finished" podID="ac0681c8-ae29-4989-b446-a0ef721cc97f" containerID="59c73c918530c6c0b63801ef37d88b8d6a1364ef84a6099d5c8807cc0a09c28c" exitCode=0
Jul 16 18:18:26.873867 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.873692    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"
Jul 16 18:18:26.873867 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.873737    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh" event={"ID":"ac0681c8-ae29-4989-b446-a0ef721cc97f","Type":"ContainerDied","Data":"59c73c918530c6c0b63801ef37d88b8d6a1364ef84a6099d5c8807cc0a09c28c"}
Jul 16 18:18:26.873867 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.873791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh" event={"ID":"ac0681c8-ae29-4989-b446-a0ef721cc97f","Type":"ContainerDied","Data":"f90a6cb0af0b5229115f212b48cad4c2aac7dae78d2ad187f3a89d7b924414dd"}
Jul 16 18:18:26.873867 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.873813    2580 scope.go:117] "RemoveContainer" containerID="59c73c918530c6c0b63801ef37d88b8d6a1364ef84a6099d5c8807cc0a09c28c"
Jul 16 18:18:26.883644 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.883624    2580 scope.go:117] "RemoveContainer" containerID="59c73c918530c6c0b63801ef37d88b8d6a1364ef84a6099d5c8807cc0a09c28c"
Jul 16 18:18:26.883949 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:18:26.883930    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59c73c918530c6c0b63801ef37d88b8d6a1364ef84a6099d5c8807cc0a09c28c\": container with ID starting with 59c73c918530c6c0b63801ef37d88b8d6a1364ef84a6099d5c8807cc0a09c28c not found: ID does not exist" containerID="59c73c918530c6c0b63801ef37d88b8d6a1364ef84a6099d5c8807cc0a09c28c"
Jul 16 18:18:26.884004 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.883958    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59c73c918530c6c0b63801ef37d88b8d6a1364ef84a6099d5c8807cc0a09c28c"} err="failed to get container status \"59c73c918530c6c0b63801ef37d88b8d6a1364ef84a6099d5c8807cc0a09c28c\": rpc error: code = NotFound desc = could not find container \"59c73c918530c6c0b63801ef37d88b8d6a1364ef84a6099d5c8807cc0a09c28c\": container with ID starting with 59c73c918530c6c0b63801ef37d88b8d6a1364ef84a6099d5c8807cc0a09c28c not found: ID does not exist"
Jul 16 18:18:26.897054 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.897017    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"]
Jul 16 18:18:26.902079 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:26.902053    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7c2a35/rate-test-model-7c2a35-kserve-66bdd966cf-4t4kh"]
Jul 16 18:18:27.143687 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.143586    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6" podUID="fc8423d4-5a14-4e11-94b5-d5bf39c9d71d" containerName="main" containerID="cri-o://8ec9fae5cec693a29c69b8faf17a742ea6f20fc48833c2dca90cbcf7353d6251" gracePeriod=45
Jul 16 18:18:27.396079 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.396003    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:18:27.434807 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.434772    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-dshm\") pod \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") "
Jul 16 18:18:27.434978 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.434857    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-tls-certs\") pod \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") "
Jul 16 18:18:27.434978 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.434874    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9nw8\" (UniqueName: \"kubernetes.io/projected/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-kube-api-access-t9nw8\") pod \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") "
Jul 16 18:18:27.434978 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.434904    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-tmp-dir\") pod \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") "
Jul 16 18:18:27.434978 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.434934    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-model-cache\") pod \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") "
Jul 16 18:18:27.434978 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.434979    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-home\") pod \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\" (UID: \"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d\") "
Jul 16 18:18:27.435282 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.435250    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fc8423d4-5a14-4e11-94b5-d5bf39c9d71d" (UID: "fc8423d4-5a14-4e11-94b5-d5bf39c9d71d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:18:27.435352 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.435263    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-model-cache" (OuterVolumeSpecName: "model-cache") pod "fc8423d4-5a14-4e11-94b5-d5bf39c9d71d" (UID: "fc8423d4-5a14-4e11-94b5-d5bf39c9d71d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:18:27.435407 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.435371    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-tmp-dir\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:27.435407 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.435387    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-model-cache\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:27.435407 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.435386    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-home" (OuterVolumeSpecName: "home") pod "fc8423d4-5a14-4e11-94b5-d5bf39c9d71d" (UID: "fc8423d4-5a14-4e11-94b5-d5bf39c9d71d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:18:27.437076 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.437027    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-dshm" (OuterVolumeSpecName: "dshm") pod "fc8423d4-5a14-4e11-94b5-d5bf39c9d71d" (UID: "fc8423d4-5a14-4e11-94b5-d5bf39c9d71d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:18:27.437214 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.437081    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-kube-api-access-t9nw8" (OuterVolumeSpecName: "kube-api-access-t9nw8") pod "fc8423d4-5a14-4e11-94b5-d5bf39c9d71d" (UID: "fc8423d4-5a14-4e11-94b5-d5bf39c9d71d"). InnerVolumeSpecName "kube-api-access-t9nw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:18:27.437214 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.437100    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fc8423d4-5a14-4e11-94b5-d5bf39c9d71d" (UID: "fc8423d4-5a14-4e11-94b5-d5bf39c9d71d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:18:27.536603 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.536553    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-tls-certs\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:27.536603 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.536597    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9nw8\" (UniqueName: \"kubernetes.io/projected/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-kube-api-access-t9nw8\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:27.536603 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.536608    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-home\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:27.536603 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.536617    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d-dshm\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:27.880238 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.880206    2580 generic.go:356] "Generic (PLEG): container finished" podID="fc8423d4-5a14-4e11-94b5-d5bf39c9d71d" containerID="8ec9fae5cec693a29c69b8faf17a742ea6f20fc48833c2dca90cbcf7353d6251" exitCode=0
Jul 16 18:18:27.880427 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.880253    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"
Jul 16 18:18:27.880427 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.880294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6" event={"ID":"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d","Type":"ContainerDied","Data":"8ec9fae5cec693a29c69b8faf17a742ea6f20fc48833c2dca90cbcf7353d6251"}
Jul 16 18:18:27.880427 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.880336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6" event={"ID":"fc8423d4-5a14-4e11-94b5-d5bf39c9d71d","Type":"ContainerDied","Data":"821bb50f6650accdb04f11bf1da1177188ee61c375c2d4a32adf8b3661ffd482"}
Jul 16 18:18:27.880427 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.880360    2580 scope.go:117] "RemoveContainer" containerID="8ec9fae5cec693a29c69b8faf17a742ea6f20fc48833c2dca90cbcf7353d6251"
Jul 16 18:18:27.889704 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.889683    2580 scope.go:117] "RemoveContainer" containerID="8ec9fae5cec693a29c69b8faf17a742ea6f20fc48833c2dca90cbcf7353d6251"
Jul 16 18:18:27.889998 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:18:27.889978    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ec9fae5cec693a29c69b8faf17a742ea6f20fc48833c2dca90cbcf7353d6251\": container with ID starting with 8ec9fae5cec693a29c69b8faf17a742ea6f20fc48833c2dca90cbcf7353d6251 not found: ID does not exist" containerID="8ec9fae5cec693a29c69b8faf17a742ea6f20fc48833c2dca90cbcf7353d6251"
Jul 16 18:18:27.890067 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.890005    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec9fae5cec693a29c69b8faf17a742ea6f20fc48833c2dca90cbcf7353d6251"} err="failed to get container status \"8ec9fae5cec693a29c69b8faf17a742ea6f20fc48833c2dca90cbcf7353d6251\": rpc error: code = NotFound desc = could not find container \"8ec9fae5cec693a29c69b8faf17a742ea6f20fc48833c2dca90cbcf7353d6251\": container with ID starting with 8ec9fae5cec693a29c69b8faf17a742ea6f20fc48833c2dca90cbcf7353d6251 not found: ID does not exist"
Jul 16 18:18:27.903881 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.903846    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"]
Jul 16 18:18:27.906521 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.906500    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d3e547/rate-test-model-d3e547-kserve-64cf56d6dc-s9gh6"]
Jul 16 18:18:27.967318 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.967286    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac0681c8-ae29-4989-b446-a0ef721cc97f" path="/var/lib/kubelet/pods/ac0681c8-ae29-4989-b446-a0ef721cc97f/volumes"
Jul 16 18:18:27.967707 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:27.967695    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc8423d4-5a14-4e11-94b5-d5bf39c9d71d" path="/var/lib/kubelet/pods/fc8423d4-5a14-4e11-94b5-d5bf39c9d71d/volumes"
Jul 16 18:18:29.021741 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.021712    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7579-140040550037808"]
Jul 16 18:18:29.022220 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.022204    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc8423d4-5a14-4e11-94b5-d5bf39c9d71d" containerName="main"
Jul 16 18:18:29.022220 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.022221    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc8423d4-5a14-4e11-94b5-d5bf39c9d71d" containerName="main"
Jul 16 18:18:29.022302 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.022231    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac0681c8-ae29-4989-b446-a0ef721cc97f" containerName="main"
Jul 16 18:18:29.022302 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.022237    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac0681c8-ae29-4989-b446-a0ef721cc97f" containerName="main"
Jul 16 18:18:29.022370 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.022305    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac0681c8-ae29-4989-b446-a0ef721cc97f" containerName="main"
Jul 16 18:18:29.022370 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.022318    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc8423d4-5a14-4e11-94b5-d5bf39c9d71d" containerName="main"
Jul 16 18:18:29.026881 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.026864    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140040550037808"
Jul 16 18:18:29.039390 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.039366    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xl26f\""
Jul 16 18:18:29.041857 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.041831    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140040550037808"]
Jul 16 18:18:29.154201 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.154158    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zp8z\" (UniqueName: \"kubernetes.io/projected/ccaedbea-48b2-4134-bf45-04515c0c8446-kube-api-access-7zp8z\") pod \"test-curl-7579-140040550037808\" (UID: \"ccaedbea-48b2-4134-bf45-04515c0c8446\") " pod="opendatahub/test-curl-7579-140040550037808"
Jul 16 18:18:29.254882 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.254838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zp8z\" (UniqueName: \"kubernetes.io/projected/ccaedbea-48b2-4134-bf45-04515c0c8446-kube-api-access-7zp8z\") pod \"test-curl-7579-140040550037808\" (UID: \"ccaedbea-48b2-4134-bf45-04515c0c8446\") " pod="opendatahub/test-curl-7579-140040550037808"
Jul 16 18:18:29.264975 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.264940    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zp8z\" (UniqueName: \"kubernetes.io/projected/ccaedbea-48b2-4134-bf45-04515c0c8446-kube-api-access-7zp8z\") pod \"test-curl-7579-140040550037808\" (UID: \"ccaedbea-48b2-4134-bf45-04515c0c8446\") " pod="opendatahub/test-curl-7579-140040550037808"
Jul 16 18:18:29.335761 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.335672    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140040550037808"
Jul 16 18:18:29.475906 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.475877    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140040550037808"]
Jul 16 18:18:29.477794 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:18:29.477763    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccaedbea_48b2_4134_bf45_04515c0c8446.slice/crio-f7638e5b04f2147442f1e106d1935b7b63d0efa1d31823770ded8ad12e4f9633 WatchSource:0}: Error finding container f7638e5b04f2147442f1e106d1935b7b63d0efa1d31823770ded8ad12e4f9633: Status 404 returned error can't find the container with id f7638e5b04f2147442f1e106d1935b7b63d0efa1d31823770ded8ad12e4f9633
Jul 16 18:18:29.479350 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.479334    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 18:18:29.895703 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:29.895665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140040550037808" event={"ID":"ccaedbea-48b2-4134-bf45-04515c0c8446","Type":"ContainerStarted","Data":"f7638e5b04f2147442f1e106d1935b7b63d0efa1d31823770ded8ad12e4f9633"}
Jul 16 18:18:30.902084 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:30.902020    2580 generic.go:356] "Generic (PLEG): container finished" podID="ccaedbea-48b2-4134-bf45-04515c0c8446" containerID="e65ea464c91590f0a1aa5996022e68722bf6b9bc0d5e6957d1b38759856cf2ad" exitCode=0
Jul 16 18:18:30.902084 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:30.902068    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140040550037808" event={"ID":"ccaedbea-48b2-4134-bf45-04515c0c8446","Type":"ContainerDied","Data":"e65ea464c91590f0a1aa5996022e68722bf6b9bc0d5e6957d1b38759856cf2ad"}
Jul 16 18:18:32.045203 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.045171    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140040550037808"
Jul 16 18:18:32.073029 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.072992    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7579-140040550037808_ccaedbea-48b2-4134-bf45-04515c0c8446/test-curl-7579-140040550037808/0.log"
Jul 16 18:18:32.102972 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.102934    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7579-140040550037808"]
Jul 16 18:18:32.108031 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.108005    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7579-140040550037808"]
Jul 16 18:18:32.185703 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.185619    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zp8z\" (UniqueName: \"kubernetes.io/projected/ccaedbea-48b2-4134-bf45-04515c0c8446-kube-api-access-7zp8z\") pod \"ccaedbea-48b2-4134-bf45-04515c0c8446\" (UID: \"ccaedbea-48b2-4134-bf45-04515c0c8446\") "
Jul 16 18:18:32.187752 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.187713    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccaedbea-48b2-4134-bf45-04515c0c8446-kube-api-access-7zp8z" (OuterVolumeSpecName: "kube-api-access-7zp8z") pod "ccaedbea-48b2-4134-bf45-04515c0c8446" (UID: "ccaedbea-48b2-4134-bf45-04515c0c8446"). InnerVolumeSpecName "kube-api-access-7zp8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:18:32.287124 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.287087    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zp8z\" (UniqueName: \"kubernetes.io/projected/ccaedbea-48b2-4134-bf45-04515c0c8446-kube-api-access-7zp8z\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:32.310994 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.310957    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj"]
Jul 16 18:18:32.311408 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.311395    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccaedbea-48b2-4134-bf45-04515c0c8446" containerName="test-curl-7579-140040550037808"
Jul 16 18:18:32.311466 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.311410    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccaedbea-48b2-4134-bf45-04515c0c8446" containerName="test-curl-7579-140040550037808"
Jul 16 18:18:32.311504 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.311491    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccaedbea-48b2-4134-bf45-04515c0c8446" containerName="test-curl-7579-140040550037808"
Jul 16 18:18:32.314590 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.314565    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj"
Jul 16 18:18:32.317644 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.317622    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 18:18:32.324590 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.324563    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj"]
Jul 16 18:18:32.387855 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.387817    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d88654dc-1582-4141-8b23-90a494627127-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj\" (UID: \"d88654dc-1582-4141-8b23-90a494627127\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj"
Jul 16 18:18:32.489042 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.489005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d88654dc-1582-4141-8b23-90a494627127-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj\" (UID: \"d88654dc-1582-4141-8b23-90a494627127\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj"
Jul 16 18:18:32.489636 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.489615    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d88654dc-1582-4141-8b23-90a494627127-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj\" (UID: \"d88654dc-1582-4141-8b23-90a494627127\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj"
Jul 16 18:18:32.626357 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.626320    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj"
Jul 16 18:18:32.774658 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.774633    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj"]
Jul 16 18:18:32.776833 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:18:32.776804    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd88654dc_1582_4141_8b23_90a494627127.slice/crio-1e6b57c71e0ba7355897f1b6d4a29802cc556d0cebbe58caae4bb1ebfd383720 WatchSource:0}: Error finding container 1e6b57c71e0ba7355897f1b6d4a29802cc556d0cebbe58caae4bb1ebfd383720: Status 404 returned error can't find the container with id 1e6b57c71e0ba7355897f1b6d4a29802cc556d0cebbe58caae4bb1ebfd383720
Jul 16 18:18:32.913570 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.913530    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj" event={"ID":"d88654dc-1582-4141-8b23-90a494627127","Type":"ContainerStarted","Data":"1e6b57c71e0ba7355897f1b6d4a29802cc556d0cebbe58caae4bb1ebfd383720"}
Jul 16 18:18:32.914710 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.914695    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7638e5b04f2147442f1e106d1935b7b63d0efa1d31823770ded8ad12e4f9633"
Jul 16 18:18:32.914784 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:32.914711    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140040550037808"
Jul 16 18:18:32.925004 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:18:32.924974    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7579-140040550037808\" is forbidden: User \"system:node:ip-10-0-130-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-51.ec2.internal' and this object" podUID="ccaedbea-48b2-4134-bf45-04515c0c8446" pod="opendatahub/test-curl-7579-140040550037808"
Jul 16 18:18:33.921584 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:33.921499    2580 generic.go:356] "Generic (PLEG): container finished" podID="d88654dc-1582-4141-8b23-90a494627127" containerID="4f97aec26ec36177ab43ef0553226992cb1d8433a02a02cf4b42a2358de7a450" exitCode=0
Jul 16 18:18:33.921927 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:33.921594    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj" event={"ID":"d88654dc-1582-4141-8b23-90a494627127","Type":"ContainerDied","Data":"4f97aec26ec36177ab43ef0553226992cb1d8433a02a02cf4b42a2358de7a450"}
Jul 16 18:18:33.924138 ip-10-0-130-51 kubenswrapper[2580]: E0716 18:18:33.924108    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7579-140040550037808\" is forbidden: User \"system:node:ip-10-0-130-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-51.ec2.internal' and this object" podUID="ccaedbea-48b2-4134-bf45-04515c0c8446" pod="opendatahub/test-curl-7579-140040550037808"
Jul 16 18:18:33.966830 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:33.966795    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccaedbea-48b2-4134-bf45-04515c0c8446" path="/var/lib/kubelet/pods/ccaedbea-48b2-4134-bf45-04515c0c8446/volumes"
Jul 16 18:18:35.059554 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:35.059529    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj"
Jul 16 18:18:35.216182 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:35.216153    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d88654dc-1582-4141-8b23-90a494627127-maas-api-service-ca\") pod \"d88654dc-1582-4141-8b23-90a494627127\" (UID: \"d88654dc-1582-4141-8b23-90a494627127\") "
Jul 16 18:18:35.216559 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:35.216538    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d88654dc-1582-4141-8b23-90a494627127-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d88654dc-1582-4141-8b23-90a494627127" (UID: "d88654dc-1582-4141-8b23-90a494627127"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:18:35.317880 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:35.317842    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d88654dc-1582-4141-8b23-90a494627127-maas-api-service-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:35.932688 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:35.932657    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj" event={"ID":"d88654dc-1582-4141-8b23-90a494627127","Type":"ContainerDied","Data":"1e6b57c71e0ba7355897f1b6d4a29802cc556d0cebbe58caae4bb1ebfd383720"}
Jul 16 18:18:35.932845 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:35.932693    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj"
Jul 16 18:18:35.932845 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:35.932704    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e6b57c71e0ba7355897f1b6d4a29802cc556d0cebbe58caae4bb1ebfd383720"
Jul 16 18:18:42.403781 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:42.403744    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:42.416113 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:42.416083    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m"]
Jul 16 18:18:42.421142 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:42.421115    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7c2a35-29737095-fn57m"]
Jul 16 18:18:43.966239 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:43.966140    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9caadcfd-abd5-4a0c-a68c-75c8c593efde" path="/var/lib/kubelet/pods/9caadcfd-abd5-4a0c-a68c-75c8c593efde/volumes"
Jul 16 18:18:47.546222 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:47.546188    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:47.938681 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:47.938580    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:54.913566 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:54.913527    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:55.013801 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.013749    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:55.228679 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.228631    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:55.460782 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.460747    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:55.567114 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.567012    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd"]
Jul 16 18:18:55.567541 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.567523    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d88654dc-1582-4141-8b23-90a494627127" containerName="revoke-keys"
Jul 16 18:18:55.567541 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.567541    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88654dc-1582-4141-8b23-90a494627127" containerName="revoke-keys"
Jul 16 18:18:55.567677 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.567600    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d88654dc-1582-4141-8b23-90a494627127" containerName="revoke-keys"
Jul 16 18:18:55.570742 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.570718    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd"
Jul 16 18:18:55.573746 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.573728    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 18:18:55.581404 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.581375    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd"]
Jul 16 18:18:55.618859 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.618822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f917d5-d46a-4178-9678-c15c0e2166c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd\" (UID: \"b8f917d5-d46a-4178-9678-c15c0e2166c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd"
Jul 16 18:18:55.720336 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.720296    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f917d5-d46a-4178-9678-c15c0e2166c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd\" (UID: \"b8f917d5-d46a-4178-9678-c15c0e2166c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd"
Jul 16 18:18:55.721071 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.721023    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f917d5-d46a-4178-9678-c15c0e2166c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd\" (UID: \"b8f917d5-d46a-4178-9678-c15c0e2166c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd"
Jul 16 18:18:55.883941 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:55.883852    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd"
Jul 16 18:18:56.026657 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:56.026633    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd"]
Jul 16 18:18:56.028719 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:18:56.028684    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f917d5_d46a_4178_9678_c15c0e2166c4.slice/crio-e7e12e0c737f8fb82dad5020d7df6f9e62d5214a0b8bd188941f5b5e450faa5d WatchSource:0}: Error finding container e7e12e0c737f8fb82dad5020d7df6f9e62d5214a0b8bd188941f5b5e450faa5d: Status 404 returned error can't find the container with id e7e12e0c737f8fb82dad5020d7df6f9e62d5214a0b8bd188941f5b5e450faa5d
Jul 16 18:18:56.037197 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:56.037169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd" event={"ID":"b8f917d5-d46a-4178-9678-c15c0e2166c4","Type":"ContainerStarted","Data":"e7e12e0c737f8fb82dad5020d7df6f9e62d5214a0b8bd188941f5b5e450faa5d"}
Jul 16 18:18:57.043922 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:57.043884    2580 generic.go:356] "Generic (PLEG): container finished" podID="b8f917d5-d46a-4178-9678-c15c0e2166c4" containerID="384f25f301375dce747a41db89026709bb73c31b4cf8fe614a862d1cd2fc4534" exitCode=0
Jul 16 18:18:57.044320 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:57.043969    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd" event={"ID":"b8f917d5-d46a-4178-9678-c15c0e2166c4","Type":"ContainerDied","Data":"384f25f301375dce747a41db89026709bb73c31b4cf8fe614a862d1cd2fc4534"}
Jul 16 18:18:58.198297 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:58.198260    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd"
Jul 16 18:18:58.245352 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:58.245313    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f917d5-d46a-4178-9678-c15c0e2166c4-maas-api-service-ca\") pod \"b8f917d5-d46a-4178-9678-c15c0e2166c4\" (UID: \"b8f917d5-d46a-4178-9678-c15c0e2166c4\") "
Jul 16 18:18:58.245859 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:58.245814    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8f917d5-d46a-4178-9678-c15c0e2166c4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b8f917d5-d46a-4178-9678-c15c0e2166c4" (UID: "b8f917d5-d46a-4178-9678-c15c0e2166c4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:18:58.246247 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:58.246221    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f917d5-d46a-4178-9678-c15c0e2166c4-maas-api-service-ca\") on node \"ip-10-0-130-51.ec2.internal\" DevicePath \"\""
Jul 16 18:18:59.056371 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:59.056341    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd"
Jul 16 18:18:59.056371 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:59.056352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd" event={"ID":"b8f917d5-d46a-4178-9678-c15c0e2166c4","Type":"ContainerDied","Data":"e7e12e0c737f8fb82dad5020d7df6f9e62d5214a0b8bd188941f5b5e450faa5d"}
Jul 16 18:18:59.056578 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:18:59.056405    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7e12e0c737f8fb82dad5020d7df6f9e62d5214a0b8bd188941f5b5e450faa5d"
Jul 16 18:19:05.709631 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:05.709560    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:19:10.836327 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:10.836293    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:19:11.240560 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:11.240526    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:19:18.308107 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:18.308066    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:19:18.408578 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:18.408540    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:19:18.610734 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:18.610645    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:19:18.858282 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:18.858240    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:19:22.114238 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:22.114213    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 18:19:22.124442 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:22.124421    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vp5p_a062b146-a0ad-447c-a839-9f44cb8d4c42/ovn-acl-logging/0.log"
Jul 16 18:19:25.273362 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:25.273329    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b9cdc9cfb-rhhvv_2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e/manager/0.log"
Jul 16 18:19:25.667056 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:25.666962    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-586f4b4fcb-bfr5c_894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd/copy-manifests/0.log"
Jul 16 18:19:25.681220 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:25.681195    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-586f4b4fcb-bfr5c_894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd/manager/0.log"
Jul 16 18:19:26.488942 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:26.488912    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29737065-l7wb8_6289e5ac-7aed-47aa-92c9-89660aed6e64/cleanup/0.log"
Jul 16 18:19:27.059991 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:27.059956    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-0baa98-m272b_b49c7609-da5d-4e90-857e-91499a128aa1/revoke-keys/0.log"
Jul 16 18:19:27.185917 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:27.185885    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-3f3f96-mqsk9_a4961839-e536-4536-a0ad-f3a7b4fa3253/revoke-keys/0.log"
Jul 16 18:19:27.542479 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:27.542452    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-36c084-ccgml_45bff916-7bbb-431e-9bde-ae3fcaaef04e/revoke-keys/0.log"
Jul 16 18:19:28.004128 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:28.004097    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-7c2a35-4cmqj_d88654dc-1582-4141-8b23-90a494627127/revoke-keys/0.log"
Jul 16 18:19:28.124483 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:28.124449    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-d3e547-lxsbd_b8f917d5-d46a-4178-9678-c15c0e2166c4/revoke-keys/0.log"
Jul 16 18:19:28.244858 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:28.244826    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-cfg49_7c3e96c1-1bda-441a-ad8c-50dfd44c93f3/postgres/0.log"
Jul 16 18:19:30.006740 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:30.006710    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9vczq_323e9254-61a5-4cf1-8cae-50a86b329b57/kuadrant-console-plugin/0.log"
Jul 16 18:19:31.263214 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:31.263182    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8cccc594-jsjr7_40b366b5-5079-4d86-91fc-eb2d0c3569dc/kube-auth-proxy/0.log"
Jul 16 18:19:31.510017 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:31.509988    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fk4hx_7a8d5018-7fb2-46ba-8638-e0a330471f06/payload-pre-processing/0.log"
Jul 16 18:19:32.112232 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:32.112186    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-86nf6_08459113-f863-433a-a89e-2df36bcc31d9/main/0.log"
Jul 16 18:19:32.352622 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:32.352571    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6vxgl_a79eda6a-902d-4034-8ad1-3160a9af15e2/main/0.log"
Jul 16 18:19:32.587521 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:32.587489    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-pt7gd_dd4060ca-643e-4c2c-a1d5-b31aa0c705b7/main/0.log"
Jul 16 18:19:37.191909 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:37.191874    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:19:37.885677 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:37.885643    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:19:37.983014 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:37.982970    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log" limit=1024
Jul 16 18:19:40.804567 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:40.804530    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c87pm_fe08b052-aad8-4578-a744-1fe793b72104/global-pull-secret-syncer/0.log"
Jul 16 18:19:40.960809 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:40.960770    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ct2x7_d5e39da5-fd84-4344-9e96-4403eab6cd5a/konnectivity-agent/0.log"
Jul 16 18:19:41.072191 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:41.072098    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-51.ec2.internal_cd686faea4db8ace4f851a7d64c4f3c7/haproxy/0.log"
Jul 16 18:19:46.516092 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:46.516063    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9vczq_323e9254-61a5-4cf1-8cae-50a86b329b57/kuadrant-console-plugin/0.log"
Jul 16 18:19:48.509252 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.509225    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce7a84dc-48b3-4ed9-9d87-453ac8704426/alertmanager/0.log"
Jul 16 18:19:48.553980 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.553947    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce7a84dc-48b3-4ed9-9d87-453ac8704426/config-reloader/0.log"
Jul 16 18:19:48.590201 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.590180    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce7a84dc-48b3-4ed9-9d87-453ac8704426/kube-rbac-proxy-web/0.log"
Jul 16 18:19:48.627568 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.627537    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce7a84dc-48b3-4ed9-9d87-453ac8704426/kube-rbac-proxy/0.log"
Jul 16 18:19:48.660486 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.660444    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce7a84dc-48b3-4ed9-9d87-453ac8704426/kube-rbac-proxy-metric/0.log"
Jul 16 18:19:48.693172 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.693146    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce7a84dc-48b3-4ed9-9d87-453ac8704426/prom-label-proxy/0.log"
Jul 16 18:19:48.721831 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.721809    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce7a84dc-48b3-4ed9-9d87-453ac8704426/init-config-reloader/0.log"
Jul 16 18:19:48.810076 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.809951    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-lz5vb_390538f6-fe92-4a30-b1e2-d818ff7884d0/kube-state-metrics/0.log"
Jul 16 18:19:48.839303 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.839280    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-lz5vb_390538f6-fe92-4a30-b1e2-d818ff7884d0/kube-rbac-proxy-main/0.log"
Jul 16 18:19:48.863539 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.863485    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-lz5vb_390538f6-fe92-4a30-b1e2-d818ff7884d0/kube-rbac-proxy-self/0.log"
Jul 16 18:19:48.893880 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.893851    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-fcd8445f5-w945z_c93d6fdd-8adb-46f7-a131-92deb2f5e01b/metrics-server/0.log"
Jul 16 18:19:48.922148 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.922122    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-fd2v9_a5f3c3f9-27b1-47b6-b10d-f5e0712993e3/monitoring-plugin/0.log"
Jul 16 18:19:48.954307 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.954284    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kk8c_ea4e2002-477a-48b0-849b-dc3e5ae44c5d/node-exporter/0.log"
Jul 16 18:19:48.984272 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:48.984238    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kk8c_ea4e2002-477a-48b0-849b-dc3e5ae44c5d/kube-rbac-proxy/0.log"
Jul 16 18:19:49.010883 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.010860    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kk8c_ea4e2002-477a-48b0-849b-dc3e5ae44c5d/init-textfile/0.log"
Jul 16 18:19:49.221915 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.221890    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-nrtn6_73efadef-775a-473c-a521-ba10783dbdc6/kube-rbac-proxy-main/0.log"
Jul 16 18:19:49.257263 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.257235    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-nrtn6_73efadef-775a-473c-a521-ba10783dbdc6/kube-rbac-proxy-self/0.log"
Jul 16 18:19:49.282541 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.282514    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-nrtn6_73efadef-775a-473c-a521-ba10783dbdc6/openshift-state-metrics/0.log"
Jul 16 18:19:49.324960 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.324927    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bebe43e9-8097-4f2d-bc0e-2ee733d47fe7/prometheus/0.log"
Jul 16 18:19:49.353467 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.353444    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bebe43e9-8097-4f2d-bc0e-2ee733d47fe7/config-reloader/0.log"
Jul 16 18:19:49.380164 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.380134    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bebe43e9-8097-4f2d-bc0e-2ee733d47fe7/thanos-sidecar/0.log"
Jul 16 18:19:49.409164 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.409142    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bebe43e9-8097-4f2d-bc0e-2ee733d47fe7/kube-rbac-proxy-web/0.log"
Jul 16 18:19:49.436890 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.436868    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bebe43e9-8097-4f2d-bc0e-2ee733d47fe7/kube-rbac-proxy/0.log"
Jul 16 18:19:49.466817 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.466789    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bebe43e9-8097-4f2d-bc0e-2ee733d47fe7/kube-rbac-proxy-thanos/0.log"
Jul 16 18:19:49.494355 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.494283    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bebe43e9-8097-4f2d-bc0e-2ee733d47fe7/init-config-reloader/0.log"
Jul 16 18:19:49.527644 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.527623    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-85ds8_842057ff-84b5-463b-b822-50ca75005195/prometheus-operator/0.log"
Jul 16 18:19:49.553715 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.553683    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-85ds8_842057ff-84b5-463b-b822-50ca75005195/kube-rbac-proxy/0.log"
Jul 16 18:19:49.582985 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.582959    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-pqw6z_f2aabc54-4085-422c-80d6-a2d4766e7e6c/prometheus-operator-admission-webhook/0.log"
Jul 16 18:19:49.616373 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.616342    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7775cf54d8-tfccf_2b1da8fe-1ec6-4327-92ee-b6f6d7367837/telemeter-client/0.log"
Jul 16 18:19:49.642216 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.642193    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7775cf54d8-tfccf_2b1da8fe-1ec6-4327-92ee-b6f6d7367837/reload/0.log"
Jul 16 18:19:49.670514 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.670490    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7775cf54d8-tfccf_2b1da8fe-1ec6-4327-92ee-b6f6d7367837/kube-rbac-proxy/0.log"
Jul 16 18:19:49.710378 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.710350    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcbd4c656-jx5f6_6ed32354-7dda-4ac3-8624-6a316ef32b79/thanos-query/0.log"
Jul 16 18:19:49.740265 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.740238    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcbd4c656-jx5f6_6ed32354-7dda-4ac3-8624-6a316ef32b79/kube-rbac-proxy-web/0.log"
Jul 16 18:19:49.766578 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.766514    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcbd4c656-jx5f6_6ed32354-7dda-4ac3-8624-6a316ef32b79/kube-rbac-proxy/0.log"
Jul 16 18:19:49.795067 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.795030    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcbd4c656-jx5f6_6ed32354-7dda-4ac3-8624-6a316ef32b79/prom-label-proxy/0.log"
Jul 16 18:19:49.821807 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.821784    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcbd4c656-jx5f6_6ed32354-7dda-4ac3-8624-6a316ef32b79/kube-rbac-proxy-rules/0.log"
Jul 16 18:19:49.850965 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:49.850941    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dcbd4c656-jx5f6_6ed32354-7dda-4ac3-8624-6a316ef32b79/kube-rbac-proxy-metrics/0.log"
Jul 16 18:19:50.266614 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.266585    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"]
Jul 16 18:19:50.267027 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.267015    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8f917d5-d46a-4178-9678-c15c0e2166c4" containerName="revoke-keys"
Jul 16 18:19:50.267096 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.267029    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8f917d5-d46a-4178-9678-c15c0e2166c4" containerName="revoke-keys"
Jul 16 18:19:50.267132 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.267110    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8f917d5-d46a-4178-9678-c15c0e2166c4" containerName="revoke-keys"
Jul 16 18:19:50.269688 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.269663    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.272999 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.272862    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w8h8n\"/\"kube-root-ca.crt\""
Jul 16 18:19:50.272999 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.272920    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w8h8n\"/\"openshift-service-ca.crt\""
Jul 16 18:19:50.273263 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.273015    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w8h8n\"/\"default-dockercfg-474ns\""
Jul 16 18:19:50.280021 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.279990    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"]
Jul 16 18:19:50.359391 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.359361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cef61c6-8438-4200-94f9-b3639dca4d23-sys\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.359571 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.359456    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cef61c6-8438-4200-94f9-b3639dca4d23-lib-modules\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.359571 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.359525    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cef61c6-8438-4200-94f9-b3639dca4d23-proc\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.359571 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.359557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cef61c6-8438-4200-94f9-b3639dca4d23-podres\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.359725 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.359686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqqs7\" (UniqueName: \"kubernetes.io/projected/8cef61c6-8438-4200-94f9-b3639dca4d23-kube-api-access-dqqs7\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.461190 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.461155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cef61c6-8438-4200-94f9-b3639dca4d23-sys\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.461371 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.461210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cef61c6-8438-4200-94f9-b3639dca4d23-lib-modules\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.461371 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.461264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cef61c6-8438-4200-94f9-b3639dca4d23-proc\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.461371 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.461285    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cef61c6-8438-4200-94f9-b3639dca4d23-sys\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.461371 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.461295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cef61c6-8438-4200-94f9-b3639dca4d23-podres\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.461371 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.461355    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cef61c6-8438-4200-94f9-b3639dca4d23-proc\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.461595 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.461384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqqs7\" (UniqueName: \"kubernetes.io/projected/8cef61c6-8438-4200-94f9-b3639dca4d23-kube-api-access-dqqs7\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.461595 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.461417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cef61c6-8438-4200-94f9-b3639dca4d23-podres\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.461595 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.461418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cef61c6-8438-4200-94f9-b3639dca4d23-lib-modules\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.471836 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.471812    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqqs7\" (UniqueName: \"kubernetes.io/projected/8cef61c6-8438-4200-94f9-b3639dca4d23-kube-api-access-dqqs7\") pod \"perf-node-gather-daemonset-q8pnx\" (UID: \"8cef61c6-8438-4200-94f9-b3639dca4d23\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.581322 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.581238    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:50.716612 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:50.716588    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"]
Jul 16 18:19:50.718472 ip-10-0-130-51 kubenswrapper[2580]: W0716 18:19:50.718441    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8cef61c6_8438_4200_94f9_b3639dca4d23.slice/crio-92eee214c13492ed4f4518adcb59b271002ee09a0587e2d68f548e96f8cdbb97 WatchSource:0}: Error finding container 92eee214c13492ed4f4518adcb59b271002ee09a0587e2d68f548e96f8cdbb97: Status 404 returned error can't find the container with id 92eee214c13492ed4f4518adcb59b271002ee09a0587e2d68f548e96f8cdbb97
Jul 16 18:19:51.332069 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:51.332020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx" event={"ID":"8cef61c6-8438-4200-94f9-b3639dca4d23","Type":"ContainerStarted","Data":"612b554ed14c7a54b86d3d8bccfe24d6e75c52bfaeb245442efcbd86d7e2d56c"}
Jul 16 18:19:51.332231 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:51.332083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx" event={"ID":"8cef61c6-8438-4200-94f9-b3639dca4d23","Type":"ContainerStarted","Data":"92eee214c13492ed4f4518adcb59b271002ee09a0587e2d68f548e96f8cdbb97"}
Jul 16 18:19:51.332231 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:51.332105    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:51.353169 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:51.353120    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx" podStartSLOduration=1.353105065 podStartE2EDuration="1.353105065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:19:51.351909139 +0000 UTC m=+3029.906966579" watchObservedRunningTime="2026-07-16 18:19:51.353105065 +0000 UTC m=+3029.908162501"
Jul 16 18:19:52.083880 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:52.083851    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-669ccf5889-t256d_ed7ce6ae-59c0-4835-85ca-43be813d2fa5/console/0.log"
Jul 16 18:19:53.832717 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:53.832686    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gpqtb_3743d9af-ba0c-486a-bde9-99913d98760a/dns/0.log"
Jul 16 18:19:53.857742 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:53.857714    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gpqtb_3743d9af-ba0c-486a-bde9-99913d98760a/kube-rbac-proxy/0.log"
Jul 16 18:19:54.084798 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:54.084719    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ssthj_6d988eda-40b2-4fbe-88e1-75a7b51aa3f5/dns-node-resolver/0.log"
Jul 16 18:19:54.727232 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:54.727200    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nmm97_3c2da323-e68f-47d8-9f40-606c77ad9f39/node-ca/0.log"
Jul 16 18:19:55.986842 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:55.986810    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8cccc594-jsjr7_40b366b5-5079-4d86-91fc-eb2d0c3569dc/kube-auth-proxy/0.log"
Jul 16 18:19:56.127548 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:56.127520    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fk4hx_7a8d5018-7fb2-46ba-8638-e0a330471f06/payload-pre-processing/0.log"
Jul 16 18:19:56.961819 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:56.961792    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zbhdt_f3b34739-58e1-4762-b3ed-794390a3eba5/serve-healthcheck-canary/0.log"
Jul 16 18:19:57.347321 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:57.347244    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-q8pnx"
Jul 16 18:19:57.512618 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:57.512591    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4wmm7_134df64e-da7d-4ca5-90f6-d1bd61d5b70c/kube-rbac-proxy/0.log"
Jul 16 18:19:57.542096 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:57.542068    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4wmm7_134df64e-da7d-4ca5-90f6-d1bd61d5b70c/exporter/0.log"
Jul 16 18:19:57.568604 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:19:57.568578    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4wmm7_134df64e-da7d-4ca5-90f6-d1bd61d5b70c/extractor/0.log"
Jul 16 18:20:00.456525 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:20:00.456488    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b9cdc9cfb-rhhvv_2f50d48f-b65f-4ff4-aaaa-6828e3c9fa2e/manager/0.log"
Jul 16 18:20:00.637828 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:20:00.637749    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-586f4b4fcb-bfr5c_894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd/manager/0.log"
Jul 16 18:20:00.667153 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:20:00.667111    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-586f4b4fcb-bfr5c_894e4d0d-a83b-44ac-8fc5-bbd0a2d32bfd/copy-manifests/0.log"
Jul 16 18:20:00.750227 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:20:00.750200    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8cccc594-jsjr7_40b366b5-5079-4d86-91fc-eb2d0c3569dc/kube-auth-proxy/0.log"
Jul 16 18:20:00.872300 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:20:00.872264    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fk4hx_7a8d5018-7fb2-46ba-8638-e0a330471f06/payload-pre-processing/0.log"
Jul 16 18:20:02.216636 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:20:02.216606    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55f946f648-llbwd_9ae99efd-1cc9-4b88-a0ea-8d1589e8cb87/manager/0.log"
Jul 16 18:20:02.473595 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:20:02.473515    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8cccc594-jsjr7_40b366b5-5079-4d86-91fc-eb2d0c3569dc/kube-auth-proxy/0.log"
Jul 16 18:20:02.579495 ip-10-0-130-51 kubenswrapper[2580]: I0716 18:20:02.579458    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fk4hx_7a8d5018-7fb2-46ba-8638-e0a330471f06/payload-pre-processing/0.log"