Jul 02 16:54:19.410790 ip-10-0-130-131 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.813161    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819579    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819594    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819598    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819602    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819605    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819608    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819611    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 16:54:19.950378 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819614    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819616    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819622    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819626    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819629    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819633    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819638    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819641    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819644    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819646    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819649    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819652    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819654    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819657    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819659    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819662    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819666    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819669    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819673    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819676    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 16:54:19.953870 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819678    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819682    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819686    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819689    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819692    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819694    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819697    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819700    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819702    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819705    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819708    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819710    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819713    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819715    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819718    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819720    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819722    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819726    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819729    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 16:54:19.954466 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819731    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819734    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819736    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819739    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819741    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819744    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819746    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819749    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819751    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819754    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819756    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819760    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819763    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819765    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819768    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819771    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819773    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819776    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819779    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819781    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819784    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 16:54:19.955345 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819786    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819788    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819791    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819794    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819797    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819799    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819802    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819804    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819807    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819809    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819811    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819814    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819816    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819819    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819821    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819826    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819829    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819831    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819834    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 16:54:19.958384 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819836    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819838    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819841    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819844    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819847    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819849    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819852    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819854    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819857    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819860    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819862    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819865    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.819867    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820643    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820652    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820655    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820658    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820661    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820666    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820669    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 16:54:19.960979 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820672    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820674    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820677    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820681    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820683    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820686    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820689    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820691    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820694    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820697    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820699    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820703    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820705    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820708    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820711    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820713    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820716    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820719    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820721    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 16:54:19.963128 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820724    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820726    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820729    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820731    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820734    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820736    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820739    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820741    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820744    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820747    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820750    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820752    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820757    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820760    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820763    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820766    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820770    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820772    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820775    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 16:54:19.963978 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820777    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820780    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820783    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820785    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820788    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820790    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820793    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820796    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820799    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820801    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820804    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820806    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820809    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820823    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820826    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820829    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820832    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820835    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820838    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820841    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820843    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 16:54:19.978787 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820846    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820849    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820852    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820855    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820858    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820862    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820865    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820869    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820873    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820876    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820878    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820881    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820885    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820887    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820890    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820892    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820895    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820899    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820902    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 16:54:19.979600 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820905    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820907    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820910    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820913    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820916    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820919    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820921    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820924    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820927    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820930    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820932    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820935    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820938    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.820941    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821432    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821439    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821442    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821445    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821469    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821475    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 16:54:19.981725 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821478    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821480    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821483    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821486    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821489    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821491    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821494    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821497    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821501    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821503    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821506    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821508    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821511    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821513    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821516    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821522    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821525    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821528    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821531    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821534    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 16:54:19.982560 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821537    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821540    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821542    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821545    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821547    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821550    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821553    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821555    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821558    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821561    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821563    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821572    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821575    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821577    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821579    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821582    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821585    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821588    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821590    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 16:54:19.984985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821593    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821595    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821598    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821600    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821603    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821605    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821608    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821611    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821615    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821617    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821620    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821622    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821624    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821627    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821629    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821632    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821634    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821637    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821639    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821642    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 16:54:19.985839 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821644    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821646    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821649    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821652    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821654    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821662    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821666    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821670    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821673    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821675    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821678    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821680    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821683    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821685    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821688    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821690    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821693    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821695    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821698    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 16:54:19.988840 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821700    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821704    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821708    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821710    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821713    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821716    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821718    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821721    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821723    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821727    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821730    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821733    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821736    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821739    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.821742    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821820    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821831    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821857    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821862    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821873    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 16:54:19.989726 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821877    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821882    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821886    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821890    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821893    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821896    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821900    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821903    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821906    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821909    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821912    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821915    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821917    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821925    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821929    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821932    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821935    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821939    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821942    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821946    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821950    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821953    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821956    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821959    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 16:54:19.993869 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821962    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821966    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821969    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821974    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821978    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821980    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821983    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821986    2579 flags.go:64] FLAG: --enable-server="true"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.821997    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822006    2579 flags.go:64] FLAG: --event-burst="100"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822009    2579 flags.go:64] FLAG: --event-qps="50"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822012    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822015    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822018    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822022    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822025    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822028    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822031    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822034    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822037    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822040    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822045    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822048    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822051    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822054    2579 flags.go:64] FLAG: --feature-gates=""
Jul 02 16:54:19.994695 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822062    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822065    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822068    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822071    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822074    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822077    2579 flags.go:64] FLAG: --help="false"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822080    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-130-131.ec2.internal"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822083    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822086    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822089    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822094    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822097    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822100    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822103    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822106    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822109    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822117    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822121    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822124    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822127    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822130    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822132    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822135    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822138    2579 flags.go:64] FLAG: --lock-file=""
Jul 02 16:54:19.998005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822141    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822144    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822147    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822152    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822156    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822159    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822162    2579 flags.go:64] FLAG: --logging-format="text"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822165    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822168    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822171    2579 flags.go:64] FLAG: --manifest-url=""
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822174    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822179    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822182    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822186    2579 flags.go:64] FLAG: --max-pods="110"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822189    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822192    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822195    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822198    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822205    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822208    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822211    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822218    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822221    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822224    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 16:54:19.999207 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822227    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822236    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822242    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822245    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822249    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822251    2579 flags.go:64] FLAG: --port="10250"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822254    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822257    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06839733d1f726a57"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822260    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822263    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822266    2579 flags.go:64] FLAG: --register-node="true"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822269    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822273    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822278    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822281    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822283    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822287    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822290    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822294    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822297    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822299    2579 flags.go:64] FLAG: --runonce="false"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822302    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822305    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822308    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822311    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 16:54:20.003735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822314    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 16:54:20.000655 ip-10-0-130-131 systemd[1]: Started Kubernetes Kubelet.
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822318    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822322    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822325    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822327    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822330    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822333    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822336    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822339    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822348    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822351    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822356    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822359    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822361    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822367    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822370    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822373    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822376    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822379    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822382    2579 flags.go:64] FLAG: --v="2"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822387    2579 flags.go:64] FLAG: --version="false"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822392    2579 flags.go:64] FLAG: --vmodule=""
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822395    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.822399    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822571    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 16:54:20.004865 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822576    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822579    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822581    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822584    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822587    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822589    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822592    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822595    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822598    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822601    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822604    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822607    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822609    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822612    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822614    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822617    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822619    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822628    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822630    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822633    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 16:54:20.107987 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822635    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822638    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822640    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822643    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822651    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822654    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822657    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822661    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822663    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822666    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822668    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822671    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822673    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822676    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822678    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822681    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822683    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822686    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822688    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822691    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 16:54:20.108767 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822695    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822698    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822700    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822703    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822705    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822708    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822710    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822713    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822715    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822718    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822727    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822730    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822733    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822737    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822741    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822743    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822747    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822749    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822751    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822755    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 16:54:20.112428 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822757    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822760    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822762    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822765    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822768    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822770    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822773    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822775    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822778    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822781    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822784    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822786    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822790    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822792    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822795    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822798    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822800    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822803    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822805    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822809    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 16:54:20.113262 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822813    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822816    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822819    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822827    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822830    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822832    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822835    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822838    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822840    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822842    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822845    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822849    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822851    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822854    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822857    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822860    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822863    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 16:54:20.116153 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.822866    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.823428    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.830394    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.830409    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.830430    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.830435    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830515    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830520    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830524    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830526    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830530    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830533    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830535    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830541    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830543    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 16:54:20.116975 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830547    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830549    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830552    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830555    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830558    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830560    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830564    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830567    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830569    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830572    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830574    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830577    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830579    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830582    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830584    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830587    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830589    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830592    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830599    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 16:54:20.120748 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830602    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830605    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830608    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830611    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830614    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830616    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830619    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830621    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830624    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830626    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830629    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830636    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830638    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830641    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830643    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830646    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830648    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830651    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830654    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830660    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 16:54:20.121602 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830662    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830665    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830668    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830670    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830673    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830675    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830678    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830681    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830683    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830686    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830688    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830690    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830693    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830696    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830698    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830701    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830704    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830707    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830710    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830714    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 16:54:20.125297 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830717    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830719    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830722    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830726    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830729    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830732    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830734    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830737    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830739    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830742    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830747    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830751    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830754    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830757    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830759    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830762    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830764    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830767    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830769    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830772    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 16:54:20.126130 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830774    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830777    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830779    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830782    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830784    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830787    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830789    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830793    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830795    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830798    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830800    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.830805    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830927    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830932    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830935    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 16:54:20.129434 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830939    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830942    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830945    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830948    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830952    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830955    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830957    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830960    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830964    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830967    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830970    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830972    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830975    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830977    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830980    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830982    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830986    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830989    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830991    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830994    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 16:54:20.130271 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830996    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.830999    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831001    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831004    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831007    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831009    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831012    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831014    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831017    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831019    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831022    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831024    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831028    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831031    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831033    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831035    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831038    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831041    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831043    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831046    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 16:54:20.133113 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831048    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831052    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831055    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831058    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831060    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831063    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831065    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831068    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831070    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831073    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831075    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831078    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831081    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831083    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831086    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831088    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831091    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831093    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831096    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831099    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 16:54:20.133923 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831101    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831104    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831106    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831109    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831114    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831117    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831120    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831122    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831126    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831130    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831133    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831136    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831138    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831142    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831145    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831148    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831150    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831153    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831156    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 16:54:20.138045 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831158    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831161    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831163    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831165    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831168    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831170    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831173    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831176    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831178    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831181    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831183    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831186    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831188    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831191    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831193    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831196    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 16:54:20.138875 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:19.831200    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 16:54:20.269432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.831206    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 16:54:20.269432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.831318    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 16:54:20.269432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.943138    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 16:54:20.269432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.944576    2579 server.go:1019] "Starting client certificate rotation"
Jul 02 16:54:20.269432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.944684    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 16:54:20.269432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.944721    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 16:54:20.269432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.946966    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 16:54:20.269432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.953019    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 16:54:20.269432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.962633    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 02 16:54:20.269432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.965697    2579 log.go:25] "Validated CRI v1 image API"
Jul 02 16:54:20.269432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.966610    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 16:54:20.269432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.970288    2579 fs.go:135] Filesystem UUIDs: map[70bfdd66-04d4-46f4-9a4f-0dcf1118b854:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8cb89c5a-5793-414b-81d5-7663fdf40f51:/dev/nvme0n1p4]
Jul 02 16:54:20.270247 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.970308    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 16:54:20.270678 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.976375    2579 manager.go:216] Machine: {Timestamp:2026-07-02 16:54:19.974910189 +0000 UTC m=+0.443209860 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3159260 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26b5216944c883042440731271c76e SystemUUID:ec26b521-6944-c883-0424-40731271c76e BootID:230c38d0-1261-4aa9-b380-80491bf57d61 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:67:e9:67:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:67:e9:67:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:6f:61:16:e2:a4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 16:54:20.270678 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.976541    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 16:54:20.270678 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.976645    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 16:54:20.270678 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.979822    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 16:54:20.270678 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.979861    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-131.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 16:54:20.270678 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.981273    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 16:54:20.270678 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.981287    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 16:54:20.270678 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.981297    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.982236    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.983038    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.985804    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.985963    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.986629    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.986645    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.986662    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.986676    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.986689    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.987128    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.987148    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.991073    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.991373    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.993178    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.993217    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.993806    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.993825    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.993834    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.993848    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.993860    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.993869    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.994162    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.994172    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.994182    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.994189    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.994201    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.994213    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.995841    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.995858    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 16:54:20.275299 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:19.999822    2579 server.go:1268] "Started kubelet"
Jul 02 16:54:21.639570 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.638780    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 16:54:21.639570 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.639161    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hdxtl"
Jul 02 16:54:21.639570 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.639179    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hdxtl"
Jul 02 16:54:21.639804 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.639541    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 16:54:21.639804 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.639628    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 16:54:21.642498 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.642280    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 16:54:21.644579 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.644557    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 16:54:21.644686 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.644579    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 16:54:21.644686 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.644618    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-131.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 16:54:21.644778 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.644714    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-131.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 16:54:21.645507 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.644555    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-131.ec2.internal.18be874b4ecb83fb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-131.ec2.internal,UID:ip-10-0-130-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-131.ec2.internal,},FirstTimestamp:2026-07-02 16:54:19.999552507 +0000 UTC m=+0.467852178,LastTimestamp:2026-07-02 16:54:19.999552507 +0000 UTC m=+0.467852178,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-131.ec2.internal,}"
Jul 02 16:54:21.645607 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.645585    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 16:54:21.647791 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.647777    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 16:54:21.647853 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.647788    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 16:54:21.647910 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.647898    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 02 16:54:21.648486 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.648462    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 16:54:21.648486 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.648469    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 16:54:21.648653 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.648504    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 16:54:21.648653 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.648642    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 16:54:21.648653 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.648650    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 16:54:21.648958 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.648934    2579 factory.go:153] Registering CRI-O factory
Jul 02 16:54:21.648958 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.648952    2579 factory.go:223] Registration of the crio container factory successfully
Jul 02 16:54:21.649060 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.649047    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 16:54:21.649060 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.649058    2579 factory.go:55] Registering systemd factory
Jul 02 16:54:21.649177 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.649067    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 02 16:54:21.649177 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.649113    2579 factory.go:103] Registering Raw factory
Jul 02 16:54:21.649177 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.649135    2579 manager.go:1196] Started watching for new ooms in manager
Jul 02 16:54:21.649539 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.649519    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 16:54:21.649613 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.649582    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-131.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 16:54:21.649753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.649740    2579 manager.go:349] Starting recovery of all containers
Jul 02 16:54:21.658764 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.658745    2579 manager.go:354] Recovery completed
Jul 02 16:54:21.662826 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.662808    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 16:54:21.664788 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.664770    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 16:54:21.664854 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.664800    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 16:54:21.664854 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.664812    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 02 16:54:21.665390 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.665378    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 16:54:21.665390 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.665390    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 16:54:21.665501 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.665409    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 16:54:21.665501 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.665392    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 16:54:21.666051 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.666036    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 16:54:21.666129 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.666062    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 16:54:21.666129 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.666071    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 02 16:54:21.666622 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.666611    2579 policy_none.go:49] "None policy: Start"
Jul 02 16:54:21.666653 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.666627    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 16:54:21.666653 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.666637    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 16:54:21.667657 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.667646    2579 policy_none.go:47] "Start"
Jul 02 16:54:21.703835 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.703689    2579 manager.go:337] "Starting Device Plugin manager"
Jul 02 16:54:21.712230 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.703852    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 16:54:21.712230 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.703862    2579 server.go:87] "Starting device plugin registration server"
Jul 02 16:54:21.712230 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.704112    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 16:54:21.712230 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.704123    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 16:54:21.712230 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.704222    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 16:54:21.712230 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.704302    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 16:54:21.712230 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.704312    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 16:54:21.712230 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.704775    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 16:54:21.712230 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.704821    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 02 16:54:21.712972 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.712947    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 16:54:21.714244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.714228    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 16:54:21.714291 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.714275    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 16:54:21.714326 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.714300    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 16:54:21.714374 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.714339    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 16:54:21.716316 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.716297    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 16:54:21.804548 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.804511    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 16:54:21.805561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.805541    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 16:54:21.805561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.805572    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 16:54:21.805744 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.805583    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 02 16:54:21.805744 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.805607    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-131.ec2.internal"
Jul 02 16:54:21.815007 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.814985    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-131.ec2.internal"
Jul 02 16:54:21.815007 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.815011    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-131.ec2.internal\": node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 02 16:54:21.815202 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.815069    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"]
Jul 02 16:54:21.815202 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.815155    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 16:54:21.816028 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.816014    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 16:54:21.816111 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.816041    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 16:54:21.816111 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.816051    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 02 16:54:21.817264 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.817251    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 16:54:21.817402 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.817390    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:21.817439 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.817421    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 16:54:21.817979 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.817961    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 16:54:21.818072 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.817987    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 16:54:21.818072 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.818013    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 16:54:21.818072 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.817992    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 16:54:21.818072 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.818037    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 02 16:54:21.818072 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.818024    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 02 16:54:21.819229 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.819212    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:21.819317 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.819241    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 16:54:21.819947 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.819933    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 16:54:21.820027 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.819960    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 16:54:21.820027 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.819976    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeHasSufficientPID"
Jul 02 16:54:21.832696 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.832675    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-131.ec2.internal\" not found" node="ip-10-0-130-131.ec2.internal"
Jul 02 16:54:21.836072 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.836058    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-131.ec2.internal\" not found" node="ip-10-0-130-131.ec2.internal"
Jul 02 16:54:21.838364 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.838339    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 02 16:54:21.938568 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:21.938474    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 02 16:54:21.949819 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.949796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ef2143623978894d796b13886d639f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal\" (UID: \"5ef2143623978894d796b13886d639f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:21.949902 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.949828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ef2143623978894d796b13886d639f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal\" (UID: \"5ef2143623978894d796b13886d639f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:21.949902 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:21.949849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/084c7305d4c2b79de5997d13e2dcbb4a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-131.ec2.internal\" (UID: \"084c7305d4c2b79de5997d13e2dcbb4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:22.039196 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:22.039158    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 02 16:54:22.045303 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.045288    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 16:54:22.045449 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.045432    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 16:54:22.050639 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.050623    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ef2143623978894d796b13886d639f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal\" (UID: \"5ef2143623978894d796b13886d639f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:22.050685 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.050648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ef2143623978894d796b13886d639f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal\" (UID: \"5ef2143623978894d796b13886d639f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:22.050685 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.050666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/084c7305d4c2b79de5997d13e2dcbb4a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-131.ec2.internal\" (UID: \"084c7305d4c2b79de5997d13e2dcbb4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:22.050747 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.050725    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/084c7305d4c2b79de5997d13e2dcbb4a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-131.ec2.internal\" (UID: \"084c7305d4c2b79de5997d13e2dcbb4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:22.050778 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.050756    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ef2143623978894d796b13886d639f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal\" (UID: \"5ef2143623978894d796b13886d639f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:22.050778 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.050725    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ef2143623978894d796b13886d639f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal\" (UID: \"5ef2143623978894d796b13886d639f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:22.136023 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.135978    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:22.139537 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:22.139236    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 02 16:54:22.140359 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.140339    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:22.239987 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:22.239902    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 02 16:54:22.340522 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:22.340489    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 02 16:54:22.440971 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:22.440940    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 02 16:54:22.475283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.475256    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 16:54:22.541479 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:22.541442    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 02 16:54:22.634930 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:22.634891    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod084c7305d4c2b79de5997d13e2dcbb4a.slice/crio-2cdb686eb2a2824e1d9a8a0075d0afc71b743345c0f00fddbf4f4d87194f373f WatchSource:0}: Error finding container 2cdb686eb2a2824e1d9a8a0075d0afc71b743345c0f00fddbf4f4d87194f373f: Status 404 returned error can't find the container with id 2cdb686eb2a2824e1d9a8a0075d0afc71b743345c0f00fddbf4f4d87194f373f
Jul 02 16:54:22.635172 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:22.635152    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef2143623978894d796b13886d639f6.slice/crio-32edb9d968e8cab445a42cd2a2a1feb29b6856e116170302c6ac3ce7455866e1 WatchSource:0}: Error finding container 32edb9d968e8cab445a42cd2a2a1feb29b6856e116170302c6ac3ce7455866e1: Status 404 returned error can't find the container with id 32edb9d968e8cab445a42cd2a2a1feb29b6856e116170302c6ac3ce7455866e1
Jul 02 16:54:22.640870 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.640854    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 16:54:22.642545 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:22.642527    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 02 16:54:22.644647 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.644611    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 16:49:21 +0000 UTC" deadline="2028-01-06 21:36:20.979857322 +0000 UTC"
Jul 02 16:54:22.644647 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.644644    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13276h41m58.335217119s"
Jul 02 16:54:22.717592 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.717542    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal" event={"ID":"5ef2143623978894d796b13886d639f6","Type":"ContainerStarted","Data":"32edb9d968e8cab445a42cd2a2a1feb29b6856e116170302c6ac3ce7455866e1"}
Jul 02 16:54:22.718494 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.718469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal" event={"ID":"084c7305d4c2b79de5997d13e2dcbb4a","Type":"ContainerStarted","Data":"2cdb686eb2a2824e1d9a8a0075d0afc71b743345c0f00fddbf4f4d87194f373f"}
Jul 02 16:54:22.743657 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:22.743631    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-131.ec2.internal\" not found"
Jul 02 16:54:22.817610 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.817534    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 16:54:22.848477 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.848455    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:22.856035 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.856013    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 16:54:22.856974 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.856961    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal"
Jul 02 16:54:22.868173 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:22.868153    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 16:54:23.091928 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.091841    2579 apiserver.go:52] "Watching apiserver"
Jul 02 16:54:23.100098 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.100069    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 16:54:23.100466 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.100448    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 16:54:23.100841 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.100807    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-czp4h","kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal","openshift-multus/network-metrics-daemon-zc26l","openshift-network-diagnostics/network-check-target-nqwj6","openshift-network-operator/iptables-alerter-vhb2t","openshift-ovn-kubernetes/ovnkube-node-jt4sh","kube-system/global-pull-secret-syncer-swtkc","openshift-cluster-node-tuning-operator/tuned-lghtl","openshift-dns/node-resolver-dx4cb","openshift-image-registry/node-ca-p5xzd","openshift-multus/multus-additional-cni-plugins-4s9sr","openshift-multus/multus-xlwgd"]
Jul 02 16:54:23.102406 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.102387    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:23.102507 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.102467    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:23.103470 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.103454    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p5xzd"
Jul 02 16:54:23.104578 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.104555    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.105947 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.105696    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dx4cb"
Jul 02 16:54:23.105947 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.105754    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 16:54:23.105947 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.105843    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hr462\""
Jul 02 16:54:23.105947 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.105844    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 16:54:23.106246 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.105979    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 16:54:23.106700 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.106681    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 16:54:23.107022 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.107003    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 16:54:23.107177 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.107027    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 16:54:23.107302 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.107286    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vhb2t"
Jul 02 16:54:23.107571 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.107287    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d6c48\""
Jul 02 16:54:23.107984 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.107967    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 16:54:23.107984 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.107974    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k6jgw\""
Jul 02 16:54:23.108176 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.108032    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 16:54:23.108515 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.108430    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:23.108515 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.108505    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:23.109783 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.109764    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-czp4h"
Jul 02 16:54:23.109884 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.109781    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 16:54:23.109988 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.109948    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 16:54:23.110073 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.110001    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 16:54:23.110254 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.110232    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9bjq9\""
Jul 02 16:54:23.111196 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.111174    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.111962 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.111944    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 16:54:23.112461 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.112260    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 16:54:23.112461 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.112295    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p8lwb\""
Jul 02 16:54:23.112601 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.112488    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:23.112601 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.112546    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:23.113426 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.113409    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 16:54:23.113619 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.113602    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 16:54:23.113854 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.113835    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 16:54:23.113938 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.113868    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 16:54:23.114433 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.114414    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.115128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.115109    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 16:54:23.115228 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.115162    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kqzbr\""
Jul 02 16:54:23.115303 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.115230    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 16:54:23.116575 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.116550    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.117204 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.117184    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 16:54:23.117204 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.117198    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 16:54:23.117336 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.117208    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mqr9x\""
Jul 02 16:54:23.118015 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.117995    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.118866 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.118850    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 16:54:23.119027 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.118856    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 16:54:23.119441 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.119415    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 16:54:23.120105 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.120074    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 16:54:23.120182 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.120104    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pqpd2\""
Jul 02 16:54:23.120182 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.120125    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 16:54:23.120791 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.120767    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 16:54:23.120955 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.120771    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jh742\""
Jul 02 16:54:23.150385 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.150354    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 16:54:23.157731 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.157705    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-etc-openvswitch\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.157851 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.157742    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:23.157851 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.157775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc4b2698-9de5-4fee-abb7-620ed1d69cba-konnectivity-ca\") pod \"konnectivity-agent-czp4h\" (UID: \"cc4b2698-9de5-4fee-abb7-620ed1d69cba\") " pod="kube-system/konnectivity-agent-czp4h"
Jul 02 16:54:23.157851 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.157822    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-system-cni-dir\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.158009 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.157862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a39e3b2-5ae8-437f-8122-d0247088e55a-multus-daemon-config\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.158009 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.157892    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8a5c633-0484-4c8b-848e-ff55b708f1f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.158009 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.157920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45t8v\" (UniqueName: \"kubernetes.io/projected/3a39e3b2-5ae8-437f-8122-d0247088e55a-kube-api-access-45t8v\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.158009 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.157943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-node-log\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.158009 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.157967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62n9j\" (UniqueName: \"kubernetes.io/projected/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-kube-api-access-62n9j\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.158283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158015    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85311435-e62b-48b9-9137-6875ceb51bc4-hosts-file\") pod \"node-resolver-dx4cb\" (UID: \"85311435-e62b-48b9-9137-6875ceb51bc4\") " pod="openshift-dns/node-resolver-dx4cb"
Jul 02 16:54:23.158283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158040    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w9vj\" (UniqueName: \"kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj\") pod \"network-check-target-nqwj6\" (UID: \"f5908f88-ad5a-44e9-9578-700495383fef\") " pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:23.158283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-run-ovn-kubernetes\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.158283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9trxp\" (UniqueName: \"kubernetes.io/projected/714f87ed-815d-48a6-a203-a5a4494ddffe-kube-api-access-9trxp\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:23.158283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158120    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-var-lib-kubelet\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.158283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-host\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.158283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-sys-fs\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.158283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158193    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-run-ovn\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.158283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/076e5765-d7cd-4dc2-86b2-91e58212d240-ovn-node-metrics-cert\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.158283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158239    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0de3411-588d-4931-b269-fbad31f83844-etc-tuned\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.158283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-multus-cni-dir\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-cnibin\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a39e3b2-5ae8-437f-8122-d0247088e55a-cni-binary-copy\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158367    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-etc-kubernetes\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158385    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-registration-dir\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d8373671-f624-4725-9b64-6db96ed0414c-kubelet-config\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158426    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-sysconfig\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158446    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-multus-socket-dir-parent\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158484    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-run-netns\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158526    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-kubelet\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158546    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-log-socket\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/076e5765-d7cd-4dc2-86b2-91e58212d240-ovnkube-config\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158614    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-run-multus-certs\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.158816 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc2tj\" (UniqueName: \"kubernetes.io/projected/978620fb-7c70-433b-9de0-7ebbdf96f064-kube-api-access-cc2tj\") pod \"node-ca-p5xzd\" (UID: \"978620fb-7c70-433b-9de0-7ebbdf96f064\") " pod="openshift-image-registry/node-ca-p5xzd"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-systemd-units\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-run-systemd\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/076e5765-d7cd-4dc2-86b2-91e58212d240-env-overrides\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-sys\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wccd\" (UniqueName: \"kubernetes.io/projected/b8a5c633-0484-4c8b-848e-ff55b708f1f0-kube-api-access-7wccd\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-var-lib-kubelet\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/076e5765-d7cd-4dc2-86b2-91e58212d240-ovnkube-script-lib\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158802    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d8373671-f624-4725-9b64-6db96ed0414c-dbus\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-sysctl-d\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-lib-modules\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8a5c633-0484-4c8b-848e-ff55b708f1f0-cnibin\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158904    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-device-dir\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87590989-2d97-4694-9e18-8240537e8b0f-iptables-alerter-script\") pod \"iptables-alerter-vhb2t\" (UID: \"87590989-2d97-4694-9e18-8240537e8b0f\") " pod="openshift-network-operator/iptables-alerter-vhb2t"
Jul 02 16:54:23.159561 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158937    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-cni-bin\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.160244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.158955    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:23.160244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159020    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-var-lib-cni-bin\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.160244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159060    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87590989-2d97-4694-9e18-8240537e8b0f-host-slash\") pod \"iptables-alerter-vhb2t\" (UID: \"87590989-2d97-4694-9e18-8240537e8b0f\") " pod="openshift-network-operator/iptables-alerter-vhb2t"
Jul 02 16:54:23.160244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159159    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-cni-netd\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.160244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.160244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8a5c633-0484-4c8b-848e-ff55b708f1f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.160244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159251    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8a5c633-0484-4c8b-848e-ff55b708f1f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.160244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159276    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-os-release\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.160244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159316    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-kubernetes\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.160244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159339    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0de3411-588d-4931-b269-fbad31f83844-tmp\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.160244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8a5c633-0484-4c8b-848e-ff55b708f1f0-os-release\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.160244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-run-k8s-cni-cncf-io\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.160244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-run-netns\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-run-openvswitch\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc4b2698-9de5-4fee-abb7-620ed1d69cba-agent-certs\") pod \"konnectivity-agent-czp4h\" (UID: \"cc4b2698-9de5-4fee-abb7-620ed1d69cba\") " pod="kube-system/konnectivity-agent-czp4h"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159512    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8a5c633-0484-4c8b-848e-ff55b708f1f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/978620fb-7c70-433b-9de0-7ebbdf96f064-host\") pod \"node-ca-p5xzd\" (UID: \"978620fb-7c70-433b-9de0-7ebbdf96f064\") " pod="openshift-image-registry/node-ca-p5xzd"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159584    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jf5w\" (UniqueName: \"kubernetes.io/projected/85311435-e62b-48b9-9137-6875ceb51bc4-kube-api-access-7jf5w\") pod \"node-resolver-dx4cb\" (UID: \"85311435-e62b-48b9-9137-6875ceb51bc4\") " pod="openshift-dns/node-resolver-dx4cb"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159620    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z4ql\" (UniqueName: \"kubernetes.io/projected/076e5765-d7cd-4dc2-86b2-91e58212d240-kube-api-access-6z4ql\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-sysctl-conf\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-run\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159710    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8a5c633-0484-4c8b-848e-ff55b708f1f0-system-cni-dir\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85311435-e62b-48b9-9137-6875ceb51bc4-tmp-dir\") pod \"node-resolver-dx4cb\" (UID: \"85311435-e62b-48b9-9137-6875ceb51bc4\") " pod="openshift-dns/node-resolver-dx4cb"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159774    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6wr6\" (UniqueName: \"kubernetes.io/projected/87590989-2d97-4694-9e18-8240537e8b0f-kube-api-access-f6wr6\") pod \"iptables-alerter-vhb2t\" (UID: \"87590989-2d97-4694-9e18-8240537e8b0f\") " pod="openshift-network-operator/iptables-alerter-vhb2t"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-244wz\" (UniqueName: \"kubernetes.io/projected/a0de3411-588d-4931-b269-fbad31f83844-kube-api-access-244wz\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159851    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-hostroot\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.160734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159876    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-multus-conf-dir\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.161318 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/978620fb-7c70-433b-9de0-7ebbdf96f064-serviceca\") pod \"node-ca-p5xzd\" (UID: \"978620fb-7c70-433b-9de0-7ebbdf96f064\") " pod="openshift-image-registry/node-ca-p5xzd"
Jul 02 16:54:23.161318 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.161318 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159947    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-socket-dir\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.161318 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159969    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-slash\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.161318 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.159992    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-modprobe-d\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.161318 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.160013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-systemd\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.161318 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.160033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-var-lib-cni-multus\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.161318 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.160064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-var-lib-openvswitch\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.261034 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.260990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8a5c633-0484-4c8b-848e-ff55b708f1f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.261034 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8a5c633-0484-4c8b-848e-ff55b708f1f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.261281 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-os-release\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.261281 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-kubernetes\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.261281 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0de3411-588d-4931-b269-fbad31f83844-tmp\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.261281 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8a5c633-0484-4c8b-848e-ff55b708f1f0-os-release\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.261281 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-run-k8s-cni-cncf-io\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.261281 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-run-netns\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.261281 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261206    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-run-openvswitch\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.261281 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc4b2698-9de5-4fee-abb7-620ed1d69cba-agent-certs\") pod \"konnectivity-agent-czp4h\" (UID: \"cc4b2698-9de5-4fee-abb7-620ed1d69cba\") " pod="kube-system/konnectivity-agent-czp4h"
Jul 02 16:54:23.261281 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8a5c633-0484-4c8b-848e-ff55b708f1f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.261281 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/978620fb-7c70-433b-9de0-7ebbdf96f064-host\") pod \"node-ca-p5xzd\" (UID: \"978620fb-7c70-433b-9de0-7ebbdf96f064\") " pod="openshift-image-registry/node-ca-p5xzd"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261298    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jf5w\" (UniqueName: \"kubernetes.io/projected/85311435-e62b-48b9-9137-6875ceb51bc4-kube-api-access-7jf5w\") pod \"node-resolver-dx4cb\" (UID: \"85311435-e62b-48b9-9137-6875ceb51bc4\") " pod="openshift-dns/node-resolver-dx4cb"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z4ql\" (UniqueName: \"kubernetes.io/projected/076e5765-d7cd-4dc2-86b2-91e58212d240-kube-api-access-6z4ql\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-sysctl-conf\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-run\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8a5c633-0484-4c8b-848e-ff55b708f1f0-system-cni-dir\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85311435-e62b-48b9-9137-6875ceb51bc4-tmp-dir\") pod \"node-resolver-dx4cb\" (UID: \"85311435-e62b-48b9-9137-6875ceb51bc4\") " pod="openshift-dns/node-resolver-dx4cb"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6wr6\" (UniqueName: \"kubernetes.io/projected/87590989-2d97-4694-9e18-8240537e8b0f-kube-api-access-f6wr6\") pod \"iptables-alerter-vhb2t\" (UID: \"87590989-2d97-4694-9e18-8240537e8b0f\") " pod="openshift-network-operator/iptables-alerter-vhb2t"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-244wz\" (UniqueName: \"kubernetes.io/projected/a0de3411-588d-4931-b269-fbad31f83844-kube-api-access-244wz\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-hostroot\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261524    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-multus-conf-dir\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/978620fb-7c70-433b-9de0-7ebbdf96f064-serviceca\") pod \"node-ca-p5xzd\" (UID: \"978620fb-7c70-433b-9de0-7ebbdf96f064\") " pod="openshift-image-registry/node-ca-p5xzd"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261593    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-socket-dir\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.261755 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-slash\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.262396 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261645    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-modprobe-d\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.262396 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261646    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/978620fb-7c70-433b-9de0-7ebbdf96f064-host\") pod \"node-ca-p5xzd\" (UID: \"978620fb-7c70-433b-9de0-7ebbdf96f064\") " pod="openshift-image-registry/node-ca-p5xzd"
Jul 02 16:54:23.262396 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-systemd\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.262396 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-var-lib-cni-multus\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.262396 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261872    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-systemd\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.262396 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261891    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-run-k8s-cni-cncf-io\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.262396 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.261972    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-modprobe-d\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.262396 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262249    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 16:54:23.262396 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262351    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-kubernetes\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.262396 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-var-lib-openvswitch\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262417    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-etc-openvswitch\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262469    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc4b2698-9de5-4fee-abb7-620ed1d69cba-konnectivity-ca\") pod \"konnectivity-agent-czp4h\" (UID: \"cc4b2698-9de5-4fee-abb7-620ed1d69cba\") " pod="kube-system/konnectivity-agent-czp4h"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-system-cni-dir\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a39e3b2-5ae8-437f-8122-d0247088e55a-multus-daemon-config\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8a5c633-0484-4c8b-848e-ff55b708f1f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262539    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8a5c633-0484-4c8b-848e-ff55b708f1f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262563    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45t8v\" (UniqueName: \"kubernetes.io/projected/3a39e3b2-5ae8-437f-8122-d0247088e55a-kube-api-access-45t8v\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262573    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-run\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262590    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-node-log\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62n9j\" (UniqueName: \"kubernetes.io/projected/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-kube-api-access-62n9j\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85311435-e62b-48b9-9137-6875ceb51bc4-hosts-file\") pod \"node-resolver-dx4cb\" (UID: \"85311435-e62b-48b9-9137-6875ceb51bc4\") " pod="openshift-dns/node-resolver-dx4cb"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262687    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-sysctl-conf\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.262867 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262708    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9vj\" (UniqueName: \"kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj\") pod \"network-check-target-nqwj6\" (UID: \"f5908f88-ad5a-44e9-9578-700495383fef\") " pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262818    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-socket-dir\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-run-ovn-kubernetes\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262854    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-slash\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9trxp\" (UniqueName: \"kubernetes.io/projected/714f87ed-815d-48a6-a203-a5a4494ddffe-kube-api-access-9trxp\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262866    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-multus-conf-dir\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262885    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-var-lib-kubelet\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-host\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262916    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-etc-openvswitch\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-sys-fs\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262958    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-var-lib-cni-multus\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-run-ovn\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262992    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/076e5765-d7cd-4dc2-86b2-91e58212d240-ovn-node-metrics-cert\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.263437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0de3411-588d-4931-b269-fbad31f83844-etc-tuned\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263029    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85311435-e62b-48b9-9137-6875ceb51bc4-hosts-file\") pod \"node-resolver-dx4cb\" (UID: \"85311435-e62b-48b9-9137-6875ceb51bc4\") " pod="openshift-dns/node-resolver-dx4cb"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263043    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-multus-cni-dir\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262824    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8a5c633-0484-4c8b-848e-ff55b708f1f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262824    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8a5c633-0484-4c8b-848e-ff55b708f1f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.262994    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-run-ovn\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.262913    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-cnibin\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263179    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-os-release\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263229    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-run-ovn-kubernetes\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263255    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a39e3b2-5ae8-437f-8122-d0247088e55a-cni-binary-copy\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263264    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-cnibin\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-etc-kubernetes\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263299    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-hostroot\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263310    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-registration-dir\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.264058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263333    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-run-netns\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263337    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d8373671-f624-4725-9b64-6db96ed0414c-kubelet-config\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-sysconfig\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263368    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc4b2698-9de5-4fee-abb7-620ed1d69cba-konnectivity-ca\") pod \"konnectivity-agent-czp4h\" (UID: \"cc4b2698-9de5-4fee-abb7-620ed1d69cba\") " pod="kube-system/konnectivity-agent-czp4h"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-multus-socket-dir-parent\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263412    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-run-netns\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263427    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-system-cni-dir\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263437    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263490    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-kubelet\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-log-socket\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/076e5765-d7cd-4dc2-86b2-91e58212d240-ovnkube-config\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-run-multus-certs\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263575    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8a5c633-0484-4c8b-848e-ff55b708f1f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263585    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-node-log\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263593    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2tj\" (UniqueName: \"kubernetes.io/projected/978620fb-7c70-433b-9de0-7ebbdf96f064-kube-api-access-cc2tj\") pod \"node-ca-p5xzd\" (UID: \"978620fb-7c70-433b-9de0-7ebbdf96f064\") " pod="openshift-image-registry/node-ca-p5xzd"
Jul 02 16:54:23.264768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263604    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/978620fb-7c70-433b-9de0-7ebbdf96f064-serviceca\") pod \"node-ca-p5xzd\" (UID: \"978620fb-7c70-433b-9de0-7ebbdf96f064\") " pod="openshift-image-registry/node-ca-p5xzd"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263622    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-run-openvswitch\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263761    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-systemd-units\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-run-systemd\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/076e5765-d7cd-4dc2-86b2-91e58212d240-env-overrides\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-sys\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263853    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-log-socket\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wccd\" (UniqueName: \"kubernetes.io/projected/b8a5c633-0484-4c8b-848e-ff55b708f1f0-kube-api-access-7wccd\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-var-lib-kubelet\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263902    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-var-lib-openvswitch\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/076e5765-d7cd-4dc2-86b2-91e58212d240-ovnkube-script-lib\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263940    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-etc-kubernetes\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d8373671-f624-4725-9b64-6db96ed0414c-dbus\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263959    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-multus-socket-dir-parent\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263981    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-kubelet\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.265446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-sysctl-d\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.263998    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-run-netns\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-lib-modules\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8a5c633-0484-4c8b-848e-ff55b708f1f0-cnibin\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264080    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8a5c633-0484-4c8b-848e-ff55b708f1f0-cnibin\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.264105    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs podName:714f87ed-815d-48a6-a203-a5a4494ddffe nodeName:}" failed. No retries permitted until 2026-07-02 16:54:23.764048824 +0000 UTC m=+3.130714764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs") pod "network-metrics-daemon-zc26l" (UID: "714f87ed-815d-48a6-a203-a5a4494ddffe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-device-dir\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264134    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-systemd-units\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264163    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-run-systemd\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264270    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a39e3b2-5ae8-437f-8122-d0247088e55a-multus-daemon-config\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264338    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8a5c633-0484-4c8b-848e-ff55b708f1f0-os-release\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264348    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-device-dir\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264550    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/076e5765-d7cd-4dc2-86b2-91e58212d240-env-overrides\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264557    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/076e5765-d7cd-4dc2-86b2-91e58212d240-ovnkube-config\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.266128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264612    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85311435-e62b-48b9-9137-6875ceb51bc4-tmp-dir\") pod \"node-resolver-dx4cb\" (UID: \"85311435-e62b-48b9-9137-6875ceb51bc4\") " pod="openshift-dns/node-resolver-dx4cb"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264631    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d8373671-f624-4725-9b64-6db96ed0414c-kubelet-config\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264664    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8a5c633-0484-4c8b-848e-ff55b708f1f0-system-cni-dir\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264679    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-sys-fs\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264757    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-multus-cni-dir\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264771    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264819    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-var-lib-kubelet\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264831    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-registration-dir\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264857    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d8373671-f624-4725-9b64-6db96ed0414c-dbus\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264878    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-sysconfig\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264925    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-etc-sysctl-d\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264948    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87590989-2d97-4694-9e18-8240537e8b0f-iptables-alerter-script\") pod \"iptables-alerter-vhb2t\" (UID: \"87590989-2d97-4694-9e18-8240537e8b0f\") " pod="openshift-network-operator/iptables-alerter-vhb2t"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264980    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-cni-bin\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264993    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-host\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.266753 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.264952    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-var-lib-kubelet\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265073    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-cni-bin\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265102    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-var-lib-cni-bin\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87590989-2d97-4694-9e18-8240537e8b0f-host-slash\") pod \"iptables-alerter-vhb2t\" (UID: \"87590989-2d97-4694-9e18-8240537e8b0f\") " pod="openshift-network-operator/iptables-alerter-vhb2t"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265150    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/076e5765-d7cd-4dc2-86b2-91e58212d240-ovnkube-script-lib\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265162    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-cni-netd\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265203    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-sys\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265293    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0de3411-588d-4931-b269-fbad31f83844-lib-modules\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265299    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265335    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-var-lib-cni-bin\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265351    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/076e5765-d7cd-4dc2-86b2-91e58212d240-host-cni-netd\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265372    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87590989-2d97-4694-9e18-8240537e8b0f-host-slash\") pod \"iptables-alerter-vhb2t\" (UID: \"87590989-2d97-4694-9e18-8240537e8b0f\") " pod="openshift-network-operator/iptables-alerter-vhb2t"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265385    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a39e3b2-5ae8-437f-8122-d0247088e55a-host-run-multus-certs\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.267507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265412    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a39e3b2-5ae8-437f-8122-d0247088e55a-cni-binary-copy\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.268220 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.265477    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:23.268220 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.265537    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret podName:d8373671-f624-4725-9b64-6db96ed0414c nodeName:}" failed. No retries permitted until 2026-07-02 16:54:23.765520032 +0000 UTC m=+3.132185975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret") pod "global-pull-secret-syncer-swtkc" (UID: "d8373671-f624-4725-9b64-6db96ed0414c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:23.268220 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.265594    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87590989-2d97-4694-9e18-8240537e8b0f-iptables-alerter-script\") pod \"iptables-alerter-vhb2t\" (UID: \"87590989-2d97-4694-9e18-8240537e8b0f\") " pod="openshift-network-operator/iptables-alerter-vhb2t"
Jul 02 16:54:23.268220 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.267623    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/076e5765-d7cd-4dc2-86b2-91e58212d240-ovn-node-metrics-cert\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.268220 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.267754    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc4b2698-9de5-4fee-abb7-620ed1d69cba-agent-certs\") pod \"konnectivity-agent-czp4h\" (UID: \"cc4b2698-9de5-4fee-abb7-620ed1d69cba\") " pod="kube-system/konnectivity-agent-czp4h"
Jul 02 16:54:23.269305 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.269145    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0de3411-588d-4931-b269-fbad31f83844-tmp\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.269305 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.269285    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0de3411-588d-4931-b269-fbad31f83844-etc-tuned\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.274242 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.273515    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62n9j\" (UniqueName: \"kubernetes.io/projected/58b5ba83-9993-49c4-8cd3-0c6ad12ce231-kube-api-access-62n9j\") pod \"aws-ebs-csi-driver-node-n6ldq\" (UID: \"58b5ba83-9993-49c4-8cd3-0c6ad12ce231\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.274242 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.273979    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6wr6\" (UniqueName: \"kubernetes.io/projected/87590989-2d97-4694-9e18-8240537e8b0f-kube-api-access-f6wr6\") pod \"iptables-alerter-vhb2t\" (UID: \"87590989-2d97-4694-9e18-8240537e8b0f\") " pod="openshift-network-operator/iptables-alerter-vhb2t"
Jul 02 16:54:23.274242 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.274019    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jf5w\" (UniqueName: \"kubernetes.io/projected/85311435-e62b-48b9-9137-6875ceb51bc4-kube-api-access-7jf5w\") pod \"node-resolver-dx4cb\" (UID: \"85311435-e62b-48b9-9137-6875ceb51bc4\") " pod="openshift-dns/node-resolver-dx4cb"
Jul 02 16:54:23.274450 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.274259    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z4ql\" (UniqueName: \"kubernetes.io/projected/076e5765-d7cd-4dc2-86b2-91e58212d240-kube-api-access-6z4ql\") pod \"ovnkube-node-jt4sh\" (UID: \"076e5765-d7cd-4dc2-86b2-91e58212d240\") " pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.275766 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.275193    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45t8v\" (UniqueName: \"kubernetes.io/projected/3a39e3b2-5ae8-437f-8122-d0247088e55a-kube-api-access-45t8v\") pod \"multus-xlwgd\" (UID: \"3a39e3b2-5ae8-437f-8122-d0247088e55a\") " pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.275766 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.275291    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 16:54:23.275766 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.275307    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 16:54:23.275766 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.275320    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7w9vj for pod openshift-network-diagnostics/network-check-target-nqwj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:23.275766 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.275379    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj podName:f5908f88-ad5a-44e9-9578-700495383fef nodeName:}" failed. No retries permitted until 2026-07-02 16:54:23.775363453 +0000 UTC m=+3.142029407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7w9vj" (UniqueName: "kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj") pod "network-check-target-nqwj6" (UID: "f5908f88-ad5a-44e9-9578-700495383fef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:23.278331 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.278294    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9trxp\" (UniqueName: \"kubernetes.io/projected/714f87ed-815d-48a6-a203-a5a4494ddffe-kube-api-access-9trxp\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:23.278583 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.278545    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-244wz\" (UniqueName: \"kubernetes.io/projected/a0de3411-588d-4931-b269-fbad31f83844-kube-api-access-244wz\") pod \"tuned-lghtl\" (UID: \"a0de3411-588d-4931-b269-fbad31f83844\") " pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.280156 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.279932    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc2tj\" (UniqueName: \"kubernetes.io/projected/978620fb-7c70-433b-9de0-7ebbdf96f064-kube-api-access-cc2tj\") pod \"node-ca-p5xzd\" (UID: \"978620fb-7c70-433b-9de0-7ebbdf96f064\") " pod="openshift-image-registry/node-ca-p5xzd"
Jul 02 16:54:23.280156 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.280037    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wccd\" (UniqueName: \"kubernetes.io/projected/b8a5c633-0484-4c8b-848e-ff55b708f1f0-kube-api-access-7wccd\") pod \"multus-additional-cni-plugins-4s9sr\" (UID: \"b8a5c633-0484-4c8b-848e-ff55b708f1f0\") " pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.417308 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.417227    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p5xzd"
Jul 02 16:54:23.425420 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.425380    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq"
Jul 02 16:54:23.433678 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.433651    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dx4cb"
Jul 02 16:54:23.440567 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.440540    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vhb2t"
Jul 02 16:54:23.447910 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.447751    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-czp4h"
Jul 02 16:54:23.454954 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.454854    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:23.463115 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.463069    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lghtl"
Jul 02 16:54:23.469041 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.469002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4s9sr"
Jul 02 16:54:23.473941 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.473846    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xlwgd"
Jul 02 16:54:23.572734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.572699    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 16:54:23.649146 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.649114    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 16:54:23.661275 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.661234    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 16:54:23.688297 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.688217    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hjkg8"
Jul 02 16:54:23.695102 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.695062    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hjkg8"
Jul 02 16:54:23.768971 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.768934    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:23.769184 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.769003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:23.769184 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.769125    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:23.769184 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.769132    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:23.769354 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.769189    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret podName:d8373671-f624-4725-9b64-6db96ed0414c nodeName:}" failed. No retries permitted until 2026-07-02 16:54:24.769174104 +0000 UTC m=+4.135840047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret") pod "global-pull-secret-syncer-swtkc" (UID: "d8373671-f624-4725-9b64-6db96ed0414c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:23.769354 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.769203    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs podName:714f87ed-815d-48a6-a203-a5a4494ddffe nodeName:}" failed. No retries permitted until 2026-07-02 16:54:24.769197217 +0000 UTC m=+4.135863157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs") pod "network-metrics-daemon-zc26l" (UID: "714f87ed-815d-48a6-a203-a5a4494ddffe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:23.870111 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:23.870061    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9vj\" (UniqueName: \"kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj\") pod \"network-check-target-nqwj6\" (UID: \"f5908f88-ad5a-44e9-9578-700495383fef\") " pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:23.870286 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.870254    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 16:54:23.870286 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.870283    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 16:54:23.870369 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.870297    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7w9vj for pod openshift-network-diagnostics/network-check-target-nqwj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:23.870412 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:23.870357    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj podName:f5908f88-ad5a-44e9-9578-700495383fef nodeName:}" failed. No retries permitted until 2026-07-02 16:54:24.870338457 +0000 UTC m=+4.237004402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7w9vj" (UniqueName: "kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj") pod "network-check-target-nqwj6" (UID: "f5908f88-ad5a-44e9-9578-700495383fef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:24.445580 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:24.445163    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87590989_2d97_4694_9e18_8240537e8b0f.slice/crio-797dd95b2944483170bed13302ab8334b714f952953aab1b98031d5897b877ac WatchSource:0}: Error finding container 797dd95b2944483170bed13302ab8334b714f952953aab1b98031d5897b877ac: Status 404 returned error can't find the container with id 797dd95b2944483170bed13302ab8334b714f952953aab1b98031d5897b877ac
Jul 02 16:54:24.446915 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:24.446891    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc4b2698_9de5_4fee_abb7_620ed1d69cba.slice/crio-f295afcfa0e0d051f66ed8b6ebafca093564b26252345c855bb64f8fbf115332 WatchSource:0}: Error finding container f295afcfa0e0d051f66ed8b6ebafca093564b26252345c855bb64f8fbf115332: Status 404 returned error can't find the container with id f295afcfa0e0d051f66ed8b6ebafca093564b26252345c855bb64f8fbf115332
Jul 02 16:54:24.448201 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:24.448173    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b5ba83_9993_49c4_8cd3_0c6ad12ce231.slice/crio-73265660a253737f6ca517f964c83b9a42b9af63300840281cd727403be8f2a9 WatchSource:0}: Error finding container 73265660a253737f6ca517f964c83b9a42b9af63300840281cd727403be8f2a9: Status 404 returned error can't find the container with id 73265660a253737f6ca517f964c83b9a42b9af63300840281cd727403be8f2a9
Jul 02 16:54:24.449562 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:24.448988    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978620fb_7c70_433b_9de0_7ebbdf96f064.slice/crio-d69b77c183531bdddb6149306f985ff8b5308bf6e54318d35eea8070076cac8c WatchSource:0}: Error finding container d69b77c183531bdddb6149306f985ff8b5308bf6e54318d35eea8070076cac8c: Status 404 returned error can't find the container with id d69b77c183531bdddb6149306f985ff8b5308bf6e54318d35eea8070076cac8c
Jul 02 16:54:24.452985 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:24.452960    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a39e3b2_5ae8_437f_8122_d0247088e55a.slice/crio-82d5f0c7fbc14d243e1b472423511c4ebc65f03c52d059aa172aebe99d3e3c9c WatchSource:0}: Error finding container 82d5f0c7fbc14d243e1b472423511c4ebc65f03c52d059aa172aebe99d3e3c9c: Status 404 returned error can't find the container with id 82d5f0c7fbc14d243e1b472423511c4ebc65f03c52d059aa172aebe99d3e3c9c
Jul 02 16:54:24.454499 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:24.454472    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a5c633_0484_4c8b_848e_ff55b708f1f0.slice/crio-ec38d75b96afbe66175f243177b518b9e922a6bc6c8b051de3d93a5a9ed83d4b WatchSource:0}: Error finding container ec38d75b96afbe66175f243177b518b9e922a6bc6c8b051de3d93a5a9ed83d4b: Status 404 returned error can't find the container with id ec38d75b96afbe66175f243177b518b9e922a6bc6c8b051de3d93a5a9ed83d4b
Jul 02 16:54:24.454786 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:24.454754    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85311435_e62b_48b9_9137_6875ceb51bc4.slice/crio-ffad862d78109fa45e9b6d4f10492dcb731c116315d8a03f972e0347dd0cd2e7 WatchSource:0}: Error finding container ffad862d78109fa45e9b6d4f10492dcb731c116315d8a03f972e0347dd0cd2e7: Status 404 returned error can't find the container with id ffad862d78109fa45e9b6d4f10492dcb731c116315d8a03f972e0347dd0cd2e7
Jul 02 16:54:24.697864 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.697710    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 16:49:23 +0000 UTC" deadline="2027-12-16 08:31:57.785470512 +0000 UTC"
Jul 02 16:54:24.697864 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.697854    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12759h37m33.087619119s"
Jul 02 16:54:24.715389 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.715368    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:24.715498 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.715368    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:24.715498 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:24.715466    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:24.715565 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:24.715549    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:24.715598 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.715368    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:24.715630 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:24.715623    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:24.721888 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.721862    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vhb2t" event={"ID":"87590989-2d97-4694-9e18-8240537e8b0f","Type":"ContainerStarted","Data":"797dd95b2944483170bed13302ab8334b714f952953aab1b98031d5897b877ac"}
Jul 02 16:54:24.723771 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.723746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal" event={"ID":"5ef2143623978894d796b13886d639f6","Type":"ContainerStarted","Data":"d22df923e8a9c8c7178924ebe919778872c1eb22c25388a7fddcf27a5b536b15"}
Jul 02 16:54:24.726465 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.726425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xlwgd" event={"ID":"3a39e3b2-5ae8-437f-8122-d0247088e55a","Type":"ContainerStarted","Data":"82d5f0c7fbc14d243e1b472423511c4ebc65f03c52d059aa172aebe99d3e3c9c"}
Jul 02 16:54:24.728880 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.728854    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-czp4h" event={"ID":"cc4b2698-9de5-4fee-abb7-620ed1d69cba","Type":"ContainerStarted","Data":"f295afcfa0e0d051f66ed8b6ebafca093564b26252345c855bb64f8fbf115332"}
Jul 02 16:54:24.730435 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.730413    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal" event={"ID":"084c7305d4c2b79de5997d13e2dcbb4a","Type":"ContainerStarted","Data":"ea7d9b59b94774763e3af5fc6eea40be4a3c9c0fcb9b9b1cf4153066eea1877e"}
Jul 02 16:54:24.731611 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.731585    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh" event={"ID":"076e5765-d7cd-4dc2-86b2-91e58212d240","Type":"ContainerStarted","Data":"82ad1b7cce8083f7d29a874d9daebd2d9daf842d0cc9ecb2b61d84898393c776"}
Jul 02 16:54:24.732630 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.732608    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lghtl" event={"ID":"a0de3411-588d-4931-b269-fbad31f83844","Type":"ContainerStarted","Data":"7c48b04e8957cb07137844936961e8a8e722f8d396e6e8984f99003134ba2942"}
Jul 02 16:54:24.733644 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.733609    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dx4cb" event={"ID":"85311435-e62b-48b9-9137-6875ceb51bc4","Type":"ContainerStarted","Data":"ffad862d78109fa45e9b6d4f10492dcb731c116315d8a03f972e0347dd0cd2e7"}
Jul 02 16:54:24.734657 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.734639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s9sr" event={"ID":"b8a5c633-0484-4c8b-848e-ff55b708f1f0","Type":"ContainerStarted","Data":"ec38d75b96afbe66175f243177b518b9e922a6bc6c8b051de3d93a5a9ed83d4b"}
Jul 02 16:54:24.735707 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.735690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p5xzd" event={"ID":"978620fb-7c70-433b-9de0-7ebbdf96f064","Type":"ContainerStarted","Data":"d69b77c183531bdddb6149306f985ff8b5308bf6e54318d35eea8070076cac8c"}
Jul 02 16:54:24.736724 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.736705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq" event={"ID":"58b5ba83-9993-49c4-8cd3-0c6ad12ce231","Type":"ContainerStarted","Data":"73265660a253737f6ca517f964c83b9a42b9af63300840281cd727403be8f2a9"}
Jul 02 16:54:24.754530 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.754483    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-131.ec2.internal" podStartSLOduration=2.754471586 podStartE2EDuration="2.754471586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:54:24.753975319 +0000 UTC m=+4.120641277" watchObservedRunningTime="2026-07-02 16:54:24.754471586 +0000 UTC m=+4.121137548"
Jul 02 16:54:24.776253 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.776231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:24.776379 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.776282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:24.776425 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:24.776389    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:24.776425 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:24.776390    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:24.776490 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:24.776439    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret podName:d8373671-f624-4725-9b64-6db96ed0414c nodeName:}" failed. No retries permitted until 2026-07-02 16:54:26.776426421 +0000 UTC m=+6.143092361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret") pod "global-pull-secret-syncer-swtkc" (UID: "d8373671-f624-4725-9b64-6db96ed0414c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:24.776490 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:24.776457    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs podName:714f87ed-815d-48a6-a203-a5a4494ddffe nodeName:}" failed. No retries permitted until 2026-07-02 16:54:26.776447039 +0000 UTC m=+6.143112981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs") pod "network-metrics-daemon-zc26l" (UID: "714f87ed-815d-48a6-a203-a5a4494ddffe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:24.877625 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:24.876886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9vj\" (UniqueName: \"kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj\") pod \"network-check-target-nqwj6\" (UID: \"f5908f88-ad5a-44e9-9578-700495383fef\") " pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:24.877625 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:24.877054    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 16:54:24.877625 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:24.877076    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 16:54:24.877625 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:24.877104    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7w9vj for pod openshift-network-diagnostics/network-check-target-nqwj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:24.877625 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:24.877170    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj podName:f5908f88-ad5a-44e9-9578-700495383fef nodeName:}" failed. No retries permitted until 2026-07-02 16:54:26.877151092 +0000 UTC m=+6.243817037 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7w9vj" (UniqueName: "kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj") pod "network-check-target-nqwj6" (UID: "f5908f88-ad5a-44e9-9578-700495383fef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:25.698963 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:25.698881    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 16:49:23 +0000 UTC" deadline="2028-01-14 09:42:27.744724647 +0000 UTC"
Jul 02 16:54:25.698963 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:25.698926    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13456h48m2.04580382s"
Jul 02 16:54:25.744112 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:25.744044    2579 generic.go:356] "Generic (PLEG): container finished" podID="5ef2143623978894d796b13886d639f6" containerID="d22df923e8a9c8c7178924ebe919778872c1eb22c25388a7fddcf27a5b536b15" exitCode=0
Jul 02 16:54:25.744436 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:25.744354    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal" event={"ID":"5ef2143623978894d796b13886d639f6","Type":"ContainerDied","Data":"d22df923e8a9c8c7178924ebe919778872c1eb22c25388a7fddcf27a5b536b15"}
Jul 02 16:54:26.715844 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:26.715815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:26.716321 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:26.715947    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:26.716386 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:26.716349    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:26.716461 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:26.716438    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:26.716525 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:26.716493    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:26.716576 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:26.716561    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:26.766670 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:26.766632    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal" event={"ID":"5ef2143623978894d796b13886d639f6","Type":"ContainerStarted","Data":"6c8629861265dba3675118d537dd8f2849f226257a2552d2641f0d96312f5dec"}
Jul 02 16:54:26.794136 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:26.794102    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:26.794334 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:26.794180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:26.794487 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:26.794332    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:26.794487 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:26.794395    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs podName:714f87ed-815d-48a6-a203-a5a4494ddffe nodeName:}" failed. No retries permitted until 2026-07-02 16:54:30.794376564 +0000 UTC m=+10.161042505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs") pod "network-metrics-daemon-zc26l" (UID: "714f87ed-815d-48a6-a203-a5a4494ddffe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:26.794487 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:26.794332    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:26.794487 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:26.794479    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret podName:d8373671-f624-4725-9b64-6db96ed0414c nodeName:}" failed. No retries permitted until 2026-07-02 16:54:30.794466047 +0000 UTC m=+10.161132001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret") pod "global-pull-secret-syncer-swtkc" (UID: "d8373671-f624-4725-9b64-6db96ed0414c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:26.894576 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:26.894544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9vj\" (UniqueName: \"kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj\") pod \"network-check-target-nqwj6\" (UID: \"f5908f88-ad5a-44e9-9578-700495383fef\") " pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:26.894744 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:26.894692    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 16:54:26.894744 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:26.894712    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 16:54:26.894744 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:26.894724    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7w9vj for pod openshift-network-diagnostics/network-check-target-nqwj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:26.894904 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:26.894778    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj podName:f5908f88-ad5a-44e9-9578-700495383fef nodeName:}" failed. No retries permitted until 2026-07-02 16:54:30.894759594 +0000 UTC m=+10.261425553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7w9vj" (UniqueName: "kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj") pod "network-check-target-nqwj6" (UID: "f5908f88-ad5a-44e9-9578-700495383fef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:28.715569 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:28.715534    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:28.716048 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:28.715679    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:28.716048 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:28.715772    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:28.716048 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:28.715851    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:28.716048 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:28.715903    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:28.716048 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:28.715963    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:30.714978 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:30.714622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:30.714978 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:30.714755    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:30.714978 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:30.714819    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:30.714978 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:30.714906    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:30.714978 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:30.714970    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:30.715651 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:30.715043    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:30.829521 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:30.829470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:30.829694 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:30.829544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:30.829694 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:30.829624    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:30.829694 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:30.829671    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:30.829877 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:30.829708    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret podName:d8373671-f624-4725-9b64-6db96ed0414c nodeName:}" failed. No retries permitted until 2026-07-02 16:54:38.829685158 +0000 UTC m=+18.196351102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret") pod "global-pull-secret-syncer-swtkc" (UID: "d8373671-f624-4725-9b64-6db96ed0414c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:30.829877 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:30.829729    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs podName:714f87ed-815d-48a6-a203-a5a4494ddffe nodeName:}" failed. No retries permitted until 2026-07-02 16:54:38.829718296 +0000 UTC m=+18.196384240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs") pod "network-metrics-daemon-zc26l" (UID: "714f87ed-815d-48a6-a203-a5a4494ddffe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:30.930441 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:30.930395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9vj\" (UniqueName: \"kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj\") pod \"network-check-target-nqwj6\" (UID: \"f5908f88-ad5a-44e9-9578-700495383fef\") " pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:30.930669 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:30.930554    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 16:54:30.930669 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:30.930579    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 16:54:30.930669 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:30.930591    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7w9vj for pod openshift-network-diagnostics/network-check-target-nqwj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:30.930669 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:30.930656    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj podName:f5908f88-ad5a-44e9-9578-700495383fef nodeName:}" failed. No retries permitted until 2026-07-02 16:54:38.930637526 +0000 UTC m=+18.297303486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7w9vj" (UniqueName: "kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj") pod "network-check-target-nqwj6" (UID: "f5908f88-ad5a-44e9-9578-700495383fef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:32.716104 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:32.715133    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:32.716104 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:32.715263    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:32.716104 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:32.715672    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:32.716104 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:32.715765    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:32.716104 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:32.715826    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:32.716104 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:32.715898    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:34.715557 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:34.715515    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:34.715557 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:34.715552    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:34.715910 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:34.715515    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:34.715910 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:34.715651    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:34.715910 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:34.715745    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:34.715910 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:34.715818    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:36.715402 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:36.715375    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:36.715887 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:36.715376    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:36.715887 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:36.715491    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:36.715887 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:36.715375    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:36.715887 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:36.715574    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:36.715887 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:36.715655    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:38.715018 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:38.714972    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:38.715018 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:38.715002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:38.715602 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:38.715002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:38.715602 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:38.715122    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:38.715602 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:38.715216    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:38.715602 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:38.715311    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:38.891171 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:38.891141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:38.891300 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:38.891199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:38.891300 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:38.891279    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:38.891360 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:38.891299    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:38.891360 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:38.891338    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret podName:d8373671-f624-4725-9b64-6db96ed0414c nodeName:}" failed. No retries permitted until 2026-07-02 16:54:54.891324726 +0000 UTC m=+34.257990667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret") pod "global-pull-secret-syncer-swtkc" (UID: "d8373671-f624-4725-9b64-6db96ed0414c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:38.891360 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:38.891354    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs podName:714f87ed-815d-48a6-a203-a5a4494ddffe nodeName:}" failed. No retries permitted until 2026-07-02 16:54:54.891346947 +0000 UTC m=+34.258012887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs") pod "network-metrics-daemon-zc26l" (UID: "714f87ed-815d-48a6-a203-a5a4494ddffe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:38.991833 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:38.991768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9vj\" (UniqueName: \"kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj\") pod \"network-check-target-nqwj6\" (UID: \"f5908f88-ad5a-44e9-9578-700495383fef\") " pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:38.991953 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:38.991922    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 16:54:38.991953 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:38.991938    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 16:54:38.991953 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:38.991947    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7w9vj for pod openshift-network-diagnostics/network-check-target-nqwj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:38.992044 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:38.991995    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj podName:f5908f88-ad5a-44e9-9578-700495383fef nodeName:}" failed. No retries permitted until 2026-07-02 16:54:54.991982582 +0000 UTC m=+34.358648525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7w9vj" (UniqueName: "kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj") pod "network-check-target-nqwj6" (UID: "f5908f88-ad5a-44e9-9578-700495383fef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:40.714899 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:40.714859    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:40.714899 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:40.714899    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:40.715446 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:40.714909    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:40.715446 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:40.714994    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:40.715446 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:40.715053    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:40.715446 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:40.715187    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:42.715398 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:42.715360    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:42.715741 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:42.715403    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:42.715741 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:42.715467    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:42.715741 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:42.715484    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:42.715741 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:42.715546    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:42.715741 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:42.715620    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:43.805567 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.805180    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh" event={"ID":"076e5765-d7cd-4dc2-86b2-91e58212d240","Type":"ContainerStarted","Data":"b6f98378b42454a48d0d4b7d8d62b53907feaed43e8d83b36582150515a72d6b"}
Jul 02 16:54:43.806300 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.805583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh" event={"ID":"076e5765-d7cd-4dc2-86b2-91e58212d240","Type":"ContainerStarted","Data":"dcc5edf770a9e103255c88c28516e4974dd60b232a9c377b0498241d9c3f35ca"}
Jul 02 16:54:43.806300 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.805628    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh" event={"ID":"076e5765-d7cd-4dc2-86b2-91e58212d240","Type":"ContainerStarted","Data":"eb6ba90795fbd65754cdc4e79b2ab434c80d1517a0f2fb8803e502bc3d83cac0"}
Jul 02 16:54:43.806300 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.805666    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh" event={"ID":"076e5765-d7cd-4dc2-86b2-91e58212d240","Type":"ContainerStarted","Data":"bbd5fc45fd30d3c57ac1063d7ca9a2f8de60113f7dacc942b98192c23beba2d3"}
Jul 02 16:54:43.806300 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.805712    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh" event={"ID":"076e5765-d7cd-4dc2-86b2-91e58212d240","Type":"ContainerStarted","Data":"2ab6b6f48905398bac270eee47f91c0593a2507d327a9cb77a42d9148e68ce9b"}
Jul 02 16:54:43.806300 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.805758    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh" event={"ID":"076e5765-d7cd-4dc2-86b2-91e58212d240","Type":"ContainerStarted","Data":"d665236013a2760dc6843074e8a4122f91a4367588c930994a114c5affbacee1"}
Jul 02 16:54:43.806706 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.806677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lghtl" event={"ID":"a0de3411-588d-4931-b269-fbad31f83844","Type":"ContainerStarted","Data":"dc5cce92a48526799ffefeb9b94eaff9c94209278559cb53ae00417cd6d4d916"}
Jul 02 16:54:43.808050 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.808020    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dx4cb" event={"ID":"85311435-e62b-48b9-9137-6875ceb51bc4","Type":"ContainerStarted","Data":"206bfeb73abef383d4d8186408c58ce10ba5bab6df6e975a1736946a7c562ca6"}
Jul 02 16:54:43.809629 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.809602    2579 generic.go:356] "Generic (PLEG): container finished" podID="b8a5c633-0484-4c8b-848e-ff55b708f1f0" containerID="c5bb2bd92f9fd3eb96caad3b38fdb2d8ba9f1bf442d3f0aed82e680a56e62372" exitCode=0
Jul 02 16:54:43.809749 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.809691    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s9sr" event={"ID":"b8a5c633-0484-4c8b-848e-ff55b708f1f0","Type":"ContainerDied","Data":"c5bb2bd92f9fd3eb96caad3b38fdb2d8ba9f1bf442d3f0aed82e680a56e62372"}
Jul 02 16:54:43.811277 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.811257    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p5xzd" event={"ID":"978620fb-7c70-433b-9de0-7ebbdf96f064","Type":"ContainerStarted","Data":"e19aba651241e48f37ca0bc5f9d7fab70f4bfabb2caf3b1d0ae914b9cb9bc3a7"}
Jul 02 16:54:43.812832 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.812801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq" event={"ID":"58b5ba83-9993-49c4-8cd3-0c6ad12ce231","Type":"ContainerStarted","Data":"bd67467d76c0623cdfbf97d28e9c4e8ab935e255b04dfda759fb334e22d3afde"}
Jul 02 16:54:43.814303 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.814282    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xlwgd" event={"ID":"3a39e3b2-5ae8-437f-8122-d0247088e55a","Type":"ContainerStarted","Data":"55bd11283bbd19ed07b55f52ed4fac3bb959d6d715a6d70ede7176a14dc47d34"}
Jul 02 16:54:43.815741 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.815720    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-czp4h" event={"ID":"cc4b2698-9de5-4fee-abb7-620ed1d69cba","Type":"ContainerStarted","Data":"a266dded9f8dc4cb78f4942fd6b6eadb9c069fcb082748c8f68a6ce118a3bf8c"}
Jul 02 16:54:43.821929 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.821891    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lghtl" podStartSLOduration=3.509883679 podStartE2EDuration="21.821878475s" totalImagesPullingTime="18.311994796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:54:43.821860258 +0000 UTC m=+23.188526219" watchObservedRunningTime="2026-07-02 16:54:43.821878475 +0000 UTC m=+23.188544437"
Jul 02 16:54:43.822395 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.822368    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-131.ec2.internal" podStartSLOduration=21.822358958 podStartE2EDuration="21.822358958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:54:26.783133502 +0000 UTC m=+6.149799464" watchObservedRunningTime="2026-07-02 16:54:43.822358958 +0000 UTC m=+23.189024919"
Jul 02 16:54:43.920840 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.920782    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dx4cb" podStartSLOduration=4.603714513 podStartE2EDuration="22.920760905s" totalImagesPullingTime="18.317046392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:54:43.886254602 +0000 UTC m=+23.252920565" watchObservedRunningTime="2026-07-02 16:54:43.920760905 +0000 UTC m=+23.287426867"
Jul 02 16:54:43.921173 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.921143    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-czp4h" podStartSLOduration=3.60138094 podStartE2EDuration="21.921132026s" totalImagesPullingTime="18.319751086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:54:43.920738951 +0000 UTC m=+23.287404915" watchObservedRunningTime="2026-07-02 16:54:43.921132026 +0000 UTC m=+23.287797989"
Jul 02 16:54:43.939147 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.939072    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xlwgd" podStartSLOduration=3.299299617 podStartE2EDuration="21.939053425s" totalImagesPullingTime="18.639753808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:54:43.938113115 +0000 UTC m=+23.304779078" watchObservedRunningTime="2026-07-02 16:54:43.939053425 +0000 UTC m=+23.305719388"
Jul 02 16:54:43.951404 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:43.951358    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p5xzd" podStartSLOduration=4.712802884 podStartE2EDuration="22.951345938s" totalImagesPullingTime="18.238543054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:54:43.950841652 +0000 UTC m=+23.317507616" watchObservedRunningTime="2026-07-02 16:54:43.951345938 +0000 UTC m=+23.318011946"
Jul 02 16:54:44.476834 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:44.476803    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 16:54:44.714719 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:44.714642    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:44.714719 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:44.714684    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:44.714719 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:44.714684    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:44.714964 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:44.714770    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:44.714964 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:44.714858    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:44.714964 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:44.714912    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:44.715629 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:44.715555    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T16:54:44.476827954Z","UUID":"954e6e8a-1520-46b8-82f5-9453f27e8d85","Handler":null,"Name":"","Endpoint":""}
Jul 02 16:54:44.717042 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:44.717023    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 16:54:44.717164 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:44.717057    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 16:54:44.820547 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:44.820515    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq" event={"ID":"58b5ba83-9993-49c4-8cd3-0c6ad12ce231","Type":"ContainerStarted","Data":"4204fbe2a62ff3931ee387568033e0e94e64f40c6837a74b741999e7b32943a6"}
Jul 02 16:54:44.822283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:44.822247    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vhb2t" event={"ID":"87590989-2d97-4694-9e18-8240537e8b0f","Type":"ContainerStarted","Data":"3725bde065ac1fd20886c8ccfdb85452e814549f09159fd0373fa578bdbda198"}
Jul 02 16:54:46.714925 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:46.714890    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:46.714925 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:46.714918    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:46.714925 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:46.714916    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:46.715596 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:46.715015    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:46.715596 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:46.715151    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:46.715596 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:46.715307    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:46.830000 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:46.829955    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq" event={"ID":"58b5ba83-9993-49c4-8cd3-0c6ad12ce231","Type":"ContainerStarted","Data":"2c00b6fb7b657911db5f2ee559b4ddd912a4784e293c3131014f49bce241ae9f"}
Jul 02 16:54:46.833732 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:46.833705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh" event={"ID":"076e5765-d7cd-4dc2-86b2-91e58212d240","Type":"ContainerStarted","Data":"7cb2b0a31c3e209044661314d84a579621a1f72531f924ee4b41a35efb182d78"}
Jul 02 16:54:46.847861 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:46.847805    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ldq" podStartSLOduration=5.048643688 podStartE2EDuration="25.847786617s" totalImagesPullingTime="20.799142929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:54:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:54:46.846488483 +0000 UTC m=+26.213154447" watchObservedRunningTime="2026-07-02 16:54:46.847786617 +0000 UTC m=+26.214452579"
Jul 02 16:54:46.848058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:46.848025    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vhb2t" podStartSLOduration=6.526566294 podStartE2EDuration="24.84801789s" totalImagesPullingTime="18.321451596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:54:44.837055704 +0000 UTC m=+24.203721665" watchObservedRunningTime="2026-07-02 16:54:46.84801789 +0000 UTC m=+26.214683853"
Jul 02 16:54:48.657935 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:48.657688    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-czp4h"
Jul 02 16:54:48.658573 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:48.658265    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-czp4h"
Jul 02 16:54:48.714949 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:48.714921    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:48.715144 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:48.714958    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:48.715144 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:48.715012    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:48.715144 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:48.714934    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:48.715144 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:48.715056    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:48.715315 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:48.715152    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:48.842038 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:48.842004    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh" event={"ID":"076e5765-d7cd-4dc2-86b2-91e58212d240","Type":"ContainerStarted","Data":"ef299a103ba212a850cd6ca87f8dfc3ec8699f294677b81d1e450ac9de078644"}
Jul 02 16:54:48.843833 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:48.843809    2579 generic.go:356] "Generic (PLEG): container finished" podID="b8a5c633-0484-4c8b-848e-ff55b708f1f0" containerID="aed4e42e4858fc80f3bac32066feda501bb71f71803494eae32a54f29e507cff" exitCode=0
Jul 02 16:54:48.843951 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:48.843883    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s9sr" event={"ID":"b8a5c633-0484-4c8b-848e-ff55b708f1f0","Type":"ContainerDied","Data":"aed4e42e4858fc80f3bac32066feda501bb71f71803494eae32a54f29e507cff"}
Jul 02 16:54:48.865199 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:48.865154    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh" podStartSLOduration=8.551102261 podStartE2EDuration="26.865138791s" totalImagesPullingTime="18.31403653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:54:48.863565883 +0000 UTC m=+28.230231845" watchObservedRunningTime="2026-07-02 16:54:48.865138791 +0000 UTC m=+28.231804754"
Jul 02 16:54:49.271324 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:49.271285    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-czp4h"
Jul 02 16:54:49.271884 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:49.271858    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-czp4h"
Jul 02 16:54:49.846580 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:49.846347    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:49.847120 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:49.846795    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:49.847120 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:49.846854    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:49.861746 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:49.861684    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:49.861870 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:49.861783    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:54:50.341840 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:50.341762    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-swtkc"]
Jul 02 16:54:50.342002 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:50.341881    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:50.342002 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:50.341969    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:50.345116 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:50.345060    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zc26l"]
Jul 02 16:54:50.345257 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:50.345197    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:50.345336 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:50.345315    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:50.345721 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:50.345701    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nqwj6"]
Jul 02 16:54:50.345815 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:50.345788    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:50.345878 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:50.345862    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:50.850171 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:50.850131    2579 generic.go:356] "Generic (PLEG): container finished" podID="b8a5c633-0484-4c8b-848e-ff55b708f1f0" containerID="8aebfc725fceed0577b61152e2fb2a996803626e95f60292302c5d35be14d2ce" exitCode=0
Jul 02 16:54:50.850557 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:50.850210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s9sr" event={"ID":"b8a5c633-0484-4c8b-848e-ff55b708f1f0","Type":"ContainerDied","Data":"8aebfc725fceed0577b61152e2fb2a996803626e95f60292302c5d35be14d2ce"}
Jul 02 16:54:51.717099 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:51.717061    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:51.717253 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:51.717184    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:51.717253 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:51.717233    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:51.717335 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:51.717318    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:52.714645 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:52.714617    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:52.715038 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:52.714723    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:52.860890 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:52.860855    2579 generic.go:356] "Generic (PLEG): container finished" podID="b8a5c633-0484-4c8b-848e-ff55b708f1f0" containerID="eafe3dad0604cff967731ce42a6daf7e4e388df607ac13b35baf14ef9abe5431" exitCode=0
Jul 02 16:54:52.861036 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:52.860905    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s9sr" event={"ID":"b8a5c633-0484-4c8b-848e-ff55b708f1f0","Type":"ContainerDied","Data":"eafe3dad0604cff967731ce42a6daf7e4e388df607ac13b35baf14ef9abe5431"}
Jul 02 16:54:53.718238 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:53.718208    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:53.718703 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:53.718245    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:53.718703 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:53.718324    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:53.718703 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:53.718461    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:54.714563 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:54.714530    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:54.714754 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:54.714632    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swtkc" podUID="d8373671-f624-4725-9b64-6db96ed0414c"
Jul 02 16:54:54.908484 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:54.908455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:54.908833 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:54.908499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:54.908833 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:54.908591    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:54.908833 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:54.908592    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:54.908833 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:54.908640    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs podName:714f87ed-815d-48a6-a203-a5a4494ddffe nodeName:}" failed. No retries permitted until 2026-07-02 16:55:26.908626194 +0000 UTC m=+66.275292134 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs") pod "network-metrics-daemon-zc26l" (UID: "714f87ed-815d-48a6-a203-a5a4494ddffe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 16:54:54.908833 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:54.908653    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret podName:d8373671-f624-4725-9b64-6db96ed0414c nodeName:}" failed. No retries permitted until 2026-07-02 16:55:26.90864652 +0000 UTC m=+66.275312459 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret") pod "global-pull-secret-syncer-swtkc" (UID: "d8373671-f624-4725-9b64-6db96ed0414c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 16:54:55.009893 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.009811    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9vj\" (UniqueName: \"kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj\") pod \"network-check-target-nqwj6\" (UID: \"f5908f88-ad5a-44e9-9578-700495383fef\") " pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:55.010058 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:55.010017    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 16:54:55.010058 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:55.010040    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 16:54:55.010058 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:55.010050    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7w9vj for pod openshift-network-diagnostics/network-check-target-nqwj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:55.010234 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:55.010125    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj podName:f5908f88-ad5a-44e9-9578-700495383fef nodeName:}" failed. No retries permitted until 2026-07-02 16:55:27.010107607 +0000 UTC m=+66.376773569 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7w9vj" (UniqueName: "kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj") pod "network-check-target-nqwj6" (UID: "f5908f88-ad5a-44e9-9578-700495383fef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 16:54:55.718709 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.718680    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:55.718864 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.718680    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:55.718864 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:55.718796    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqwj6" podUID="f5908f88-ad5a-44e9-9578-700495383fef"
Jul 02 16:54:55.718972 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:55.718910    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:54:55.875039 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.874931    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-131.ec2.internal" event="NodeReady"
Jul 02 16:54:55.875218 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.875116    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 16:54:55.913395 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.913358    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"]
Jul 02 16:54:55.945260 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.945224    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b67fddffc-9z5lv"]
Jul 02 16:54:55.945421 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.945395    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:54:55.948758 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.948387    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 02 16:54:55.948758 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.948660    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cm9q4\""
Jul 02 16:54:55.949837 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.949725    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 02 16:54:55.973279 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.973064    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rpw8d"]
Jul 02 16:54:55.973432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.973206    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:55.975817 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.975782    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 16:54:55.976137 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.976120    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 16:54:55.976137 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.976128    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s9rkj\""
Jul 02 16:54:55.976287 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.976159    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 16:54:55.981982 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.981877    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:54:55.982200 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.982181    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 16:54:55.989199 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.989172    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"]
Jul 02 16:54:55.989290 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.989208    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b67fddffc-9z5lv"]
Jul 02 16:54:55.989290 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.989232    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h9cdx"]
Jul 02 16:54:55.989290 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.989272    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:55.991775 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.991758    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 16:54:55.991874 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.991758    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 16:54:55.991949 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:55.991896    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mmn65\""
Jul 02 16:54:56.005163 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.005135    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rpw8d"]
Jul 02 16:54:56.005163 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.005167    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h9cdx"]
Jul 02 16:54:56.005317 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.005244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h9cdx"
Jul 02 16:54:56.007494 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.007474    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-947jv\""
Jul 02 16:54:56.007609 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.007564    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 16:54:56.007724 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.007708    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 16:54:56.007983 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.007963    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 16:54:56.017937 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.017912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:54:56.018050 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.018035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6571d87-c591-4faa-92bf-51667bd9b37a-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:54:56.074008 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.073973    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:54:56.118666 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.118628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/628f316e-f572-469a-af90-da94166005b3-ca-trust-extracted\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.118832 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.118670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/628f316e-f572-469a-af90-da94166005b3-trusted-ca\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.118832 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.118761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.118936 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.118826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6571d87-c591-4faa-92bf-51667bd9b37a-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:54:56.118936 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.118872    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:56.118936 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.118904    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-bound-sa-token\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.119050 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.119034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:54:56.119138 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.119119    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/628f316e-f572-469a-af90-da94166005b3-image-registry-private-configuration\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.119202 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.119158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cphj\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-kube-api-access-5cphj\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.119202 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.119185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnrln\" (UniqueName: \"kubernetes.io/projected/c40fbd58-95ff-4b7b-9719-f024284c62d0-kube-api-access-xnrln\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:56.119202 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.119189    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 16:54:56.119330 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.119215    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6r2g\" (UniqueName: \"kubernetes.io/projected/06a380d9-c1c0-438b-a440-a968c83c2764-kube-api-access-s6r2g\") pod \"ingress-canary-h9cdx\" (UID: \"06a380d9-c1c0-438b-a440-a968c83c2764\") " pod="openshift-ingress-canary/ingress-canary-h9cdx"
Jul 02 16:54:56.119330 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.119256    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert podName:a6571d87-c591-4faa-92bf-51667bd9b37a nodeName:}" failed. No retries permitted until 2026-07-02 16:54:56.619240696 +0000 UTC m=+35.985906637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kvwhg" (UID: "a6571d87-c591-4faa-92bf-51667bd9b37a") : secret "networking-console-plugin-cert" not found
Jul 02 16:54:56.119330 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.119300    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/628f316e-f572-469a-af90-da94166005b3-registry-certificates\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.119488 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.119343    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c40fbd58-95ff-4b7b-9719-f024284c62d0-config-volume\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:56.119488 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.119364    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c40fbd58-95ff-4b7b-9719-f024284c62d0-tmp-dir\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:56.119488 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.119410    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/628f316e-f572-469a-af90-da94166005b3-installation-pull-secrets\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.119620 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.119497    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a380d9-c1c0-438b-a440-a968c83c2764-cert\") pod \"ingress-canary-h9cdx\" (UID: \"06a380d9-c1c0-438b-a440-a968c83c2764\") " pod="openshift-ingress-canary/ingress-canary-h9cdx"
Jul 02 16:54:56.119663 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.119628    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6571d87-c591-4faa-92bf-51667bd9b37a-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:54:56.220713 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.220628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c40fbd58-95ff-4b7b-9719-f024284c62d0-config-volume\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:56.220713 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.220670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c40fbd58-95ff-4b7b-9719-f024284c62d0-tmp-dir\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:56.220713 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.220705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/628f316e-f572-469a-af90-da94166005b3-installation-pull-secrets\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.220986 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.220733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a380d9-c1c0-438b-a440-a968c83c2764-cert\") pod \"ingress-canary-h9cdx\" (UID: \"06a380d9-c1c0-438b-a440-a968c83c2764\") " pod="openshift-ingress-canary/ingress-canary-h9cdx"
Jul 02 16:54:56.220986 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.220802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/628f316e-f572-469a-af90-da94166005b3-ca-trust-extracted\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.220986 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.220846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/628f316e-f572-469a-af90-da94166005b3-trusted-ca\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.220986 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.220899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.220986 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.220938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:56.221219 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.221017    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 16:54:56.221219 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.221107    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls podName:c40fbd58-95ff-4b7b-9719-f024284c62d0 nodeName:}" failed. No retries permitted until 2026-07-02 16:54:56.721067114 +0000 UTC m=+36.087733074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls") pod "dns-default-rpw8d" (UID: "c40fbd58-95ff-4b7b-9719-f024284c62d0") : secret "dns-default-metrics-tls" not found
Jul 02 16:54:56.221219 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.221195    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 16:54:56.221219 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.221209    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b67fddffc-9z5lv: secret "image-registry-tls" not found
Jul 02 16:54:56.221402 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.221247    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls podName:628f316e-f572-469a-af90-da94166005b3 nodeName:}" failed. No retries permitted until 2026-07-02 16:54:56.721233039 +0000 UTC m=+36.087899001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls") pod "image-registry-b67fddffc-9z5lv" (UID: "628f316e-f572-469a-af90-da94166005b3") : secret "image-registry-tls" not found
Jul 02 16:54:56.221402 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.221283    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/628f316e-f572-469a-af90-da94166005b3-ca-trust-extracted\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.221517 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.221417    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-bound-sa-token\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.221517 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.221418    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c40fbd58-95ff-4b7b-9719-f024284c62d0-config-volume\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:56.221605 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.221573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/628f316e-f572-469a-af90-da94166005b3-image-registry-private-configuration\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.221647 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.221611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cphj\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-kube-api-access-5cphj\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.221647 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.221635    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnrln\" (UniqueName: \"kubernetes.io/projected/c40fbd58-95ff-4b7b-9719-f024284c62d0-kube-api-access-xnrln\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:56.221727 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.221664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6r2g\" (UniqueName: \"kubernetes.io/projected/06a380d9-c1c0-438b-a440-a968c83c2764-kube-api-access-s6r2g\") pod \"ingress-canary-h9cdx\" (UID: \"06a380d9-c1c0-438b-a440-a968c83c2764\") " pod="openshift-ingress-canary/ingress-canary-h9cdx"
Jul 02 16:54:56.221727 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.221690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/628f316e-f572-469a-af90-da94166005b3-registry-certificates\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.221804 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.221763    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c40fbd58-95ff-4b7b-9719-f024284c62d0-tmp-dir\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:56.222238 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.222197    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/628f316e-f572-469a-af90-da94166005b3-registry-certificates\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.222347 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.222323    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/628f316e-f572-469a-af90-da94166005b3-trusted-ca\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.225573 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.225547    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/628f316e-f572-469a-af90-da94166005b3-image-registry-private-configuration\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.225573 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.225557    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/628f316e-f572-469a-af90-da94166005b3-installation-pull-secrets\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.225761 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.225744    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a380d9-c1c0-438b-a440-a968c83c2764-cert\") pod \"ingress-canary-h9cdx\" (UID: \"06a380d9-c1c0-438b-a440-a968c83c2764\") " pod="openshift-ingress-canary/ingress-canary-h9cdx"
Jul 02 16:54:56.232341 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.232316    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-bound-sa-token\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.232613 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.232593    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cphj\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-kube-api-access-5cphj\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.232895 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.232875    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnrln\" (UniqueName: \"kubernetes.io/projected/c40fbd58-95ff-4b7b-9719-f024284c62d0-kube-api-access-xnrln\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:56.244219 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.244188    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6r2g\" (UniqueName: \"kubernetes.io/projected/06a380d9-c1c0-438b-a440-a968c83c2764-kube-api-access-s6r2g\") pod \"ingress-canary-h9cdx\" (UID: \"06a380d9-c1c0-438b-a440-a968c83c2764\") " pod="openshift-ingress-canary/ingress-canary-h9cdx"
Jul 02 16:54:56.315280 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.315241    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h9cdx"
Jul 02 16:54:56.625489 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.625401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:54:56.625649 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.625569    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 16:54:56.625649 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.625636    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert podName:a6571d87-c591-4faa-92bf-51667bd9b37a nodeName:}" failed. No retries permitted until 2026-07-02 16:54:57.625616121 +0000 UTC m=+36.992282106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kvwhg" (UID: "a6571d87-c591-4faa-92bf-51667bd9b37a") : secret "networking-console-plugin-cert" not found
Jul 02 16:54:56.715041 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.715002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:54:56.725903 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.725871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:56.726037 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.725928    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:56.726037 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.725998    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 16:54:56.726037 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.726015    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b67fddffc-9z5lv: secret "image-registry-tls" not found
Jul 02 16:54:56.726278 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.726077    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 16:54:56.726278 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.726102    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls podName:628f316e-f572-469a-af90-da94166005b3 nodeName:}" failed. No retries permitted until 2026-07-02 16:54:57.726070632 +0000 UTC m=+37.092736575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls") pod "image-registry-b67fddffc-9z5lv" (UID: "628f316e-f572-469a-af90-da94166005b3") : secret "image-registry-tls" not found
Jul 02 16:54:56.726278 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:56.726157    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls podName:c40fbd58-95ff-4b7b-9719-f024284c62d0 nodeName:}" failed. No retries permitted until 2026-07-02 16:54:57.726138488 +0000 UTC m=+37.092804430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls") pod "dns-default-rpw8d" (UID: "c40fbd58-95ff-4b7b-9719-f024284c62d0") : secret "dns-default-metrics-tls" not found
Jul 02 16:54:56.727883 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:56.727819    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 16:54:57.135628 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.133056    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h9cdx"]
Jul 02 16:54:57.267398 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:54:57.267315    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a380d9_c1c0_438b_a440_a968c83c2764.slice/crio-76895a01597ff088f082b2a1b3ac80c430ba0616dd59db3c24f82dcb1a2d5129 WatchSource:0}: Error finding container 76895a01597ff088f082b2a1b3ac80c430ba0616dd59db3c24f82dcb1a2d5129: Status 404 returned error can't find the container with id 76895a01597ff088f082b2a1b3ac80c430ba0616dd59db3c24f82dcb1a2d5129
Jul 02 16:54:57.633462 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.633281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:54:57.633628 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:57.633429    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 16:54:57.633628 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:57.633585    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert podName:a6571d87-c591-4faa-92bf-51667bd9b37a nodeName:}" failed. No retries permitted until 2026-07-02 16:54:59.633569053 +0000 UTC m=+39.000234994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kvwhg" (UID: "a6571d87-c591-4faa-92bf-51667bd9b37a") : secret "networking-console-plugin-cert" not found
Jul 02 16:54:57.718102 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.718065    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:54:57.718270 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.718242    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:54:57.720627 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.720605    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 16:54:57.720627 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.720628    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 16:54:57.720827 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.720640    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 16:54:57.720827 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.720678    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6k5zx\""
Jul 02 16:54:57.721475 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.721460    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-442wp\""
Jul 02 16:54:57.733995 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.733974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:57.734117 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.734009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:57.734176 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:57.734139    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 16:54:57.734176 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:57.734153    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b67fddffc-9z5lv: secret "image-registry-tls" not found
Jul 02 16:54:57.734275 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:57.734198    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 16:54:57.734334 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:57.734203    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls podName:628f316e-f572-469a-af90-da94166005b3 nodeName:}" failed. No retries permitted until 2026-07-02 16:54:59.734187747 +0000 UTC m=+39.100853687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls") pod "image-registry-b67fddffc-9z5lv" (UID: "628f316e-f572-469a-af90-da94166005b3") : secret "image-registry-tls" not found
Jul 02 16:54:57.734334 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:57.734319    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls podName:c40fbd58-95ff-4b7b-9719-f024284c62d0 nodeName:}" failed. No retries permitted until 2026-07-02 16:54:59.734299921 +0000 UTC m=+39.100965868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls") pod "dns-default-rpw8d" (UID: "c40fbd58-95ff-4b7b-9719-f024284c62d0") : secret "dns-default-metrics-tls" not found
Jul 02 16:54:57.810809 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.810721    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:54:57.871311 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.871273    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:54:57.874779 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.874753    2579 generic.go:356] "Generic (PLEG): container finished" podID="b8a5c633-0484-4c8b-848e-ff55b708f1f0" containerID="6c3e3b16cd928880715b665baf49d821d7f6c4ed9c5cde23d79f66da48b71bff" exitCode=0
Jul 02 16:54:57.874897 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.874836    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s9sr" event={"ID":"b8a5c633-0484-4c8b-848e-ff55b708f1f0","Type":"ContainerDied","Data":"6c3e3b16cd928880715b665baf49d821d7f6c4ed9c5cde23d79f66da48b71bff"}
Jul 02 16:54:57.875939 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:57.875918    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h9cdx" event={"ID":"06a380d9-c1c0-438b-a440-a968c83c2764","Type":"ContainerStarted","Data":"76895a01597ff088f082b2a1b3ac80c430ba0616dd59db3c24f82dcb1a2d5129"}
Jul 02 16:54:58.762118 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:58.762071    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:54:58.881265 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:58.881223    2579 generic.go:356] "Generic (PLEG): container finished" podID="b8a5c633-0484-4c8b-848e-ff55b708f1f0" containerID="0aad5ab0c0f39232f637f7ddcd6d3bdec1389dc09245466effed1cfa8d52107d" exitCode=0
Jul 02 16:54:58.881265 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:58.881260    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s9sr" event={"ID":"b8a5c633-0484-4c8b-848e-ff55b708f1f0","Type":"ContainerDied","Data":"0aad5ab0c0f39232f637f7ddcd6d3bdec1389dc09245466effed1cfa8d52107d"}
Jul 02 16:54:59.652118 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:59.652062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:54:59.652303 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:59.652195    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 16:54:59.652303 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:59.652263    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert podName:a6571d87-c591-4faa-92bf-51667bd9b37a nodeName:}" failed. No retries permitted until 2026-07-02 16:55:03.652241178 +0000 UTC m=+43.018907132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kvwhg" (UID: "a6571d87-c591-4faa-92bf-51667bd9b37a") : secret "networking-console-plugin-cert" not found
Jul 02 16:54:59.752734 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:59.752694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:54:59.752909 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:59.752749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:54:59.752909 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:59.752861    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 16:54:59.752909 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:59.752867    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 16:54:59.752909 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:59.752890    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b67fddffc-9z5lv: secret "image-registry-tls" not found
Jul 02 16:54:59.753125 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:59.752920    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls podName:c40fbd58-95ff-4b7b-9719-f024284c62d0 nodeName:}" failed. No retries permitted until 2026-07-02 16:55:03.752903113 +0000 UTC m=+43.119569053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls") pod "dns-default-rpw8d" (UID: "c40fbd58-95ff-4b7b-9719-f024284c62d0") : secret "dns-default-metrics-tls" not found
Jul 02 16:54:59.753125 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:54:59.752951    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls podName:628f316e-f572-469a-af90-da94166005b3 nodeName:}" failed. No retries permitted until 2026-07-02 16:55:03.752929632 +0000 UTC m=+43.119595588 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls") pod "image-registry-b67fddffc-9z5lv" (UID: "628f316e-f572-469a-af90-da94166005b3") : secret "image-registry-tls" not found
Jul 02 16:54:59.886758 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:59.886722    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4s9sr" event={"ID":"b8a5c633-0484-4c8b-848e-ff55b708f1f0","Type":"ContainerStarted","Data":"429c3a8bb331ba678be8c96f7c5997aac5d245e261dd3f4564d48c740c189bb7"}
Jul 02 16:54:59.888253 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:59.888230    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h9cdx" event={"ID":"06a380d9-c1c0-438b-a440-a968c83c2764","Type":"ContainerStarted","Data":"08541bdc9acff083fe9e7ed89bc2a9b00d7647f4446c250267ae75123becf25e"}
Jul 02 16:54:59.908563 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:59.908465    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4s9sr" podStartSLOduration=8.810490197 podStartE2EDuration="37.908447115s" totalImagesPullingTime="29.097956918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:54:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:54:59.907250567 +0000 UTC m=+39.273916528" watchObservedRunningTime="2026-07-02 16:54:59.908447115 +0000 UTC m=+39.275113077"
Jul 02 16:54:59.922232 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:54:59.922179    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h9cdx" podStartSLOduration=2.40070183 podStartE2EDuration="4.92215986s" totalImagesPullingTime="2.52145803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:54:59.920347622 +0000 UTC m=+39.287013585" watchObservedRunningTime="2026-07-02 16:54:59.92215986 +0000 UTC m=+39.288825821"
Jul 02 16:55:00.034855 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:00.034792    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:00.085127 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:00.085040    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:00.661440 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:00.661274    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:00.760837 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:00.760792    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:03.683014 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:03.682968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:55:03.683392 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:03.683135    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 16:55:03.683392 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:03.683208    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert podName:a6571d87-c591-4faa-92bf-51667bd9b37a nodeName:}" failed. No retries permitted until 2026-07-02 16:55:11.683192358 +0000 UTC m=+51.049858298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kvwhg" (UID: "a6571d87-c591-4faa-92bf-51667bd9b37a") : secret "networking-console-plugin-cert" not found
Jul 02 16:55:03.783523 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:03.783487    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:55:03.783523 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:03.783528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:55:03.783726 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:03.783631    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 16:55:03.783726 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:03.783662    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 16:55:03.783726 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:03.783681    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls podName:c40fbd58-95ff-4b7b-9719-f024284c62d0 nodeName:}" failed. No retries permitted until 2026-07-02 16:55:11.783668526 +0000 UTC m=+51.150334465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls") pod "dns-default-rpw8d" (UID: "c40fbd58-95ff-4b7b-9719-f024284c62d0") : secret "dns-default-metrics-tls" not found
Jul 02 16:55:03.783726 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:03.783687    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b67fddffc-9z5lv: secret "image-registry-tls" not found
Jul 02 16:55:03.783847 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:03.783737    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls podName:628f316e-f572-469a-af90-da94166005b3 nodeName:}" failed. No retries permitted until 2026-07-02 16:55:11.783718795 +0000 UTC m=+51.150384735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls") pod "image-registry-b67fddffc-9z5lv" (UID: "628f316e-f572-469a-af90-da94166005b3") : secret "image-registry-tls" not found
Jul 02 16:55:05.592058 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:05.592020    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:05.692815 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:05.692775    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:06.200464 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:06.200431    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:06.299399 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:06.299365    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:10.187397 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:10.187358    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:10.242522 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:10.242493    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:11.742254 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:11.742216    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:55:11.742619 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:11.742357    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 16:55:11.742619 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:11.742428    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert podName:a6571d87-c591-4faa-92bf-51667bd9b37a nodeName:}" failed. No retries permitted until 2026-07-02 16:55:27.742411095 +0000 UTC m=+67.109077035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kvwhg" (UID: "a6571d87-c591-4faa-92bf-51667bd9b37a") : secret "networking-console-plugin-cert" not found
Jul 02 16:55:11.843402 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:11.843359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:55:11.843402 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:11.843403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:55:11.843665 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:11.843510    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 16:55:11.843665 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:11.843519    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 16:55:11.843665 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:11.843541    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b67fddffc-9z5lv: secret "image-registry-tls" not found
Jul 02 16:55:11.843665 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:11.843567    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls podName:c40fbd58-95ff-4b7b-9719-f024284c62d0 nodeName:}" failed. No retries permitted until 2026-07-02 16:55:27.843549395 +0000 UTC m=+67.210215358 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls") pod "dns-default-rpw8d" (UID: "c40fbd58-95ff-4b7b-9719-f024284c62d0") : secret "dns-default-metrics-tls" not found
Jul 02 16:55:11.843665 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:11.843607    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls podName:628f316e-f572-469a-af90-da94166005b3 nodeName:}" failed. No retries permitted until 2026-07-02 16:55:27.843589354 +0000 UTC m=+67.210255310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls") pod "image-registry-b67fddffc-9z5lv" (UID: "628f316e-f572-469a-af90-da94166005b3") : secret "image-registry-tls" not found
Jul 02 16:55:13.135214 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:13.135173    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:14.899419 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:14.899385    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:14.953901 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:14.953871    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:21.863377 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:21.863349    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jt4sh"
Jul 02 16:55:22.015709 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:22.015672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:22.114133 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:22.114038    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:26.958459 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:26.958421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:55:26.958970 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:26.958493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:55:26.961054 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:26.961033    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 16:55:26.961183 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:26.961077    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 16:55:26.969114 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:26.969073    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 16:55:26.969188 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:26.969154    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs podName:714f87ed-815d-48a6-a203-a5a4494ddffe nodeName:}" failed. No retries permitted until 2026-07-02 16:56:30.969130616 +0000 UTC m=+130.335796555 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs") pod "network-metrics-daemon-zc26l" (UID: "714f87ed-815d-48a6-a203-a5a4494ddffe") : secret "metrics-daemon-secret" not found
Jul 02 16:55:26.972724 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:26.972694    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d8373671-f624-4725-9b64-6db96ed0414c-original-pull-secret\") pod \"global-pull-secret-syncer-swtkc\" (UID: \"d8373671-f624-4725-9b64-6db96ed0414c\") " pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:55:27.025817 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.025784    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swtkc"
Jul 02 16:55:27.058995 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.058958    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9vj\" (UniqueName: \"kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj\") pod \"network-check-target-nqwj6\" (UID: \"f5908f88-ad5a-44e9-9578-700495383fef\") " pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:55:27.061645 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.061623    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 16:55:27.071390 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.071366    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 16:55:27.082254 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.082228    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w9vj\" (UniqueName: \"kubernetes.io/projected/f5908f88-ad5a-44e9-9578-700495383fef-kube-api-access-7w9vj\") pod \"network-check-target-nqwj6\" (UID: \"f5908f88-ad5a-44e9-9578-700495383fef\") " pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:55:27.136746 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.136715    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-442wp\""
Jul 02 16:55:27.145527 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.145508    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:55:27.148470 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.148445    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-swtkc"]
Jul 02 16:55:27.151969 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:55:27.151945    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8373671_f624_4725_9b64_6db96ed0414c.slice/crio-993dd6213d05d71e28691750ed4350ecad904485503eb35f1464e4945dbcb68f WatchSource:0}: Error finding container 993dd6213d05d71e28691750ed4350ecad904485503eb35f1464e4945dbcb68f: Status 404 returned error can't find the container with id 993dd6213d05d71e28691750ed4350ecad904485503eb35f1464e4945dbcb68f
Jul 02 16:55:27.264029 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.263946    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nqwj6"]
Jul 02 16:55:27.267609 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:55:27.267580    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5908f88_ad5a_44e9_9578_700495383fef.slice/crio-6104d9d428d57509e9e06b6d43b2ee6524865a3533cf0695db4eb66a31c35fdc WatchSource:0}: Error finding container 6104d9d428d57509e9e06b6d43b2ee6524865a3533cf0695db4eb66a31c35fdc: Status 404 returned error can't find the container with id 6104d9d428d57509e9e06b6d43b2ee6524865a3533cf0695db4eb66a31c35fdc
Jul 02 16:55:27.764913 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.764880    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:55:27.765108 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:27.765054    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 16:55:27.765169 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:27.765156    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert podName:a6571d87-c591-4faa-92bf-51667bd9b37a nodeName:}" failed. No retries permitted until 2026-07-02 16:55:59.765132019 +0000 UTC m=+99.131797960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kvwhg" (UID: "a6571d87-c591-4faa-92bf-51667bd9b37a") : secret "networking-console-plugin-cert" not found
Jul 02 16:55:27.865907 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.865869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:55:27.866113 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.865920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:55:27.866113 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:27.866046    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 16:55:27.866113 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:27.866055    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 16:55:27.866113 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:27.866077    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b67fddffc-9z5lv: secret "image-registry-tls" not found
Jul 02 16:55:27.866408 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:27.866129    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls podName:c40fbd58-95ff-4b7b-9719-f024284c62d0 nodeName:}" failed. No retries permitted until 2026-07-02 16:55:59.866106535 +0000 UTC m=+99.232772492 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls") pod "dns-default-rpw8d" (UID: "c40fbd58-95ff-4b7b-9719-f024284c62d0") : secret "dns-default-metrics-tls" not found
Jul 02 16:55:27.866408 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:27.866147    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls podName:628f316e-f572-469a-af90-da94166005b3 nodeName:}" failed. No retries permitted until 2026-07-02 16:55:59.866138945 +0000 UTC m=+99.232804884 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls") pod "image-registry-b67fddffc-9z5lv" (UID: "628f316e-f572-469a-af90-da94166005b3") : secret "image-registry-tls" not found
Jul 02 16:55:27.953894 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.953854    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nqwj6" event={"ID":"f5908f88-ad5a-44e9-9578-700495383fef","Type":"ContainerStarted","Data":"6104d9d428d57509e9e06b6d43b2ee6524865a3533cf0695db4eb66a31c35fdc"}
Jul 02 16:55:27.955171 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:27.955129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-swtkc" event={"ID":"d8373671-f624-4725-9b64-6db96ed0414c","Type":"ContainerStarted","Data":"993dd6213d05d71e28691750ed4350ecad904485503eb35f1464e4945dbcb68f"}
Jul 02 16:55:28.580547 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:28.580505    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:28.643729 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:28.643689    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:30.964537 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:30.964496    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nqwj6" event={"ID":"f5908f88-ad5a-44e9-9578-700495383fef","Type":"ContainerStarted","Data":"54f364c545f54757caef076e8cf5062e60c6ea82f3194230a49625f69282aa8f"}
Jul 02 16:55:30.964992 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:30.964748    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:55:30.979061 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:30.979011    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nqwj6" podStartSLOduration=65.768213289 podStartE2EDuration="1m8.978996772s" totalImagesPullingTime="3.210783483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:55:30.977815059 +0000 UTC m=+70.344481023" watchObservedRunningTime="2026-07-02 16:55:30.978996772 +0000 UTC m=+70.345662733"
Jul 02 16:55:32.970158 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:32.970122    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-swtkc" event={"ID":"d8373671-f624-4725-9b64-6db96ed0414c","Type":"ContainerStarted","Data":"98a33594666f3b4544e37c0f893346c42a1b379531678b7d336a61d252f8da13"}
Jul 02 16:55:32.986429 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:32.986382    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-swtkc" podStartSLOduration=65.653847626 podStartE2EDuration="1m10.986365272s" totalImagesPullingTime="5.332517646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:55:32.985288703 +0000 UTC m=+72.351954665" watchObservedRunningTime="2026-07-02 16:55:32.986365272 +0000 UTC m=+72.353031228"
Jul 02 16:55:33.844291 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:33.844257    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:33.944745 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:33.944718    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:36.092574 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:36.092542    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:36.144455 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:36.144425    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:57.419123 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.419003    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"]
Jul 02 16:55:57.421671 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.421650    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:55:57.424081 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.424060    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 16:55:57.425196 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.425173    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 02 16:55:57.425307 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.425179    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 16:55:57.425307 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.425276    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 16:55:57.434120 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.434074    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"]
Jul 02 16:55:57.487458 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.487423    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps2q5\" (UniqueName: \"kubernetes.io/projected/261389f9-363c-45f2-a933-69705b81f543-kube-api-access-ps2q5\") pod \"klusterlet-addon-workmgr-5ff88977d5-bfr9l\" (UID: \"261389f9-363c-45f2-a933-69705b81f543\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:55:57.487655 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.487495    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/261389f9-363c-45f2-a933-69705b81f543-tmp\") pod \"klusterlet-addon-workmgr-5ff88977d5-bfr9l\" (UID: \"261389f9-363c-45f2-a933-69705b81f543\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:55:57.487655 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.487547    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/261389f9-363c-45f2-a933-69705b81f543-klusterlet-config\") pod \"klusterlet-addon-workmgr-5ff88977d5-bfr9l\" (UID: \"261389f9-363c-45f2-a933-69705b81f543\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:55:57.588015 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.587969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/261389f9-363c-45f2-a933-69705b81f543-tmp\") pod \"klusterlet-addon-workmgr-5ff88977d5-bfr9l\" (UID: \"261389f9-363c-45f2-a933-69705b81f543\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:55:57.588172 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.588036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/261389f9-363c-45f2-a933-69705b81f543-klusterlet-config\") pod \"klusterlet-addon-workmgr-5ff88977d5-bfr9l\" (UID: \"261389f9-363c-45f2-a933-69705b81f543\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:55:57.588172 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.588103    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps2q5\" (UniqueName: \"kubernetes.io/projected/261389f9-363c-45f2-a933-69705b81f543-kube-api-access-ps2q5\") pod \"klusterlet-addon-workmgr-5ff88977d5-bfr9l\" (UID: \"261389f9-363c-45f2-a933-69705b81f543\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:55:57.588483 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.588458    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/261389f9-363c-45f2-a933-69705b81f543-tmp\") pod \"klusterlet-addon-workmgr-5ff88977d5-bfr9l\" (UID: \"261389f9-363c-45f2-a933-69705b81f543\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:55:57.590457 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.590438    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/261389f9-363c-45f2-a933-69705b81f543-klusterlet-config\") pod \"klusterlet-addon-workmgr-5ff88977d5-bfr9l\" (UID: \"261389f9-363c-45f2-a933-69705b81f543\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:55:57.599930 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.599908    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps2q5\" (UniqueName: \"kubernetes.io/projected/261389f9-363c-45f2-a933-69705b81f543-kube-api-access-ps2q5\") pod \"klusterlet-addon-workmgr-5ff88977d5-bfr9l\" (UID: \"261389f9-363c-45f2-a933-69705b81f543\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:55:57.730919 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.730836    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:55:57.847310 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:57.847270    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"]
Jul 02 16:55:57.850189 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:55:57.850156    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261389f9_363c_45f2_a933_69705b81f543.slice/crio-9e105238071370e3148149fe2cace78c6bc27949bd7e4244171f1df7f5d574a1 WatchSource:0}: Error finding container 9e105238071370e3148149fe2cace78c6bc27949bd7e4244171f1df7f5d574a1: Status 404 returned error can't find the container with id 9e105238071370e3148149fe2cace78c6bc27949bd7e4244171f1df7f5d574a1
Jul 02 16:55:58.029461 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:58.029371    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l" event={"ID":"261389f9-363c-45f2-a933-69705b81f543","Type":"ContainerStarted","Data":"9e105238071370e3148149fe2cace78c6bc27949bd7e4244171f1df7f5d574a1"}
Jul 02 16:55:59.623862 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:59.623768    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:59.679040 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:59.679002    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:55:59.808744 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:59.808610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:55:59.808744 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:59.808731    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 16:55:59.808984 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:59.808818    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert podName:a6571d87-c591-4faa-92bf-51667bd9b37a nodeName:}" failed. No retries permitted until 2026-07-02 16:57:03.808798121 +0000 UTC m=+163.175464069 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kvwhg" (UID: "a6571d87-c591-4faa-92bf-51667bd9b37a") : secret "networking-console-plugin-cert" not found
Jul 02 16:55:59.909565 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:59.909466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:55:59.909565 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:55:59.909522    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:55:59.909812 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:59.909638    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 16:55:59.909812 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:59.909645    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 16:55:59.909812 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:59.909668    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b67fddffc-9z5lv: secret "image-registry-tls" not found
Jul 02 16:55:59.909812 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:59.909697    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls podName:c40fbd58-95ff-4b7b-9719-f024284c62d0 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:03.909682342 +0000 UTC m=+163.276348282 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls") pod "dns-default-rpw8d" (UID: "c40fbd58-95ff-4b7b-9719-f024284c62d0") : secret "dns-default-metrics-tls" not found
Jul 02 16:55:59.909812 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:55:59.909722    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls podName:628f316e-f572-469a-af90-da94166005b3 nodeName:}" failed. No retries permitted until 2026-07-02 16:57:03.90970379 +0000 UTC m=+163.276369743 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls") pod "image-registry-b67fddffc-9z5lv" (UID: "628f316e-f572-469a-af90-da94166005b3") : secret "image-registry-tls" not found
Jul 02 16:56:01.969400 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:56:01.969372    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nqwj6"
Jul 02 16:56:03.044628 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:56:03.044589    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l" event={"ID":"261389f9-363c-45f2-a933-69705b81f543","Type":"ContainerStarted","Data":"c7dc5c9f5e3e1723b28c2ecc6407c4d062ad359c2b2a47cf0cdf45b656bf3767"}
Jul 02 16:56:03.045126 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:56:03.044799    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:56:03.046415 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:56:03.046394    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:56:03.060742 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:56:03.060695    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l" podStartSLOduration=1.9014751589999999 podStartE2EDuration="6.060680593s" totalImagesPullingTime="4.159205434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:55:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:56:03.05987213 +0000 UTC m=+102.426538103" watchObservedRunningTime="2026-07-02 16:56:03.060680593 +0000 UTC m=+102.427346555"
Jul 02 16:56:31.034041 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:56:31.033985    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:56:31.034567 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:56:31.034167    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 16:56:31.034567 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:56:31.034230    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs podName:714f87ed-815d-48a6-a203-a5a4494ddffe nodeName:}" failed. No retries permitted until 2026-07-02 16:58:33.034211987 +0000 UTC m=+252.400877943 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs") pod "network-metrics-daemon-zc26l" (UID: "714f87ed-815d-48a6-a203-a5a4494ddffe") : secret "metrics-daemon-secret" not found
Jul 02 16:56:58.959151 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:56:58.959074    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg" podUID="a6571d87-c591-4faa-92bf-51667bd9b37a"
Jul 02 16:56:58.984844 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:56:58.984813    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv" podUID="628f316e-f572-469a-af90-da94166005b3"
Jul 02 16:56:58.998946 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:56:58.998917    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rpw8d" podUID="c40fbd58-95ff-4b7b-9719-f024284c62d0"
Jul 02 16:56:59.173666 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:56:59.173629    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:56:59.173666 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:56:59.173657    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:56:59.173854 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:56:59.173766    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:57:00.728681 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:57:00.728634    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:57:03.862382 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:57:03.862340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:57:03.862866 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:57:03.862446    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 16:57:03.862866 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:57:03.862498    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert podName:a6571d87-c591-4faa-92bf-51667bd9b37a nodeName:}" failed. No retries permitted until 2026-07-02 16:59:05.862484456 +0000 UTC m=+285.229150396 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kvwhg" (UID: "a6571d87-c591-4faa-92bf-51667bd9b37a") : secret "networking-console-plugin-cert" not found
Jul 02 16:57:03.962820 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:57:03.962779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:57:03.962820 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:57:03.962822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:57:03.963031 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:57:03.962921    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 16:57:03.963031 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:57:03.962925    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 16:57:03.963031 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:57:03.962943    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b67fddffc-9z5lv: secret "image-registry-tls" not found
Jul 02 16:57:03.963031 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:57:03.962985    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls podName:c40fbd58-95ff-4b7b-9719-f024284c62d0 nodeName:}" failed. No retries permitted until 2026-07-02 16:59:05.962970712 +0000 UTC m=+285.329636651 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls") pod "dns-default-rpw8d" (UID: "c40fbd58-95ff-4b7b-9719-f024284c62d0") : secret "dns-default-metrics-tls" not found
Jul 02 16:57:03.963031 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:57:03.963002    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls podName:628f316e-f572-469a-af90-da94166005b3 nodeName:}" failed. No retries permitted until 2026-07-02 16:59:05.96299404 +0000 UTC m=+285.329659982 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls") pod "image-registry-b67fddffc-9z5lv" (UID: "628f316e-f572-469a-af90-da94166005b3") : secret "image-registry-tls" not found
Jul 02 16:57:13.715227 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:57:13.715148    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:57:27.940851 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:57:27.940819    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:02.319987 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:02.319950    2579 generic.go:356] "Generic (PLEG): container finished" podID="261389f9-363c-45f2-a933-69705b81f543" containerID="c7dc5c9f5e3e1723b28c2ecc6407c4d062ad359c2b2a47cf0cdf45b656bf3767" exitCode=1
Jul 02 16:58:02.320410 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:02.320022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l" event={"ID":"261389f9-363c-45f2-a933-69705b81f543","Type":"ContainerDied","Data":"c7dc5c9f5e3e1723b28c2ecc6407c4d062ad359c2b2a47cf0cdf45b656bf3767"}
Jul 02 16:58:02.320410 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:02.320350    2579 scope.go:117] "RemoveContainer" containerID="c7dc5c9f5e3e1723b28c2ecc6407c4d062ad359c2b2a47cf0cdf45b656bf3767"
Jul 02 16:58:03.045041 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:03.045012    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:58:03.324313 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:03.324231    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l" event={"ID":"261389f9-363c-45f2-a933-69705b81f543","Type":"ContainerStarted","Data":"be8677c7a6c04e089c48aebd701743b051946967ae9c8563d55d6e39b6019c02"}
Jul 02 16:58:03.324661 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:03.324524    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:58:03.325134 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:03.325119    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ff88977d5-bfr9l"
Jul 02 16:58:28.423028 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.422988    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"]
Jul 02 16:58:28.425065 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.425043    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:28.427993 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.427972    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 02 16:58:28.428763 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.428748    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 16:58:28.429524 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.429507    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 16:58:28.430772 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.430747    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 02 16:58:28.430772 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.430756    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t2xzs\""
Jul 02 16:58:28.434879 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.434857    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"]
Jul 02 16:58:28.473287 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.473252    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5vkb\" (UniqueName: \"kubernetes.io/projected/08dfb488-85a2-4599-a684-0442227de015-kube-api-access-r5vkb\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:28.473427 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.473331    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/08dfb488-85a2-4599-a684-0442227de015-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:28.473427 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.473378    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:28.574427 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.574389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/08dfb488-85a2-4599-a684-0442227de015-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:28.574626 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.574446    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:28.574626 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:28.574541    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 16:58:28.574626 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:28.574590    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls podName:08dfb488-85a2-4599-a684-0442227de015 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:29.074572653 +0000 UTC m=+248.441238593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-5m7vl" (UID: "08dfb488-85a2-4599-a684-0442227de015") : secret "cluster-monitoring-operator-tls" not found
Jul 02 16:58:28.574626 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.574604    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5vkb\" (UniqueName: \"kubernetes.io/projected/08dfb488-85a2-4599-a684-0442227de015-kube-api-access-r5vkb\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:28.575243 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.575220    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/08dfb488-85a2-4599-a684-0442227de015-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:28.583673 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.583647    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5vkb\" (UniqueName: \"kubernetes.io/projected/08dfb488-85a2-4599-a684-0442227de015-kube-api-access-r5vkb\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:28.618742 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.618707    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8c4776ff9-lqj2x"]
Jul 02 16:58:28.620719 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.620699    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.623155 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.623136    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 02 16:58:28.623245 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.623188    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 02 16:58:28.623302 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.623188    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 02 16:58:28.623433 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.623398    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 02 16:58:28.623555 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.623440    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 16:58:28.623608 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.623596    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tmdg6\""
Jul 02 16:58:28.623650 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.623617    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 16:58:28.635517 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.635486    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8c4776ff9-lqj2x"]
Jul 02 16:58:28.675201 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.675124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-default-certificate\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.675201 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.675162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khphm\" (UniqueName: \"kubernetes.io/projected/655210e2-330f-496d-a2c1-f8c0f6a34eff-kube-api-access-khphm\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.675367 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.675234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.675367 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.675302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.675367 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.675322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-stats-auth\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.741937 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.741906    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:28.776083 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.776036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-default-certificate\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.776083 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.776098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khphm\" (UniqueName: \"kubernetes.io/projected/655210e2-330f-496d-a2c1-f8c0f6a34eff-kube-api-access-khphm\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.776313 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.776141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.776313 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.776180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.776313 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.776196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-stats-auth\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.776313 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:28.776293    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 16:58:28.776482 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:28.776333    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle podName:655210e2-330f-496d-a2c1-f8c0f6a34eff nodeName:}" failed. No retries permitted until 2026-07-02 16:58:29.276316428 +0000 UTC m=+248.642982368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle") pod "router-default-8c4776ff9-lqj2x" (UID: "655210e2-330f-496d-a2c1-f8c0f6a34eff") : configmap references non-existent config key: service-ca.crt
Jul 02 16:58:28.776482 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:28.776364    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs podName:655210e2-330f-496d-a2c1-f8c0f6a34eff nodeName:}" failed. No retries permitted until 2026-07-02 16:58:29.276345623 +0000 UTC m=+248.643011585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs") pod "router-default-8c4776ff9-lqj2x" (UID: "655210e2-330f-496d-a2c1-f8c0f6a34eff") : secret "router-metrics-certs-default" not found
Jul 02 16:58:28.778513 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.778491    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-stats-auth\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.778610 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.778542    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-default-certificate\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.785736 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.785716    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khphm\" (UniqueName: \"kubernetes.io/projected/655210e2-330f-496d-a2c1-f8c0f6a34eff-kube-api-access-khphm\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:28.844131 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:28.844073    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:29.078216 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:29.078122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:29.078367 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:29.078268    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 16:58:29.078367 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:29.078328    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls podName:08dfb488-85a2-4599-a684-0442227de015 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:30.078313284 +0000 UTC m=+249.444979224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-5m7vl" (UID: "08dfb488-85a2-4599-a684-0442227de015") : secret "cluster-monitoring-operator-tls" not found
Jul 02 16:58:29.280203 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:29.280172    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:29.280385 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:29.280250    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:29.280385 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:29.280343    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle podName:655210e2-330f-496d-a2c1-f8c0f6a34eff nodeName:}" failed. No retries permitted until 2026-07-02 16:58:30.280327039 +0000 UTC m=+249.646992978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle") pod "router-default-8c4776ff9-lqj2x" (UID: "655210e2-330f-496d-a2c1-f8c0f6a34eff") : configmap references non-existent config key: service-ca.crt
Jul 02 16:58:29.280385 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:29.280357    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 16:58:29.280503 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:29.280397    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs podName:655210e2-330f-496d-a2c1-f8c0f6a34eff nodeName:}" failed. No retries permitted until 2026-07-02 16:58:30.280385546 +0000 UTC m=+249.647051485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs") pod "router-default-8c4776ff9-lqj2x" (UID: "655210e2-330f-496d-a2c1-f8c0f6a34eff") : secret "router-metrics-certs-default" not found
Jul 02 16:58:30.087437 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:30.087401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:30.087813 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:30.087549    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 16:58:30.087813 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:30.087612    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls podName:08dfb488-85a2-4599-a684-0442227de015 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:32.087594896 +0000 UTC m=+251.454260844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-5m7vl" (UID: "08dfb488-85a2-4599-a684-0442227de015") : secret "cluster-monitoring-operator-tls" not found
Jul 02 16:58:30.289065 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:30.289010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:30.289260 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:30.289105    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:30.289260 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:30.289175    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 16:58:30.289260 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:30.289241    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs podName:655210e2-330f-496d-a2c1-f8c0f6a34eff nodeName:}" failed. No retries permitted until 2026-07-02 16:58:32.289224858 +0000 UTC m=+251.655890798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs") pod "router-default-8c4776ff9-lqj2x" (UID: "655210e2-330f-496d-a2c1-f8c0f6a34eff") : secret "router-metrics-certs-default" not found
Jul 02 16:58:30.289260 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:30.289257    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle podName:655210e2-330f-496d-a2c1-f8c0f6a34eff nodeName:}" failed. No retries permitted until 2026-07-02 16:58:32.289250377 +0000 UTC m=+251.655916317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle") pod "router-default-8c4776ff9-lqj2x" (UID: "655210e2-330f-496d-a2c1-f8c0f6a34eff") : configmap references non-existent config key: service-ca.crt
Jul 02 16:58:31.047714 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:31.047676    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:31.105233 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:31.105200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:32.105273 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:32.105223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:32.105685 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:32.105353    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 16:58:32.105685 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:32.105413    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls podName:08dfb488-85a2-4599-a684-0442227de015 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:36.105399142 +0000 UTC m=+255.472065081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-5m7vl" (UID: "08dfb488-85a2-4599-a684-0442227de015") : secret "cluster-monitoring-operator-tls" not found
Jul 02 16:58:32.306504 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:32.306470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:32.306653 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:32.306527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:32.306653 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:32.306611    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 16:58:32.306747 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:32.306671    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs podName:655210e2-330f-496d-a2c1-f8c0f6a34eff nodeName:}" failed. No retries permitted until 2026-07-02 16:58:36.306657321 +0000 UTC m=+255.673323261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs") pod "router-default-8c4776ff9-lqj2x" (UID: "655210e2-330f-496d-a2c1-f8c0f6a34eff") : secret "router-metrics-certs-default" not found
Jul 02 16:58:32.306747 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:32.306686    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle podName:655210e2-330f-496d-a2c1-f8c0f6a34eff nodeName:}" failed. No retries permitted until 2026-07-02 16:58:36.306680172 +0000 UTC m=+255.673346112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle") pod "router-default-8c4776ff9-lqj2x" (UID: "655210e2-330f-496d-a2c1-f8c0f6a34eff") : configmap references non-existent config key: service-ca.crt
Jul 02 16:58:32.969478 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:32.969443    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:33.048805 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.048742    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:33.112949 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.112912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:58:33.113334 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:33.113043    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 16:58:33.113334 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:33.113110    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs podName:714f87ed-815d-48a6-a203-a5a4494ddffe nodeName:}" failed. No retries permitted until 2026-07-02 17:00:35.113078273 +0000 UTC m=+374.479744212 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs") pod "network-metrics-daemon-zc26l" (UID: "714f87ed-815d-48a6-a203-a5a4494ddffe") : secret "metrics-daemon-secret" not found
Jul 02 16:58:33.149003 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.148957    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:33.240884 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.240763    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:33.299659 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.299632    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:33.664483 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.664453    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7kzsz"]
Jul 02 16:58:33.666735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.666720    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:33.669262 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.669238    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 16:58:33.669389 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.669357    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pdlkg\""
Jul 02 16:58:33.669483 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.669467    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 16:58:33.670168 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.670151    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 16:58:33.670263 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.670158    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 16:58:33.683776 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.683757    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7kzsz"]
Jul 02 16:58:33.718843 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.718819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chd8j\" (UniqueName: \"kubernetes.io/projected/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-api-access-chd8j\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:33.718996 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.718854    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:33.718996 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.718894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-data-volume\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:33.718996 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.718952    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:33.718996 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.718975    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-crio-socket\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:33.721293 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.721268    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:33.819746 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.819715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:33.819882 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.819753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-crio-socket\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:33.819882 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.819831    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-crio-socket\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:33.819882 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.819843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chd8j\" (UniqueName: \"kubernetes.io/projected/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-api-access-chd8j\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:33.820019 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:33.819887    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 16:58:33.820019 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:33.819948    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm podName:7e9bb8ca-29eb-4599-9830-a5dc1ebd6656 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:34.319929646 +0000 UTC m=+253.686595586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7kzsz" (UID: "7e9bb8ca-29eb-4599-9830-a5dc1ebd6656") : configmap "kube-rbac-proxy" not found
Jul 02 16:58:33.820019 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.819965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:33.820161 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.820037    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-data-volume\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:33.820161 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:33.820077    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 16:58:33.820161 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:33.820152    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls podName:7e9bb8ca-29eb-4599-9830-a5dc1ebd6656 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:34.320138947 +0000 UTC m=+253.686804896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7kzsz" (UID: "7e9bb8ca-29eb-4599-9830-a5dc1ebd6656") : secret "insights-runtime-extractor-tls" not found
Jul 02 16:58:33.820373 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.820356    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-data-volume\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:33.827962 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:33.827938    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chd8j\" (UniqueName: \"kubernetes.io/projected/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-api-access-chd8j\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:34.052301 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:34.052217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:34.154359 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:34.154309    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:34.328669 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:34.328574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:34.328819 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:34.328699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:34.328819 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:34.328729    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 16:58:34.328819 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:34.328791    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls podName:7e9bb8ca-29eb-4599-9830-a5dc1ebd6656 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:35.328775752 +0000 UTC m=+254.695441695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7kzsz" (UID: "7e9bb8ca-29eb-4599-9830-a5dc1ebd6656") : secret "insights-runtime-extractor-tls" not found
Jul 02 16:58:34.328938 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:34.328823    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 16:58:34.328938 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:34.328880    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm podName:7e9bb8ca-29eb-4599-9830-a5dc1ebd6656 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:35.328865905 +0000 UTC m=+254.695531866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7kzsz" (UID: "7e9bb8ca-29eb-4599-9830-a5dc1ebd6656") : configmap "kube-rbac-proxy" not found
Jul 02 16:58:34.490074 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:34.490006    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:34.546482 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:34.546452    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:34.758781 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:34.758752    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:34.859120 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:34.859068    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:35.081478 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:35.081368    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:35.182393 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:35.182359    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:35.335772 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:35.335743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:35.335907 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:35.335812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:35.335907 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:35.335866    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 16:58:35.335978 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:35.335933    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm podName:7e9bb8ca-29eb-4599-9830-a5dc1ebd6656 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:37.33591755 +0000 UTC m=+256.702583490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7kzsz" (UID: "7e9bb8ca-29eb-4599-9830-a5dc1ebd6656") : configmap "kube-rbac-proxy" not found
Jul 02 16:58:35.335978 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:35.335938    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 16:58:35.336048 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:35.335981    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls podName:7e9bb8ca-29eb-4599-9830-a5dc1ebd6656 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:37.335967773 +0000 UTC m=+256.702633713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7kzsz" (UID: "7e9bb8ca-29eb-4599-9830-a5dc1ebd6656") : secret "insights-runtime-extractor-tls" not found
Jul 02 16:58:36.142618 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.142581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:36.142784 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:36.142727    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 16:58:36.142829 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:36.142790    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls podName:08dfb488-85a2-4599-a684-0442227de015 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:44.142775281 +0000 UTC m=+263.509441222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-5m7vl" (UID: "08dfb488-85a2-4599-a684-0442227de015") : secret "cluster-monitoring-operator-tls" not found
Jul 02 16:58:36.344362 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.344327    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"]
Jul 02 16:58:36.344737 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.344479    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:36.344737 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.344598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:36.344737 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:36.344658    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle podName:655210e2-330f-496d-a2c1-f8c0f6a34eff nodeName:}" failed. No retries permitted until 2026-07-02 16:58:44.344635236 +0000 UTC m=+263.711301176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle") pod "router-default-8c4776ff9-lqj2x" (UID: "655210e2-330f-496d-a2c1-f8c0f6a34eff") : configmap references non-existent config key: service-ca.crt
Jul 02 16:58:36.344737 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:36.344734    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 16:58:36.344893 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:36.344784    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs podName:655210e2-330f-496d-a2c1-f8c0f6a34eff nodeName:}" failed. No retries permitted until 2026-07-02 16:58:44.344770841 +0000 UTC m=+263.711436792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs") pod "router-default-8c4776ff9-lqj2x" (UID: "655210e2-330f-496d-a2c1-f8c0f6a34eff") : secret "router-metrics-certs-default" not found
Jul 02 16:58:36.346570 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.346553    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"
Jul 02 16:58:36.349054 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.349033    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 02 16:58:36.349757 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.349742    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 02 16:58:36.349757 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.349755    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gsqw4\""
Jul 02 16:58:36.349913 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.349794    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 02 16:58:36.349913 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.349860    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 02 16:58:36.356356 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.356333    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"]
Jul 02 16:58:36.403731 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.403654    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:36.445818 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.445782    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/647644c5-cf38-48c0-afe4-200b02e1c635-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-7cb48\" (UID: \"647644c5-cf38-48c0-afe4-200b02e1c635\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"
Jul 02 16:58:36.445952 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.445911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zw7f\" (UniqueName: \"kubernetes.io/projected/647644c5-cf38-48c0-afe4-200b02e1c635-kube-api-access-6zw7f\") pod \"service-ca-7bb4f4bcc7-7cb48\" (UID: \"647644c5-cf38-48c0-afe4-200b02e1c635\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"
Jul 02 16:58:36.446017 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.445974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/647644c5-cf38-48c0-afe4-200b02e1c635-signing-key\") pod \"service-ca-7bb4f4bcc7-7cb48\" (UID: \"647644c5-cf38-48c0-afe4-200b02e1c635\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"
Jul 02 16:58:36.456383 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.456359    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dx4cb_85311435-e62b-48b9-9137-6875ceb51bc4/dns-node-resolver/0.log"
Jul 02 16:58:36.504786 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.504758    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:36.547381 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.547352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zw7f\" (UniqueName: \"kubernetes.io/projected/647644c5-cf38-48c0-afe4-200b02e1c635-kube-api-access-6zw7f\") pod \"service-ca-7bb4f4bcc7-7cb48\" (UID: \"647644c5-cf38-48c0-afe4-200b02e1c635\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"
Jul 02 16:58:36.547496 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.547439    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/647644c5-cf38-48c0-afe4-200b02e1c635-signing-key\") pod \"service-ca-7bb4f4bcc7-7cb48\" (UID: \"647644c5-cf38-48c0-afe4-200b02e1c635\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"
Jul 02 16:58:36.547556 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.547507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/647644c5-cf38-48c0-afe4-200b02e1c635-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-7cb48\" (UID: \"647644c5-cf38-48c0-afe4-200b02e1c635\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"
Jul 02 16:58:36.548061 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.548043    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/647644c5-cf38-48c0-afe4-200b02e1c635-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-7cb48\" (UID: \"647644c5-cf38-48c0-afe4-200b02e1c635\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"
Jul 02 16:58:36.549953 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.549932    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/647644c5-cf38-48c0-afe4-200b02e1c635-signing-key\") pod \"service-ca-7bb4f4bcc7-7cb48\" (UID: \"647644c5-cf38-48c0-afe4-200b02e1c635\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"
Jul 02 16:58:36.555350 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.555322    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zw7f\" (UniqueName: \"kubernetes.io/projected/647644c5-cf38-48c0-afe4-200b02e1c635-kube-api-access-6zw7f\") pod \"service-ca-7bb4f4bcc7-7cb48\" (UID: \"647644c5-cf38-48c0-afe4-200b02e1c635\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"
Jul 02 16:58:36.655633 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.655551    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"
Jul 02 16:58:36.776483 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:36.776452    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-7cb48"]
Jul 02 16:58:36.780008 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:58:36.779981    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647644c5_cf38_48c0_afe4_200b02e1c635.slice/crio-3fd1cbff50a1ff8181a3e0976669dc930fb97586dac284e93c88f35f2c36cd8c WatchSource:0}: Error finding container 3fd1cbff50a1ff8181a3e0976669dc930fb97586dac284e93c88f35f2c36cd8c: Status 404 returned error can't find the container with id 3fd1cbff50a1ff8181a3e0976669dc930fb97586dac284e93c88f35f2c36cd8c
Jul 02 16:58:37.265137 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:37.265104    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:37.354909 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:37.354869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:37.355384 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:37.355018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:37.355384 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:37.355047    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 16:58:37.355384 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:37.355143    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 16:58:37.355384 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:37.355172    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls podName:7e9bb8ca-29eb-4599-9830-a5dc1ebd6656 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:41.355152612 +0000 UTC m=+260.721818552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7kzsz" (UID: "7e9bb8ca-29eb-4599-9830-a5dc1ebd6656") : secret "insights-runtime-extractor-tls" not found
Jul 02 16:58:37.355384 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:37.355203    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm podName:7e9bb8ca-29eb-4599-9830-a5dc1ebd6656 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:41.355184699 +0000 UTC m=+260.721850645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7kzsz" (UID: "7e9bb8ca-29eb-4599-9830-a5dc1ebd6656") : configmap "kube-rbac-proxy" not found
Jul 02 16:58:37.405538 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:37.405498    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48" event={"ID":"647644c5-cf38-48c0-afe4-200b02e1c635","Type":"ContainerStarted","Data":"3fd1cbff50a1ff8181a3e0976669dc930fb97586dac284e93c88f35f2c36cd8c"}
Jul 02 16:58:37.657355 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:37.657327    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p5xzd_978620fb-7c70-433b-9de0-7ebbdf96f064/node-ca/0.log"
Jul 02 16:58:38.456668 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:38.456638    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h9cdx_06a380d9-c1c0-438b-a440-a968c83c2764/serve-healthcheck-canary/0.log"
Jul 02 16:58:39.416425 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:39.416387    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48" event={"ID":"647644c5-cf38-48c0-afe4-200b02e1c635","Type":"ContainerStarted","Data":"1de7a1c9f50040f4225da4ddd874ac5dfb6d078f27b72dc7cc4569a3be2e6570"}
Jul 02 16:58:39.434125 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:39.434056    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-7cb48" podStartSLOduration=1.384222221 podStartE2EDuration="3.434039708s" totalImagesPullingTime="2.049817487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:58:39.433284774 +0000 UTC m=+258.799950761" watchObservedRunningTime="2026-07-02 16:58:39.434039708 +0000 UTC m=+258.800705670"
Jul 02 16:58:39.738049 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:39.737933    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:39.927342 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:39.927304    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:39.984990 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:39.984952    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:40.082972 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:40.082888    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:40.182745 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:40.182712    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:40.509995 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:40.509966    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:40.838298 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:40.838268    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:41.389522 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:41.389479    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:41.389686 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:41.389574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:41.389686 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:41.389605    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 16:58:41.389686 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:41.389678    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm podName:7e9bb8ca-29eb-4599-9830-a5dc1ebd6656 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:49.389663315 +0000 UTC m=+268.756329255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7kzsz" (UID: "7e9bb8ca-29eb-4599-9830-a5dc1ebd6656") : configmap "kube-rbac-proxy" not found
Jul 02 16:58:41.389793 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:41.389691    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 16:58:41.389793 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:41.389742    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls podName:7e9bb8ca-29eb-4599-9830-a5dc1ebd6656 nodeName:}" failed. No retries permitted until 2026-07-02 16:58:49.389724758 +0000 UTC m=+268.756390699 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7kzsz" (UID: "7e9bb8ca-29eb-4599-9830-a5dc1ebd6656") : secret "insights-runtime-extractor-tls" not found
Jul 02 16:58:41.443999 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:41.443968    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:41.643793 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:41.643709    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:42.037313 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:42.037234    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:42.238583 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:42.238554    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:42.839622 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:42.839591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:43.369259 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:43.369182    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:43.470296 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:43.470268    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:43.636289 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:43.636197    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:43.705810 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:43.705780    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:44.038322 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:44.038233    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:44.214669 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:44.214622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:58:44.214862 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:44.214759    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 16:58:44.214862 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:44.214835    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls podName:08dfb488-85a2-4599-a684-0442227de015 nodeName:}" failed. No retries permitted until 2026-07-02 16:59:00.214818583 +0000 UTC m=+279.581484528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-5m7vl" (UID: "08dfb488-85a2-4599-a684-0442227de015") : secret "cluster-monitoring-operator-tls" not found
Jul 02 16:58:44.241651 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:44.241618    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:44.416765 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:44.416728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:44.417153 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:44.416827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:44.417153 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:44.417025    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle podName:655210e2-330f-496d-a2c1-f8c0f6a34eff nodeName:}" failed. No retries permitted until 2026-07-02 16:59:00.417005993 +0000 UTC m=+279.783671951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle") pod "router-default-8c4776ff9-lqj2x" (UID: "655210e2-330f-496d-a2c1-f8c0f6a34eff") : configmap references non-existent config key: service-ca.crt
Jul 02 16:58:44.419103 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:44.419067    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655210e2-330f-496d-a2c1-f8c0f6a34eff-metrics-certs\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:58:44.638198 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:44.638163    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:45.240244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:45.240212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:45.634355 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:45.634323    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:45.833849 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:45.833815    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:46.055148 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:46.055024    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:46.239323 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:46.239286    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:46.435551 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:46.435516    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:46.638769 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:46.638739    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:47.042800 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:47.042765    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:47.832265 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:47.832231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:48.033657 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:48.033621    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:48.239284 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:48.239247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:48.438929 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:48.438899    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:48.920220 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:48.920178    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:49.443283 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:49.443245    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:49.460384 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:49.460353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:49.460528 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:49.460412    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:49.460574 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:49.460532    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 16:58:49.460605 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:58:49.460596    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls podName:7e9bb8ca-29eb-4599-9830-a5dc1ebd6656 nodeName:}" failed. No retries permitted until 2026-07-02 16:59:05.460578202 +0000 UTC m=+284.827244144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7kzsz" (UID: "7e9bb8ca-29eb-4599-9830-a5dc1ebd6656") : secret "insights-runtime-extractor-tls" not found
Jul 02 16:58:49.460908 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:49.460888    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:58:49.839027 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:49.838995    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:50.071320 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:50.071279    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:50.260418 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:50.260332    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:50.437832 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:50.437806    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:55.178521 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:55.178490    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:55.279493 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:55.279462    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:56.977149 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:56.977120    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:58:57.079853 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:58:57.079824    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:00.245727 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:00.245667    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:59:00.248166 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:00.248138    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/08dfb488-85a2-4599-a684-0442227de015-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-5m7vl\" (UID: \"08dfb488-85a2-4599-a684-0442227de015\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:59:00.447102 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:00.447048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:59:00.447648 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:00.447626    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/655210e2-330f-496d-a2c1-f8c0f6a34eff-service-ca-bundle\") pod \"router-default-8c4776ff9-lqj2x\" (UID: \"655210e2-330f-496d-a2c1-f8c0f6a34eff\") " pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:59:00.534031 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:00.533941    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"
Jul 02 16:59:00.656203 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:00.656163    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl"]
Jul 02 16:59:00.660041 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:59:00.660016    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08dfb488_85a2_4599_a684_0442227de015.slice/crio-6aafb25ff39a3b1faf2342ccebfa0080ed7bc1fcbc9bcdc58c9d9f91a941800e WatchSource:0}: Error finding container 6aafb25ff39a3b1faf2342ccebfa0080ed7bc1fcbc9bcdc58c9d9f91a941800e: Status 404 returned error can't find the container with id 6aafb25ff39a3b1faf2342ccebfa0080ed7bc1fcbc9bcdc58c9d9f91a941800e
Jul 02 16:59:00.729657 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:00.729624    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:59:00.850528 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:00.850494    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8c4776ff9-lqj2x"]
Jul 02 16:59:00.853426 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:59:00.853391    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655210e2_330f_496d_a2c1_f8c0f6a34eff.slice/crio-09a3f12bf49e63ee91f066664d663fbcd4b21e7b5d5757df4c121212c9f8874b WatchSource:0}: Error finding container 09a3f12bf49e63ee91f066664d663fbcd4b21e7b5d5757df4c121212c9f8874b: Status 404 returned error can't find the container with id 09a3f12bf49e63ee91f066664d663fbcd4b21e7b5d5757df4c121212c9f8874b
Jul 02 16:59:01.479463 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:01.479427    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8c4776ff9-lqj2x" event={"ID":"655210e2-330f-496d-a2c1-f8c0f6a34eff","Type":"ContainerStarted","Data":"194d8a27a314f643a371eacf52377f242f603078a064cc5e7c598a3ce13c5587"}
Jul 02 16:59:01.479943 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:01.479487    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8c4776ff9-lqj2x" event={"ID":"655210e2-330f-496d-a2c1-f8c0f6a34eff","Type":"ContainerStarted","Data":"09a3f12bf49e63ee91f066664d663fbcd4b21e7b5d5757df4c121212c9f8874b"}
Jul 02 16:59:01.480791 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:01.480759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl" event={"ID":"08dfb488-85a2-4599-a684-0442227de015","Type":"ContainerStarted","Data":"6aafb25ff39a3b1faf2342ccebfa0080ed7bc1fcbc9bcdc58c9d9f91a941800e"}
Jul 02 16:59:01.500766 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:01.500704    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-8c4776ff9-lqj2x" podStartSLOduration=33.500684223 podStartE2EDuration="33.500684223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:01.499836865 +0000 UTC m=+280.866502827" watchObservedRunningTime="2026-07-02 16:59:01.500684223 +0000 UTC m=+280.867350166"
Jul 02 16:59:01.730627 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:01.730542    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:59:01.733178 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:01.733149    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:59:02.174711 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:59:02.174663    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rpw8d" podUID="c40fbd58-95ff-4b7b-9719-f024284c62d0"
Jul 02 16:59:02.174711 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:59:02.174663    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg" podUID="a6571d87-c591-4faa-92bf-51667bd9b37a"
Jul 02 16:59:02.174960 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:59:02.174679    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv" podUID="628f316e-f572-469a-af90-da94166005b3"
Jul 02 16:59:02.483244 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:02.483219    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:59:02.483607 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:02.483219    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:59:02.483607 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:02.483219    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:59:02.483607 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:02.483522    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:59:02.484697 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:02.484678    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8c4776ff9-lqj2x"
Jul 02 16:59:02.766225 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:02.766143    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:02.865025 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:02.864994    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:02.958975 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:02.955384    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:03.175723 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:03.175680    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:03.487067 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:03.486973    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl" event={"ID":"08dfb488-85a2-4599-a684-0442227de015","Type":"ContainerStarted","Data":"bc14629fc09e0e15024e88d2155e836ea9eb2a816d337a304db76c4a958a38d1"}
Jul 02 16:59:03.503914 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:03.503859    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl" podStartSLOduration=33.726611866 podStartE2EDuration="35.503842673s" totalImagesPullingTime="1.777230807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:03.503711664 +0000 UTC m=+282.870377624" watchObservedRunningTime="2026-07-02 16:59:03.503842673 +0000 UTC m=+282.870508636"
Jul 02 16:59:05.488199 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.488155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:59:05.490484 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.490455    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e9bb8ca-29eb-4599-9830-a5dc1ebd6656-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7kzsz\" (UID: \"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656\") " pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:59:05.775533 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.775443    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7kzsz"
Jul 02 16:59:05.890933 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.890898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:59:05.893321 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.893285    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6571d87-c591-4faa-92bf-51667bd9b37a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kvwhg\" (UID: \"a6571d87-c591-4faa-92bf-51667bd9b37a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:59:05.898523 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.898491    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7kzsz"]
Jul 02 16:59:05.901242 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:59:05.901216    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9bb8ca_29eb_4599_9830_a5dc1ebd6656.slice/crio-133e278e5fdb263627b8cfc869d2c524f3aafd43db0ea839398ca3a8df189cc1 WatchSource:0}: Error finding container 133e278e5fdb263627b8cfc869d2c524f3aafd43db0ea839398ca3a8df189cc1: Status 404 returned error can't find the container with id 133e278e5fdb263627b8cfc869d2c524f3aafd43db0ea839398ca3a8df189cc1
Jul 02 16:59:05.948409 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.948369    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:05.979742 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.979711    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-xvrft"]
Jul 02 16:59:05.982298 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.982281    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:05.984939 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.984879    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 02 16:59:05.984939 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.984911    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 02 16:59:05.984939 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.984924    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 16:59:05.985182 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.985175    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mmdfw\""
Jul 02 16:59:05.991490 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.991468    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:59:05.991612 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.991508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:59:05.993914 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.993885    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c40fbd58-95ff-4b7b-9719-f024284c62d0-metrics-tls\") pod \"dns-default-rpw8d\" (UID: \"c40fbd58-95ff-4b7b-9719-f024284c62d0\") " pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:59:05.994050 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.994033    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") pod \"image-registry-b67fddffc-9z5lv\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") " pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:59:05.994656 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:05.994640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-xvrft"]
Jul 02 16:59:06.048205 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.048128    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:06.087032 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.087008    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cm9q4\""
Jul 02 16:59:06.087220 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.087066    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s9rkj\""
Jul 02 16:59:06.087220 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.087157    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mmn65\""
Jul 02 16:59:06.092398 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.092374    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66b2a413-8337-457b-8c09-d8d3f71d1282-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-xvrft\" (UID: \"66b2a413-8337-457b-8c09-d8d3f71d1282\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:06.092520 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.092416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66b2a413-8337-457b-8c09-d8d3f71d1282-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-xvrft\" (UID: \"66b2a413-8337-457b-8c09-d8d3f71d1282\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:06.092520 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.092448    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdlw9\" (UniqueName: \"kubernetes.io/projected/66b2a413-8337-457b-8c09-d8d3f71d1282-kube-api-access-zdlw9\") pod \"prometheus-operator-7b7d896497-xvrft\" (UID: \"66b2a413-8337-457b-8c09-d8d3f71d1282\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:06.092520 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.092479    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/66b2a413-8337-457b-8c09-d8d3f71d1282-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-xvrft\" (UID: \"66b2a413-8337-457b-8c09-d8d3f71d1282\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:06.095429 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.095408    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:59:06.095483 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.095448    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:59:06.095522 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.095495    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"
Jul 02 16:59:06.150537 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.150063    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:06.193187 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.193112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66b2a413-8337-457b-8c09-d8d3f71d1282-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-xvrft\" (UID: \"66b2a413-8337-457b-8c09-d8d3f71d1282\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:06.193187 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.193167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66b2a413-8337-457b-8c09-d8d3f71d1282-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-xvrft\" (UID: \"66b2a413-8337-457b-8c09-d8d3f71d1282\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:06.193319 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.193206    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdlw9\" (UniqueName: \"kubernetes.io/projected/66b2a413-8337-457b-8c09-d8d3f71d1282-kube-api-access-zdlw9\") pod \"prometheus-operator-7b7d896497-xvrft\" (UID: \"66b2a413-8337-457b-8c09-d8d3f71d1282\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:06.193770 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.193647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/66b2a413-8337-457b-8c09-d8d3f71d1282-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-xvrft\" (UID: \"66b2a413-8337-457b-8c09-d8d3f71d1282\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:06.194161 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.194137    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66b2a413-8337-457b-8c09-d8d3f71d1282-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-xvrft\" (UID: \"66b2a413-8337-457b-8c09-d8d3f71d1282\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:06.196481 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.196460    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66b2a413-8337-457b-8c09-d8d3f71d1282-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-xvrft\" (UID: \"66b2a413-8337-457b-8c09-d8d3f71d1282\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:06.196931 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.196895    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/66b2a413-8337-457b-8c09-d8d3f71d1282-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-xvrft\" (UID: \"66b2a413-8337-457b-8c09-d8d3f71d1282\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:06.202709 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.202683    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdlw9\" (UniqueName: \"kubernetes.io/projected/66b2a413-8337-457b-8c09-d8d3f71d1282-kube-api-access-zdlw9\") pod \"prometheus-operator-7b7d896497-xvrft\" (UID: \"66b2a413-8337-457b-8c09-d8d3f71d1282\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:06.240986 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:59:06.240930    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6571d87_c591_4faa_92bf_51667bd9b37a.slice/crio-3d91c12b30781ebd3e5bfaccb5583572ccd622940367b27179c75c0dccb43a7c WatchSource:0}: Error finding container 3d91c12b30781ebd3e5bfaccb5583572ccd622940367b27179c75c0dccb43a7c: Status 404 returned error can't find the container with id 3d91c12b30781ebd3e5bfaccb5583572ccd622940367b27179c75c0dccb43a7c
Jul 02 16:59:06.242118 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.242075    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg"]
Jul 02 16:59:06.258880 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.258843    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rpw8d"]
Jul 02 16:59:06.262167 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:59:06.262074    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40fbd58_95ff_4b7b_9719_f024284c62d0.slice/crio-022c1d8df2c658aee0f284f2b2a97ec036d9b8067f83a6273f6b39e70f31828a WatchSource:0}: Error finding container 022c1d8df2c658aee0f284f2b2a97ec036d9b8067f83a6273f6b39e70f31828a: Status 404 returned error can't find the container with id 022c1d8df2c658aee0f284f2b2a97ec036d9b8067f83a6273f6b39e70f31828a
Jul 02 16:59:06.275372 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.275345    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b67fddffc-9z5lv"]
Jul 02 16:59:06.278479 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:59:06.278450    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628f316e_f572_469a_af90_da94166005b3.slice/crio-3cc8780b56bad687c60cd3c336c6d9a09e1d802ef4a3e2906ee3889265efe019 WatchSource:0}: Error finding container 3cc8780b56bad687c60cd3c336c6d9a09e1d802ef4a3e2906ee3889265efe019: Status 404 returned error can't find the container with id 3cc8780b56bad687c60cd3c336c6d9a09e1d802ef4a3e2906ee3889265efe019
Jul 02 16:59:06.292272 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.292250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft"
Jul 02 16:59:06.465146 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.465109    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-xvrft"]
Jul 02 16:59:06.470285 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:59:06.470244    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b2a413_8337_457b_8c09_d8d3f71d1282.slice/crio-bd2f5b8c93e6bc9f0702fdc59c39ebaa49529401d1c0c08879df1dab8ba3d90e WatchSource:0}: Error finding container bd2f5b8c93e6bc9f0702fdc59c39ebaa49529401d1c0c08879df1dab8ba3d90e: Status 404 returned error can't find the container with id bd2f5b8c93e6bc9f0702fdc59c39ebaa49529401d1c0c08879df1dab8ba3d90e
Jul 02 16:59:06.499898 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.499340    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft" event={"ID":"66b2a413-8337-457b-8c09-d8d3f71d1282","Type":"ContainerStarted","Data":"bd2f5b8c93e6bc9f0702fdc59c39ebaa49529401d1c0c08879df1dab8ba3d90e"}
Jul 02 16:59:06.502281 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.502223    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg" event={"ID":"a6571d87-c591-4faa-92bf-51667bd9b37a","Type":"ContainerStarted","Data":"3d91c12b30781ebd3e5bfaccb5583572ccd622940367b27179c75c0dccb43a7c"}
Jul 02 16:59:06.503718 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.503691    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rpw8d" event={"ID":"c40fbd58-95ff-4b7b-9719-f024284c62d0","Type":"ContainerStarted","Data":"022c1d8df2c658aee0f284f2b2a97ec036d9b8067f83a6273f6b39e70f31828a"}
Jul 02 16:59:06.505511 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.505476    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7kzsz" event={"ID":"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656","Type":"ContainerStarted","Data":"133e278e5fdb263627b8cfc869d2c524f3aafd43db0ea839398ca3a8df189cc1"}
Jul 02 16:59:06.508598 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.508513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv" event={"ID":"628f316e-f572-469a-af90-da94166005b3","Type":"ContainerStarted","Data":"fe636e86ad730be16d3e0086d1d8937402e0477a5b0642cc480befef9a9ef2bb"}
Jul 02 16:59:06.508598 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.508554    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv" event={"ID":"628f316e-f572-469a-af90-da94166005b3","Type":"ContainerStarted","Data":"3cc8780b56bad687c60cd3c336c6d9a09e1d802ef4a3e2906ee3889265efe019"}
Jul 02 16:59:06.508774 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.508707    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:59:06.528800 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:06.528734    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv" podStartSLOduration=284.528710821 podStartE2EDuration="4m44.528710821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:06.527500178 +0000 UTC m=+285.894166141" watchObservedRunningTime="2026-07-02 16:59:06.528710821 +0000 UTC m=+285.895376784"
Jul 02 16:59:10.983316 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:10.983233    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:11.534994 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:11.534953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft" event={"ID":"66b2a413-8337-457b-8c09-d8d3f71d1282","Type":"ContainerStarted","Data":"c0ac0c153e010cc1e08cc23ae465c2746c0657d2c39b23206b39fb3866260a1f"}
Jul 02 16:59:11.535177 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:11.535018    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft" event={"ID":"66b2a413-8337-457b-8c09-d8d3f71d1282","Type":"ContainerStarted","Data":"3ea84b4960dba763820fd03aa253ea863f0caa96a6c69eb5aa33bd28c2a72531"}
Jul 02 16:59:11.536380 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:11.536356    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg" event={"ID":"a6571d87-c591-4faa-92bf-51667bd9b37a","Type":"ContainerStarted","Data":"770b6e45ef6c21b03d41c62586ed47b5323d2ab0c1b64781417ef9bc3dfc73cf"}
Jul 02 16:59:11.538345 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:11.538321    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rpw8d" event={"ID":"c40fbd58-95ff-4b7b-9719-f024284c62d0","Type":"ContainerStarted","Data":"4368d3d98d2e45295640c47dcbe08af60479b1a51309ea5cad11dfbcfb8163a3"}
Jul 02 16:59:11.538472 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:11.538371    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:59:11.538472 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:11.538395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rpw8d" event={"ID":"c40fbd58-95ff-4b7b-9719-f024284c62d0","Type":"ContainerStarted","Data":"7c7382548b1a1768de30034409e20fc770497a8de66bfc24b07cc0bda62a2551"}
Jul 02 16:59:11.540119 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:11.540082    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7kzsz" event={"ID":"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656","Type":"ContainerStarted","Data":"3bbf130796595db7832de5f78742f2d112d1264b8f6c8cc93e1ecec25f4067cd"}
Jul 02 16:59:11.540220 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:11.540145    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7kzsz" event={"ID":"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656","Type":"ContainerStarted","Data":"6c3237b17db6a8480bced0da4a5f2d26da9df2955aa4afc2a6a7e5a1aa7557f7"}
Jul 02 16:59:11.551662 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:11.551550    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-xvrft" podStartSLOduration=2.377096328 podStartE2EDuration="6.55153402s" totalImagesPullingTime="4.174437692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:11.551268914 +0000 UTC m=+290.917934889" watchObservedRunningTime="2026-07-02 16:59:11.55153402 +0000 UTC m=+290.918199983"
Jul 02 16:59:11.567814 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:11.567767    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rpw8d" podStartSLOduration=252.18217826 podStartE2EDuration="4m16.567752411s" totalImagesPullingTime="4.385574151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:11.567024231 +0000 UTC m=+290.933690193" watchObservedRunningTime="2026-07-02 16:59:11.567752411 +0000 UTC m=+290.934418372"
Jul 02 16:59:11.581789 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:11.581744    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kvwhg" podStartSLOduration=278.175476794 podStartE2EDuration="4m42.581729909s" totalImagesPullingTime="4.406253115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:11.580966979 +0000 UTC m=+290.947632942" watchObservedRunningTime="2026-07-02 16:59:11.581729909 +0000 UTC m=+290.948395905"
Jul 02 16:59:11.677821 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:11.677751    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:11.735887 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:11.735828    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:13.088075 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:13.088036    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:13.477264 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:13.477231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:14.553757 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:14.553724    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 16:59:14.554191 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:14.553771    2579 generic.go:356] "Generic (PLEG): container finished" podID="08dfb488-85a2-4599-a684-0442227de015" containerID="bc14629fc09e0e15024e88d2155e836ea9eb2a816d337a304db76c4a958a38d1" exitCode=2
Jul 02 16:59:14.554191 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:14.553849    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl" event={"ID":"08dfb488-85a2-4599-a684-0442227de015","Type":"ContainerDied","Data":"bc14629fc09e0e15024e88d2155e836ea9eb2a816d337a304db76c4a958a38d1"}
Jul 02 16:59:14.554292 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:14.554239    2579 scope.go:117] "RemoveContainer" containerID="bc14629fc09e0e15024e88d2155e836ea9eb2a816d337a304db76c4a958a38d1"
Jul 02 16:59:14.556017 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:14.555995    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7kzsz" event={"ID":"7e9bb8ca-29eb-4599-9830-a5dc1ebd6656","Type":"ContainerStarted","Data":"b60358617bb67869660778a3d0b7e2757b98a03c96124f1d5e2e8d1bcc9feb77"}
Jul 02 16:59:14.585521 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:14.585475    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7kzsz" podStartSLOduration=33.684846532 podStartE2EDuration="41.585460499s" totalImagesPullingTime="7.900613967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:58:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:14.584366339 +0000 UTC m=+293.951032301" watchObservedRunningTime="2026-07-02 16:59:14.585460499 +0000 UTC m=+293.952126462"
Jul 02 16:59:15.560779 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:15.560754    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 16:59:15.561163 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:15.560868    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-5m7vl" event={"ID":"08dfb488-85a2-4599-a684-0442227de015","Type":"ContainerStarted","Data":"178518d7eccaaa25a985f197fdc99902ff64046a74f8182f835565072b6f3cc2"}
Jul 02 16:59:16.715863 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:59:16.715820    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zc26l" podUID="714f87ed-815d-48a6-a203-a5a4494ddffe"
Jul 02 16:59:18.100505 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.100471    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:18.112668 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.112636    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"]
Jul 02 16:59:18.116029 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.116013    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.118456 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.118435    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 02 16:59:18.118456 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.118446    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-m4mwp\""
Jul 02 16:59:18.118630 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.118445    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 02 16:59:18.126285 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.126268    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"]
Jul 02 16:59:18.137325 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.137304    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-tstdl"]
Jul 02 16:59:18.140407 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.140386    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.142712 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.142688    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-w9879\""
Jul 02 16:59:18.142826 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.142760    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 02 16:59:18.143037 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.143021    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 02 16:59:18.143184 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.143168    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 02 16:59:18.149831 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.149796    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-tstdl"]
Jul 02 16:59:18.191729 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.191681    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.191918 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.191738    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-metrics-client-ca\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.191918 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.191774    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc1065c8-948c-4b09-9773-4df6b1625147-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-hfkmc\" (UID: \"cc1065c8-948c-4b09-9773-4df6b1625147\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.191918 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.191802    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.191918 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.191842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.192157 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.191921    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc1065c8-948c-4b09-9773-4df6b1625147-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-hfkmc\" (UID: \"cc1065c8-948c-4b09-9773-4df6b1625147\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.192157 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.191958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.192157 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.191988    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fck25\" (UniqueName: \"kubernetes.io/projected/cc1065c8-948c-4b09-9773-4df6b1625147-kube-api-access-fck25\") pod \"openshift-state-metrics-57f99c8b49-hfkmc\" (UID: \"cc1065c8-948c-4b09-9773-4df6b1625147\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.192157 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.192015    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs725\" (UniqueName: \"kubernetes.io/projected/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-kube-api-access-qs725\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.192157 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.192042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc1065c8-948c-4b09-9773-4df6b1625147-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-hfkmc\" (UID: \"cc1065c8-948c-4b09-9773-4df6b1625147\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.200352 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.200323    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:18.290396 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.290357    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l772g"]
Jul 02 16:59:18.292457 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.292420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fck25\" (UniqueName: \"kubernetes.io/projected/cc1065c8-948c-4b09-9773-4df6b1625147-kube-api-access-fck25\") pod \"openshift-state-metrics-57f99c8b49-hfkmc\" (UID: \"cc1065c8-948c-4b09-9773-4df6b1625147\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.292555 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.292464    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs725\" (UniqueName: \"kubernetes.io/projected/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-kube-api-access-qs725\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.292555 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.292492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc1065c8-948c-4b09-9773-4df6b1625147-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-hfkmc\" (UID: \"cc1065c8-948c-4b09-9773-4df6b1625147\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.292696 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.292558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.292696 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.292582    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-metrics-client-ca\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.292696 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.292613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc1065c8-948c-4b09-9773-4df6b1625147-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-hfkmc\" (UID: \"cc1065c8-948c-4b09-9773-4df6b1625147\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.292696 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.292627    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:18.292934 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.292637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.292934 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.292774    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.292934 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.292865    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc1065c8-948c-4b09-9773-4df6b1625147-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-hfkmc\" (UID: \"cc1065c8-948c-4b09-9773-4df6b1625147\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.292934 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.292912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.293157 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.292983    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.293348 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.293323    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc1065c8-948c-4b09-9773-4df6b1625147-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-hfkmc\" (UID: \"cc1065c8-948c-4b09-9773-4df6b1625147\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.293664 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.293648    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.293833 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.293808    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.293904 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.293671    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-metrics-client-ca\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.295856 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.295834    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc1065c8-948c-4b09-9773-4df6b1625147-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-hfkmc\" (UID: \"cc1065c8-948c-4b09-9773-4df6b1625147\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.295937 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.295883    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc1065c8-948c-4b09-9773-4df6b1625147-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-hfkmc\" (UID: \"cc1065c8-948c-4b09-9773-4df6b1625147\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.296128 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.296074    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.296539 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.296505    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.296645 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.296545    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 16:59:18.296645 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.296562    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 16:59:18.296752 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.296699    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4v478\""
Jul 02 16:59:18.297112 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.297076    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 16:59:18.309630 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.309585    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs725\" (UniqueName: \"kubernetes.io/projected/ab5b6d7d-84bc-42de-8b74-1bb0cd717799-kube-api-access-qs725\") pod \"kube-state-metrics-845b954455-tstdl\" (UID: \"ab5b6d7d-84bc-42de-8b74-1bb0cd717799\") " pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.309739 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.309632    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fck25\" (UniqueName: \"kubernetes.io/projected/cc1065c8-948c-4b09-9773-4df6b1625147-kube-api-access-fck25\") pod \"openshift-state-metrics-57f99c8b49-hfkmc\" (UID: \"cc1065c8-948c-4b09-9773-4df6b1625147\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.369821 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.369745    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:18.394139 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.394105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0391dec-f56f-436d-8391-5575bb04d923-metrics-client-ca\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.394263 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.394170    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0391dec-f56f-436d-8391-5575bb04d923-root\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.394263 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.394210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-wtmp\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.394376 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.394305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0391dec-f56f-436d-8391-5575bb04d923-sys\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.394376 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.394330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-tls\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.394376 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.394349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcl48\" (UniqueName: \"kubernetes.io/projected/b0391dec-f56f-436d-8391-5575bb04d923-kube-api-access-wcl48\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.394525 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.394382    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-textfile\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.394525 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.394404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-accelerators-collector-config\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.394525 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.394427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.425008 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.424980    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"
Jul 02 16:59:18.449968 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.449930    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl"
Jul 02 16:59:18.494919 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.494887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0391dec-f56f-436d-8391-5575bb04d923-metrics-client-ca\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.495074 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.494939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0391dec-f56f-436d-8391-5575bb04d923-root\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.495074 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.494988    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-wtmp\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.495074 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.495053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0391dec-f56f-436d-8391-5575bb04d923-sys\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.495248 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.495077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-tls\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.495248 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.495120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcl48\" (UniqueName: \"kubernetes.io/projected/b0391dec-f56f-436d-8391-5575bb04d923-kube-api-access-wcl48\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.495248 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.495152    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-textfile\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.495248 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.495180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-accelerators-collector-config\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.495248 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.495217    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.497710 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.496607    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:18.497710 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.497137    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-wtmp\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.497710 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.497195    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0391dec-f56f-436d-8391-5575bb04d923-root\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.497710 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.497239    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0391dec-f56f-436d-8391-5575bb04d923-sys\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.497710 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:59:18.497341    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 16:59:18.497710 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:59:18.497430    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-tls podName:b0391dec-f56f-436d-8391-5575bb04d923 nodeName:}" failed. No retries permitted until 2026-07-02 16:59:18.997411397 +0000 UTC m=+298.364077338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-tls") pod "node-exporter-l772g" (UID: "b0391dec-f56f-436d-8391-5575bb04d923") : secret "node-exporter-tls" not found
Jul 02 16:59:18.498875 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.498265    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-textfile\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.498875 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.498629    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-accelerators-collector-config\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.498875 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.498681    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0391dec-f56f-436d-8391-5575bb04d923-metrics-client-ca\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.500568 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.500533    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.506850 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.506765    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcl48\" (UniqueName: \"kubernetes.io/projected/b0391dec-f56f-436d-8391-5575bb04d923-kube-api-access-wcl48\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:18.598863 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.598778    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc"]
Jul 02 16:59:18.602295 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:59:18.602264    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1065c8_948c_4b09_9773_4df6b1625147.slice/crio-106fe5cc175f5425768aee578118db4324790b70e29d8952442e37f10b472c12 WatchSource:0}: Error finding container 106fe5cc175f5425768aee578118db4324790b70e29d8952442e37f10b472c12: Status 404 returned error can't find the container with id 106fe5cc175f5425768aee578118db4324790b70e29d8952442e37f10b472c12
Jul 02 16:59:18.619459 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.619248    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-tstdl"]
Jul 02 16:59:18.621261 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:59:18.621228    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab5b6d7d_84bc_42de_8b74_1bb0cd717799.slice/crio-4b55bc8c6294d0713c5a5e44e2adfd49cd77870793188f8e92a89a24a2799de5 WatchSource:0}: Error finding container 4b55bc8c6294d0713c5a5e44e2adfd49cd77870793188f8e92a89a24a2799de5: Status 404 returned error can't find the container with id 4b55bc8c6294d0713c5a5e44e2adfd49cd77870793188f8e92a89a24a2799de5
Jul 02 16:59:18.949077 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:18.948969    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:19.000324 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:19.000286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-tls\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:19.002713 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:19.002696    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0391dec-f56f-436d-8391-5575bb04d923-node-exporter-tls\") pod \"node-exporter-l772g\" (UID: \"b0391dec-f56f-436d-8391-5575bb04d923\") " pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:19.049641 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:19.049605    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:19.189080 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:19.189001    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:19.222833 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:19.222751    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l772g"
Jul 02 16:59:19.236398 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:59:19.236355    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0391dec_f56f_436d_8391_5575bb04d923.slice/crio-2e7175b9332d2cb1376041f4f7e7236de45489a445ae955c527467b614217f77 WatchSource:0}: Error finding container 2e7175b9332d2cb1376041f4f7e7236de45489a445ae955c527467b614217f77: Status 404 returned error can't find the container with id 2e7175b9332d2cb1376041f4f7e7236de45489a445ae955c527467b614217f77
Jul 02 16:59:19.290404 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:19.290350    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:19.389288 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:19.389234    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:19.491267 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:19.491162    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:19.581289 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:19.581249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l772g" event={"ID":"b0391dec-f56f-436d-8391-5575bb04d923","Type":"ContainerStarted","Data":"2e7175b9332d2cb1376041f4f7e7236de45489a445ae955c527467b614217f77"}
Jul 02 16:59:19.582837 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:19.582793    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl" event={"ID":"ab5b6d7d-84bc-42de-8b74-1bb0cd717799","Type":"ContainerStarted","Data":"4b55bc8c6294d0713c5a5e44e2adfd49cd77870793188f8e92a89a24a2799de5"}
Jul 02 16:59:19.585029 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:19.585003    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc" event={"ID":"cc1065c8-948c-4b09-9773-4df6b1625147","Type":"ContainerStarted","Data":"386119d25d855ecf046726125b1f7544d15b330151c57570e840a2ac8c752721"}
Jul 02 16:59:19.585158 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:19.585060    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc" event={"ID":"cc1065c8-948c-4b09-9773-4df6b1625147","Type":"ContainerStarted","Data":"4167b52e455bdbd7aff9afab83500c038ff05e960fea5a66360f2b7f282a4ade"}
Jul 02 16:59:19.585158 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:19.585104    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc" event={"ID":"cc1065c8-948c-4b09-9773-4df6b1625147","Type":"ContainerStarted","Data":"106fe5cc175f5425768aee578118db4324790b70e29d8952442e37f10b472c12"}
Jul 02 16:59:20.595201 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:20.595131    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l772g" event={"ID":"b0391dec-f56f-436d-8391-5575bb04d923","Type":"ContainerStarted","Data":"3bce6a4223e2a7f33607b8e9c6a52cb5e466db3820fdddc3eac4e1d5b1a3f00a"}
Jul 02 16:59:20.598063 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:20.598020    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl" event={"ID":"ab5b6d7d-84bc-42de-8b74-1bb0cd717799","Type":"ContainerStarted","Data":"00d40e4edc1d138daca5cb0fcab156ecc7e321663f7feda246dfdff73035de47"}
Jul 02 16:59:20.602239 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:20.602192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc" event={"ID":"cc1065c8-948c-4b09-9773-4df6b1625147","Type":"ContainerStarted","Data":"ca892e6df4ef6af1415b38519067ddfc861ef79ec221be64547dbba80a4f6d59"}
Jul 02 16:59:20.638556 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:20.638497    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-hfkmc" podStartSLOduration=0.893000078 podStartE2EDuration="2.638473967s" totalImagesPullingTime="1.745473889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:20.636783907 +0000 UTC m=+300.003449870" watchObservedRunningTime="2026-07-02 16:59:20.638473967 +0000 UTC m=+300.005139930"
Jul 02 16:59:21.150689 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:21.150651    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:21.251369 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:21.251320    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:21.547273 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:21.547192    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rpw8d"
Jul 02 16:59:21.607303 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:21.607270    2579 generic.go:356] "Generic (PLEG): container finished" podID="b0391dec-f56f-436d-8391-5575bb04d923" containerID="3bce6a4223e2a7f33607b8e9c6a52cb5e466db3820fdddc3eac4e1d5b1a3f00a" exitCode=0
Jul 02 16:59:21.607733 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:21.607308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l772g" event={"ID":"b0391dec-f56f-436d-8391-5575bb04d923","Type":"ContainerDied","Data":"3bce6a4223e2a7f33607b8e9c6a52cb5e466db3820fdddc3eac4e1d5b1a3f00a"}
Jul 02 16:59:21.618911 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:21.618824    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl" event={"ID":"ab5b6d7d-84bc-42de-8b74-1bb0cd717799","Type":"ContainerStarted","Data":"37843d83bdb3acfe3b9353182d44e27ad85801a9e5d07a1dd6c7955ccceb2d93"}
Jul 02 16:59:21.618911 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:21.618884    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl" event={"ID":"ab5b6d7d-84bc-42de-8b74-1bb0cd717799","Type":"ContainerStarted","Data":"5c8863bc7971b231e24eb2f532cdac371354f3b3d84a14a706c3b4ff9fe535a0"}
Jul 02 16:59:21.623888 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:21.623113    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:21.654018 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:21.653971    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-tstdl" podStartSLOduration=1.788712384 podStartE2EDuration="3.653955069s" totalImagesPullingTime="1.865242685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:21.652822873 +0000 UTC m=+301.019488839" watchObservedRunningTime="2026-07-02 16:59:21.653955069 +0000 UTC m=+301.020621008"
Jul 02 16:59:21.674823 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:21.674797    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 16:59:21.674960 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:21.674809    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 16:59:21.691052 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:21.691031    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 16:59:22.360472 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:22.360437    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:22.461079 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:22.461036    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:22.524659 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:22.524615    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:22.624199 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:22.624117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l772g" event={"ID":"b0391dec-f56f-436d-8391-5575bb04d923","Type":"ContainerStarted","Data":"68e2e7a6ebd5bdf25c7551bfc58209f1a3d968c2da060db9a3ce79296a145667"}
Jul 02 16:59:22.624199 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:22.624177    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l772g" event={"ID":"b0391dec-f56f-436d-8391-5575bb04d923","Type":"ContainerStarted","Data":"82ffeea34e20406c75b0342209a1f875208da7f58de5b058ff5b52924e11856a"}
Jul 02 16:59:22.643350 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:22.643299    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l772g" podStartSLOduration=3.303599258 podStartE2EDuration="4.643280574s" totalImagesPullingTime="1.253047482s" totalInitContainerRuntime="86.633834ms" isStatefulPod=true podCreationTimestamp="2026-07-02 16:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:22.641711011 +0000 UTC m=+302.008376973" watchObservedRunningTime="2026-07-02 16:59:22.643280574 +0000 UTC m=+302.009946537"
Jul 02 16:59:23.047065 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:23.046970    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:24.563775 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:24.563729    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:25.790744 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:25.790715    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:25.888319 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:25.888289    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:25.988880 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:25.988851    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:26.100002 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:26.099965    2579 patch_prober.go:28] interesting pod/image-registry-b67fddffc-9z5lv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 16:59:26.100196 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:26.100018    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv" podUID="628f316e-f572-469a-af90-da94166005b3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 16:59:26.150234 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:26.150207    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:26.252240 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:26.252213    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:26.328083 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:26.328054    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:26.674646 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:26.674613    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:26.856420 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:26.856391    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:27.048713 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:27.048619    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:27.462961 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:27.462930    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:27.519531 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:27.519509    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:59:27.657846 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:27.657820    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:27.715894 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:27.715803    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:27.927577 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:27.927538    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:28.278539 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:28.278504    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:29.116532 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:29.116497    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b67fddffc-9z5lv"]
Jul 02 16:59:29.184134 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:29.184083    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:29.285645 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:29.285610    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:29.686581 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:29.686548    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:29.745441 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:29.745409    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:29.900594 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:29.900565    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:29.956928 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:29.956857    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:30.664979 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:30.664944    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:30.714775 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:30.714740    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 16:59:30.715784 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:30.715760    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:31.409019 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.408982    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79b4fb886d-wnnsc"]
Jul 02 16:59:31.413324 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.413296    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.416073 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.416046    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 16:59:31.416284 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.416194    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7gxdm\""
Jul 02 16:59:31.416284 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.416195    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 16:59:31.416875 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.416854    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 16:59:31.416875 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.416860    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 16:59:31.417036 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.416914    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 16:59:31.417127 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.417067    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 16:59:31.417231 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.417210    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 16:59:31.423767 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.423738    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79b4fb886d-wnnsc"]
Jul 02 16:59:31.515440 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.515405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-service-ca\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.515617 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.515494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-oauth-serving-cert\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.515617 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.515546    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-config\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.515709 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.515628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-oauth-config\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.515709 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.515658    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-serving-cert\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.515709 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.515683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66tb6\" (UniqueName: \"kubernetes.io/projected/ed388748-4134-41d9-974f-b0aa6c5c1c97-kube-api-access-66tb6\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.616669 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.616633    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-oauth-config\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.617183 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.616906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-serving-cert\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.617432 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.617406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66tb6\" (UniqueName: \"kubernetes.io/projected/ed388748-4134-41d9-974f-b0aa6c5c1c97-kube-api-access-66tb6\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.617503 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.617477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-service-ca\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.617608 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.617593    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-oauth-serving-cert\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.617669 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.617651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-config\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.618450 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.618426    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-config\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.619395 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.619365    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-service-ca\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.623376 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.620144    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-oauth-config\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.623376 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.620309    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-serving-cert\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.624550 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.624526    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-oauth-serving-cert\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.628704 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.628681    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66tb6\" (UniqueName: \"kubernetes.io/projected/ed388748-4134-41d9-974f-b0aa6c5c1c97-kube-api-access-66tb6\") pod \"console-79b4fb886d-wnnsc\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") " pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.724735 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.724652    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:31.854331 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.854304    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79b4fb886d-wnnsc"]
Jul 02 16:59:31.856723 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:59:31.856691    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded388748_4134_41d9_974f_b0aa6c5c1c97.slice/crio-2d30b0abb7c98d6e25d3e554ec4ac90b07e9a39b7cd9cd46b3024e70158a0281 WatchSource:0}: Error finding container 2d30b0abb7c98d6e25d3e554ec4ac90b07e9a39b7cd9cd46b3024e70158a0281: Status 404 returned error can't find the container with id 2d30b0abb7c98d6e25d3e554ec4ac90b07e9a39b7cd9cd46b3024e70158a0281
Jul 02 16:59:31.858798 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:31.858778    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 16:59:32.113253 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:32.113226    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:32.165175 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:32.165138    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:32.661811 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:32.661775    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b4fb886d-wnnsc" event={"ID":"ed388748-4134-41d9-974f-b0aa6c5c1c97","Type":"ContainerStarted","Data":"2d30b0abb7c98d6e25d3e554ec4ac90b07e9a39b7cd9cd46b3024e70158a0281"}
Jul 02 16:59:35.673857 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:35.673823    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b4fb886d-wnnsc" event={"ID":"ed388748-4134-41d9-974f-b0aa6c5c1c97","Type":"ContainerStarted","Data":"bd23e16cd6e986b1d559eabc8839e86cb275e8e6935dac61303f24db27a3c4b4"}
Jul 02 16:59:35.693025 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:35.692972    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79b4fb886d-wnnsc" podStartSLOduration=1.88781074 podStartE2EDuration="4.692955099s" totalImagesPullingTime="2.805144359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:35.692395372 +0000 UTC m=+315.059061334" watchObservedRunningTime="2026-07-02 16:59:35.692955099 +0000 UTC m=+315.059621060"
Jul 02 16:59:38.978011 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:38.977962    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:39.077633 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:39.077598    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:39.478195 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:39.478159    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:39.541596 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:39.541557    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:39.683215 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:39.683184    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:39.737963 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:39.737885    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:40.069770 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.069694    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d79bf7d4c-8d2tz"]
Jul 02 16:59:40.182158 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.182125    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:40.192924 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.192897    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d79bf7d4c-8d2tz"]
Jul 02 16:59:40.193051 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.192989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.200535 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.200514    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 16:59:40.239185 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.239153    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:40.291358 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.291322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-service-ca\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.291358 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.291358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-config\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.291545 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.291418    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-serving-cert\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.291545 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.291456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-oauth-serving-cert\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.291545 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.291488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-oauth-config\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.291545 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.291502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-trusted-ca-bundle\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.291668 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.291566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcvxw\" (UniqueName: \"kubernetes.io/projected/af1fb9db-4e24-432d-a6d9-cb313c86c9af-kube-api-access-qcvxw\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.392641 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.392605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-oauth-serving-cert\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.392842 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.392652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-oauth-config\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.392842 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.392674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-trusted-ca-bundle\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.392842 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.392723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcvxw\" (UniqueName: \"kubernetes.io/projected/af1fb9db-4e24-432d-a6d9-cb313c86c9af-kube-api-access-qcvxw\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.392842 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.392780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-service-ca\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.392842 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.392805    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-config\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.393124 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.392877    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-serving-cert\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.393528 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.393499    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-oauth-serving-cert\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.393712 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.393569    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-trusted-ca-bundle\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.393712 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.393603    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-service-ca\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.393844 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.393618    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-config\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.395334 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.395314    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-oauth-config\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.395430 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.395413    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-serving-cert\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.405005 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.404975    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcvxw\" (UniqueName: \"kubernetes.io/projected/af1fb9db-4e24-432d-a6d9-cb313c86c9af-kube-api-access-qcvxw\") pod \"console-7d79bf7d4c-8d2tz\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") " pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.502254 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.502218    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:40.661241 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.661217    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d79bf7d4c-8d2tz"]
Jul 02 16:59:40.663471 ip-10-0-130-131 kubenswrapper[2579]: W0702 16:59:40.663440    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1fb9db_4e24_432d_a6d9_cb313c86c9af.slice/crio-61f3fe5618c5b7552f3f8b3072522a699baabf11f4663d617b77f2f94d03383d WatchSource:0}: Error finding container 61f3fe5618c5b7552f3f8b3072522a699baabf11f4663d617b77f2f94d03383d: Status 404 returned error can't find the container with id 61f3fe5618c5b7552f3f8b3072522a699baabf11f4663d617b77f2f94d03383d
Jul 02 16:59:40.699771 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:40.699741    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d79bf7d4c-8d2tz" event={"ID":"af1fb9db-4e24-432d-a6d9-cb313c86c9af","Type":"ContainerStarted","Data":"61f3fe5618c5b7552f3f8b3072522a699baabf11f4663d617b77f2f94d03383d"}
Jul 02 16:59:41.705108 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:41.705051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d79bf7d4c-8d2tz" event={"ID":"af1fb9db-4e24-432d-a6d9-cb313c86c9af","Type":"ContainerStarted","Data":"e83e6bda53ba54d7280ab79570f37d28a0dfe3ea8981a7b356a8f02f6443e22d"}
Jul 02 16:59:41.721944 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:41.721838    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d79bf7d4c-8d2tz" podStartSLOduration=1.72181947 podStartE2EDuration="1.72181947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:59:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:59:41.721420292 +0000 UTC m=+321.088086254" watchObservedRunningTime="2026-07-02 16:59:41.72181947 +0000 UTC m=+321.088485414"
Jul 02 16:59:41.725436 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:41.725412    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:41.725507 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:41.725461    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:41.730399 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:41.730375    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:42.480164 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:42.480129    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:42.712440 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:42.712408    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 16:59:46.684344 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:46.684305    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:46.737915 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:46.737882    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:48.089932 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:48.089900    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:48.144174 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:48.144141    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:48.688951 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:48.688918    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:48.743118 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:48.743073    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:50.502902 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:50.502866    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:50.503290 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:50.502935    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:50.507719 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:50.507693    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:50.742484 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:50.742455    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 16:59:50.787969 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:50.787882    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79b4fb886d-wnnsc"]
Jul 02 16:59:50.893975 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:50.893943    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:50.948403 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:50.948373    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:51.508703 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:51.508666    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:54.143387 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.143335    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv" podUID="628f316e-f572-469a-af90-da94166005b3" containerName="registry" containerID="cri-o://fe636e86ad730be16d3e0086d1d8937402e0477a5b0642cc480befef9a9ef2bb" gracePeriod=30
Jul 02 16:59:54.389262 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.389238    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:59:54.411768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.411700    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/628f316e-f572-469a-af90-da94166005b3-image-registry-private-configuration\") pod \"628f316e-f572-469a-af90-da94166005b3\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") "
Jul 02 16:59:54.411768 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.411736    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/628f316e-f572-469a-af90-da94166005b3-trusted-ca\") pod \"628f316e-f572-469a-af90-da94166005b3\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") "
Jul 02 16:59:54.411978 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.411775    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cphj\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-kube-api-access-5cphj\") pod \"628f316e-f572-469a-af90-da94166005b3\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") "
Jul 02 16:59:54.411978 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.411794    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/628f316e-f572-469a-af90-da94166005b3-registry-certificates\") pod \"628f316e-f572-469a-af90-da94166005b3\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") "
Jul 02 16:59:54.411978 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.411817    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/628f316e-f572-469a-af90-da94166005b3-installation-pull-secrets\") pod \"628f316e-f572-469a-af90-da94166005b3\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") "
Jul 02 16:59:54.411978 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.411835    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/628f316e-f572-469a-af90-da94166005b3-ca-trust-extracted\") pod \"628f316e-f572-469a-af90-da94166005b3\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") "
Jul 02 16:59:54.411978 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.411872    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") pod \"628f316e-f572-469a-af90-da94166005b3\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") "
Jul 02 16:59:54.411978 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.411913    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-bound-sa-token\") pod \"628f316e-f572-469a-af90-da94166005b3\" (UID: \"628f316e-f572-469a-af90-da94166005b3\") "
Jul 02 16:59:54.412434 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.412397    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/628f316e-f572-469a-af90-da94166005b3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "628f316e-f572-469a-af90-da94166005b3" (UID: "628f316e-f572-469a-af90-da94166005b3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 16:59:54.413272 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.413227    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/628f316e-f572-469a-af90-da94166005b3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "628f316e-f572-469a-af90-da94166005b3" (UID: "628f316e-f572-469a-af90-da94166005b3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 16:59:54.415707 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.415678    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "628f316e-f572-469a-af90-da94166005b3" (UID: "628f316e-f572-469a-af90-da94166005b3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 16:59:54.415820 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.415749    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/628f316e-f572-469a-af90-da94166005b3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "628f316e-f572-469a-af90-da94166005b3" (UID: "628f316e-f572-469a-af90-da94166005b3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 16:59:54.416081 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.416048    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "628f316e-f572-469a-af90-da94166005b3" (UID: "628f316e-f572-469a-af90-da94166005b3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 16:59:54.416081 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.416068    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-kube-api-access-5cphj" (OuterVolumeSpecName: "kube-api-access-5cphj") pod "628f316e-f572-469a-af90-da94166005b3" (UID: "628f316e-f572-469a-af90-da94166005b3"). InnerVolumeSpecName "kube-api-access-5cphj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 16:59:54.416276 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.416242    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/628f316e-f572-469a-af90-da94166005b3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "628f316e-f572-469a-af90-da94166005b3" (UID: "628f316e-f572-469a-af90-da94166005b3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 16:59:54.422217 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.422079    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/628f316e-f572-469a-af90-da94166005b3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "628f316e-f572-469a-af90-da94166005b3" (UID: "628f316e-f572-469a-af90-da94166005b3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 16:59:54.512975 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.512941    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cphj\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-kube-api-access-5cphj\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 16:59:54.512975 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.512969    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/628f316e-f572-469a-af90-da94166005b3-registry-certificates\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 16:59:54.512975 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.512978    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/628f316e-f572-469a-af90-da94166005b3-installation-pull-secrets\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 16:59:54.513221 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.512986    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/628f316e-f572-469a-af90-da94166005b3-ca-trust-extracted\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 16:59:54.513221 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.512995    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-registry-tls\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 16:59:54.513221 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.513005    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/628f316e-f572-469a-af90-da94166005b3-bound-sa-token\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 16:59:54.513221 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.513015    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/628f316e-f572-469a-af90-da94166005b3-image-registry-private-configuration\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 16:59:54.513221 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.513024    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/628f316e-f572-469a-af90-da94166005b3-trusted-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 16:59:54.753263 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.753173    2579 generic.go:356] "Generic (PLEG): container finished" podID="628f316e-f572-469a-af90-da94166005b3" containerID="fe636e86ad730be16d3e0086d1d8937402e0477a5b0642cc480befef9a9ef2bb" exitCode=0
Jul 02 16:59:54.753263 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.753225    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv"
Jul 02 16:59:54.753436 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.753266    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv" event={"ID":"628f316e-f572-469a-af90-da94166005b3","Type":"ContainerDied","Data":"fe636e86ad730be16d3e0086d1d8937402e0477a5b0642cc480befef9a9ef2bb"}
Jul 02 16:59:54.753436 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.753316    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b67fddffc-9z5lv" event={"ID":"628f316e-f572-469a-af90-da94166005b3","Type":"ContainerDied","Data":"3cc8780b56bad687c60cd3c336c6d9a09e1d802ef4a3e2906ee3889265efe019"}
Jul 02 16:59:54.753436 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.753349    2579 scope.go:117] "RemoveContainer" containerID="fe636e86ad730be16d3e0086d1d8937402e0477a5b0642cc480befef9a9ef2bb"
Jul 02 16:59:54.761835 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.761815    2579 scope.go:117] "RemoveContainer" containerID="fe636e86ad730be16d3e0086d1d8937402e0477a5b0642cc480befef9a9ef2bb"
Jul 02 16:59:54.762122 ip-10-0-130-131 kubenswrapper[2579]: E0702 16:59:54.762076    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe636e86ad730be16d3e0086d1d8937402e0477a5b0642cc480befef9a9ef2bb\": container with ID starting with fe636e86ad730be16d3e0086d1d8937402e0477a5b0642cc480befef9a9ef2bb not found: ID does not exist" containerID="fe636e86ad730be16d3e0086d1d8937402e0477a5b0642cc480befef9a9ef2bb"
Jul 02 16:59:54.762185 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.762138    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe636e86ad730be16d3e0086d1d8937402e0477a5b0642cc480befef9a9ef2bb"} err="failed to get container status \"fe636e86ad730be16d3e0086d1d8937402e0477a5b0642cc480befef9a9ef2bb\": rpc error: code = NotFound desc = could not find container \"fe636e86ad730be16d3e0086d1d8937402e0477a5b0642cc480befef9a9ef2bb\": container with ID starting with fe636e86ad730be16d3e0086d1d8937402e0477a5b0642cc480befef9a9ef2bb not found: ID does not exist"
Jul 02 16:59:54.772741 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.772716    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b67fddffc-9z5lv"]
Jul 02 16:59:54.776468 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:54.776446    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b67fddffc-9z5lv"]
Jul 02 16:59:55.179015 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:55.178966    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:55.280028 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:55.279992    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 16:59:55.719989 ip-10-0-130-131 kubenswrapper[2579]: I0702 16:59:55.719957    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="628f316e-f572-469a-af90-da94166005b3" path="/var/lib/kubelet/pods/628f316e-f572-469a-af90-da94166005b3/volumes"
Jul 02 17:00:10.182821 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:10.182788    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:10.249878 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:10.249848    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:15.808339 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:15.808250    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79b4fb886d-wnnsc" podUID="ed388748-4134-41d9-974f-b0aa6c5c1c97" containerName="console" containerID="cri-o://bd23e16cd6e986b1d559eabc8839e86cb275e8e6935dac61303f24db27a3c4b4" gracePeriod=15
Jul 02 17:00:16.050953 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.050926    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 17:00:16.064167 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.064123    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-oauth-serving-cert\") pod \"ed388748-4134-41d9-974f-b0aa6c5c1c97\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") "
Jul 02 17:00:16.064239 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.064166    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-service-ca\") pod \"ed388748-4134-41d9-974f-b0aa6c5c1c97\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") "
Jul 02 17:00:16.064239 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.064200    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66tb6\" (UniqueName: \"kubernetes.io/projected/ed388748-4134-41d9-974f-b0aa6c5c1c97-kube-api-access-66tb6\") pod \"ed388748-4134-41d9-974f-b0aa6c5c1c97\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") "
Jul 02 17:00:16.064239 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.064217    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-serving-cert\") pod \"ed388748-4134-41d9-974f-b0aa6c5c1c97\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") "
Jul 02 17:00:16.064346 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.064266    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-config\") pod \"ed388748-4134-41d9-974f-b0aa6c5c1c97\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") "
Jul 02 17:00:16.064346 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.064286    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-oauth-config\") pod \"ed388748-4134-41d9-974f-b0aa6c5c1c97\" (UID: \"ed388748-4134-41d9-974f-b0aa6c5c1c97\") "
Jul 02 17:00:16.064602 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.064542    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ed388748-4134-41d9-974f-b0aa6c5c1c97" (UID: "ed388748-4134-41d9-974f-b0aa6c5c1c97"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:00:16.064740 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.064662    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-service-ca" (OuterVolumeSpecName: "service-ca") pod "ed388748-4134-41d9-974f-b0aa6c5c1c97" (UID: "ed388748-4134-41d9-974f-b0aa6c5c1c97"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:00:16.064806 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.064730    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-config" (OuterVolumeSpecName: "console-config") pod "ed388748-4134-41d9-974f-b0aa6c5c1c97" (UID: "ed388748-4134-41d9-974f-b0aa6c5c1c97"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:00:16.066480 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.066451    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed388748-4134-41d9-974f-b0aa6c5c1c97-kube-api-access-66tb6" (OuterVolumeSpecName: "kube-api-access-66tb6") pod "ed388748-4134-41d9-974f-b0aa6c5c1c97" (UID: "ed388748-4134-41d9-974f-b0aa6c5c1c97"). InnerVolumeSpecName "kube-api-access-66tb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:00:16.066571 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.066504    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ed388748-4134-41d9-974f-b0aa6c5c1c97" (UID: "ed388748-4134-41d9-974f-b0aa6c5c1c97"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:00:16.066571 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.066522    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ed388748-4134-41d9-974f-b0aa6c5c1c97" (UID: "ed388748-4134-41d9-974f-b0aa6c5c1c97"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:00:16.165493 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.165460    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-config\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:00:16.165493 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.165486    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-oauth-config\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:00:16.165493 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.165496    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-oauth-serving-cert\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:00:16.165493 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.165504    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed388748-4134-41d9-974f-b0aa6c5c1c97-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:00:16.165750 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.165513    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66tb6\" (UniqueName: \"kubernetes.io/projected/ed388748-4134-41d9-974f-b0aa6c5c1c97-kube-api-access-66tb6\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:00:16.165750 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.165521    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed388748-4134-41d9-974f-b0aa6c5c1c97-console-serving-cert\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:00:16.839862 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.839823    2579 generic.go:356] "Generic (PLEG): container finished" podID="ed388748-4134-41d9-974f-b0aa6c5c1c97" containerID="bd23e16cd6e986b1d559eabc8839e86cb275e8e6935dac61303f24db27a3c4b4" exitCode=0
Jul 02 17:00:16.840274 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.839871    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b4fb886d-wnnsc"
Jul 02 17:00:16.840274 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.839898    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b4fb886d-wnnsc" event={"ID":"ed388748-4134-41d9-974f-b0aa6c5c1c97","Type":"ContainerDied","Data":"bd23e16cd6e986b1d559eabc8839e86cb275e8e6935dac61303f24db27a3c4b4"}
Jul 02 17:00:16.840274 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.839946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b4fb886d-wnnsc" event={"ID":"ed388748-4134-41d9-974f-b0aa6c5c1c97","Type":"ContainerDied","Data":"2d30b0abb7c98d6e25d3e554ec4ac90b07e9a39b7cd9cd46b3024e70158a0281"}
Jul 02 17:00:16.840274 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.839974    2579 scope.go:117] "RemoveContainer" containerID="bd23e16cd6e986b1d559eabc8839e86cb275e8e6935dac61303f24db27a3c4b4"
Jul 02 17:00:16.848178 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.848159    2579 scope.go:117] "RemoveContainer" containerID="bd23e16cd6e986b1d559eabc8839e86cb275e8e6935dac61303f24db27a3c4b4"
Jul 02 17:00:16.848431 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:00:16.848412    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd23e16cd6e986b1d559eabc8839e86cb275e8e6935dac61303f24db27a3c4b4\": container with ID starting with bd23e16cd6e986b1d559eabc8839e86cb275e8e6935dac61303f24db27a3c4b4 not found: ID does not exist" containerID="bd23e16cd6e986b1d559eabc8839e86cb275e8e6935dac61303f24db27a3c4b4"
Jul 02 17:00:16.848477 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.848439    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd23e16cd6e986b1d559eabc8839e86cb275e8e6935dac61303f24db27a3c4b4"} err="failed to get container status \"bd23e16cd6e986b1d559eabc8839e86cb275e8e6935dac61303f24db27a3c4b4\": rpc error: code = NotFound desc = could not find container \"bd23e16cd6e986b1d559eabc8839e86cb275e8e6935dac61303f24db27a3c4b4\": container with ID starting with bd23e16cd6e986b1d559eabc8839e86cb275e8e6935dac61303f24db27a3c4b4 not found: ID does not exist"
Jul 02 17:00:16.861258 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.861233    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79b4fb886d-wnnsc"]
Jul 02 17:00:16.864499 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:16.864477    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79b4fb886d-wnnsc"]
Jul 02 17:00:17.719870 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:17.719836    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed388748-4134-41d9-974f-b0aa6c5c1c97" path="/var/lib/kubelet/pods/ed388748-4134-41d9-974f-b0aa6c5c1c97/volumes"
Jul 02 17:00:34.325328 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:34.325282    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:34.380988 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:34.380943    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:35.118766 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:35.118726    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 17:00:35.121104 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:35.121060    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714f87ed-815d-48a6-a203-a5a4494ddffe-metrics-certs\") pod \"network-metrics-daemon-zc26l\" (UID: \"714f87ed-815d-48a6-a203-a5a4494ddffe\") " pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 17:00:35.217979 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:35.217950    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6k5zx\""
Jul 02 17:00:35.226724 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:35.226700    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc26l"
Jul 02 17:00:35.351120 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:35.351067    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zc26l"]
Jul 02 17:00:35.354279 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:00:35.354250    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714f87ed_815d_48a6_a203_a5a4494ddffe.slice/crio-d2e067febd5bb1f8bae4e5a8e7a2102485b72a0dc6f3e3213ffd12364eebc6b2 WatchSource:0}: Error finding container d2e067febd5bb1f8bae4e5a8e7a2102485b72a0dc6f3e3213ffd12364eebc6b2: Status 404 returned error can't find the container with id d2e067febd5bb1f8bae4e5a8e7a2102485b72a0dc6f3e3213ffd12364eebc6b2
Jul 02 17:00:35.911604 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:35.911562    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zc26l" event={"ID":"714f87ed-815d-48a6-a203-a5a4494ddffe","Type":"ContainerStarted","Data":"d2e067febd5bb1f8bae4e5a8e7a2102485b72a0dc6f3e3213ffd12364eebc6b2"}
Jul 02 17:00:36.916899 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:36.916864    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zc26l" event={"ID":"714f87ed-815d-48a6-a203-a5a4494ddffe","Type":"ContainerStarted","Data":"38a686248d6b65c04f921fdf36baac700e84365090080c417870dda611fd7e41"}
Jul 02 17:00:36.917305 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:36.916949    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zc26l" event={"ID":"714f87ed-815d-48a6-a203-a5a4494ddffe","Type":"ContainerStarted","Data":"ec4a7699ed04ab89525db9d8dcdf1eee00bf60806f9a5effcdd46619ae7b7351"}
Jul 02 17:00:36.932791 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:36.932733    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zc26l" podStartSLOduration=374.955001043 podStartE2EDuration="6m15.932714511s" totalImagesPullingTime="977.713468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:00:36.932650533 +0000 UTC m=+376.299316496" watchObservedRunningTime="2026-07-02 17:00:36.932714511 +0000 UTC m=+376.299380474"
Jul 02 17:00:37.021794 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:37.021763    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:37.080570 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:37.080535    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:43.620115 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:43.620056    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:43.723868 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:43.723829    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:46.163004 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:46.162953    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:46.218443 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:46.218411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:48.982841 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:48.982803    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:49.038577 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:49.038543    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:55.187670 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.187626    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:55.330776 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.330742    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:55.843604 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.843570    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f679c7df7-75vmc"]
Jul 02 17:00:55.843843 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.843832    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="628f316e-f572-469a-af90-da94166005b3" containerName="registry"
Jul 02 17:00:55.843897 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.843844    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="628f316e-f572-469a-af90-da94166005b3" containerName="registry"
Jul 02 17:00:55.843897 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.843861    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed388748-4134-41d9-974f-b0aa6c5c1c97" containerName="console"
Jul 02 17:00:55.843897 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.843867    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed388748-4134-41d9-974f-b0aa6c5c1c97" containerName="console"
Jul 02 17:00:55.844003 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.843906    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="628f316e-f572-469a-af90-da94166005b3" containerName="registry"
Jul 02 17:00:55.844003 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.843913    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed388748-4134-41d9-974f-b0aa6c5c1c97" containerName="console"
Jul 02 17:00:55.845910 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.845888    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:55.857707 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.857678    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f679c7df7-75vmc"]
Jul 02 17:00:55.992595 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.992558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-oauth-serving-cert\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:55.992790 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.992599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-trusted-ca-bundle\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:55.992790 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.992622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpr7c\" (UniqueName: \"kubernetes.io/projected/d7645d99-6802-45c5-9cce-7d6338fd0bcc-kube-api-access-fpr7c\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:55.992790 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.992718    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-serving-cert\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:55.992790 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.992750    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-config\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:55.992790 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.992776    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-oauth-config\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:55.993010 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.992854    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-service-ca\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:55.998426 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:55.998398    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:56.093537 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.093500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-oauth-serving-cert\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.093753 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.093544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-trusted-ca-bundle\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.093753 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.093563    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpr7c\" (UniqueName: \"kubernetes.io/projected/d7645d99-6802-45c5-9cce-7d6338fd0bcc-kube-api-access-fpr7c\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.093753 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.093597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-serving-cert\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.093753 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.093623    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-config\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.093753 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.093647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-oauth-config\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.093753 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.093665    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-service-ca\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.094379 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.094351    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-oauth-serving-cert\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.094506 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.094445    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-service-ca\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.094506 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.094451    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-config\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.094602 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.094538    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-trusted-ca-bundle\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.096200 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.096169    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-serving-cert\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.096308 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.096225    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-oauth-config\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.098900 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.098878    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:56.100944 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.100916    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpr7c\" (UniqueName: \"kubernetes.io/projected/d7645d99-6802-45c5-9cce-7d6338fd0bcc-kube-api-access-fpr7c\") pod \"console-f679c7df7-75vmc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") " pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.154776 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.154742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:00:56.307674 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.307546    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f679c7df7-75vmc"]
Jul 02 17:00:56.310425 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:00:56.310393    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7645d99_6802_45c5_9cce_7d6338fd0bcc.slice/crio-7f260dbf1052c1462c8d584d71fd6a8fb2bcd66575ce2ef6c6da21230e855208 WatchSource:0}: Error finding container 7f260dbf1052c1462c8d584d71fd6a8fb2bcd66575ce2ef6c6da21230e855208: Status 404 returned error can't find the container with id 7f260dbf1052c1462c8d584d71fd6a8fb2bcd66575ce2ef6c6da21230e855208
Jul 02 17:00:56.647239 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.647145    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:56.712909 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.712867    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:00:56.989525 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.989431    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f679c7df7-75vmc" event={"ID":"d7645d99-6802-45c5-9cce-7d6338fd0bcc","Type":"ContainerStarted","Data":"5468989cf92aab6509fa73146aa77034d0b5f70891f49d3c8bf4937275197c9b"}
Jul 02 17:00:56.989525 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:56.989485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f679c7df7-75vmc" event={"ID":"d7645d99-6802-45c5-9cce-7d6338fd0bcc","Type":"ContainerStarted","Data":"7f260dbf1052c1462c8d584d71fd6a8fb2bcd66575ce2ef6c6da21230e855208"}
Jul 02 17:00:57.005777 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:00:57.005715    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f679c7df7-75vmc" podStartSLOduration=2.005695816 podStartE2EDuration="2.005695816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:00:57.004869167 +0000 UTC m=+396.371535130" watchObservedRunningTime="2026-07-02 17:00:57.005695816 +0000 UTC m=+396.372361779"
Jul 02 17:01:06.155252 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:06.155212    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:01:06.155749 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:06.155293    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:01:06.159925 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:06.159901    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:01:07.029360 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:07.029329    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:01:07.073813 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:07.073782    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d79bf7d4c-8d2tz"]
Jul 02 17:01:07.171348 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:07.171313    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:01:07.272474 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:07.272443    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:01:07.372660 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:07.372630    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:01:23.945415 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:23.945375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:01:30.410010 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:30.409976    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:01:32.102331 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.102285    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d79bf7d4c-8d2tz" podUID="af1fb9db-4e24-432d-a6d9-cb313c86c9af" containerName="console" containerID="cri-o://e83e6bda53ba54d7280ab79570f37d28a0dfe3ea8981a7b356a8f02f6443e22d" gracePeriod=15
Jul 02 17:01:32.347340 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.347313    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 17:01:32.483965 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.483860    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-config\") pod \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") "
Jul 02 17:01:32.483965 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.483913    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-serving-cert\") pod \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") "
Jul 02 17:01:32.483965 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.483938    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-oauth-serving-cert\") pod \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") "
Jul 02 17:01:32.484323 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.484130    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-trusted-ca-bundle\") pod \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") "
Jul 02 17:01:32.484323 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.484201    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcvxw\" (UniqueName: \"kubernetes.io/projected/af1fb9db-4e24-432d-a6d9-cb313c86c9af-kube-api-access-qcvxw\") pod \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") "
Jul 02 17:01:32.484323 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.484232    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-oauth-config\") pod \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") "
Jul 02 17:01:32.484323 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.484265    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-service-ca\") pod \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\" (UID: \"af1fb9db-4e24-432d-a6d9-cb313c86c9af\") "
Jul 02 17:01:32.484568 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.484349    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-config" (OuterVolumeSpecName: "console-config") pod "af1fb9db-4e24-432d-a6d9-cb313c86c9af" (UID: "af1fb9db-4e24-432d-a6d9-cb313c86c9af"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:01:32.484568 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.484384    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "af1fb9db-4e24-432d-a6d9-cb313c86c9af" (UID: "af1fb9db-4e24-432d-a6d9-cb313c86c9af"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:01:32.484704 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.484589    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-oauth-serving-cert\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:01:32.484704 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.484610    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-config\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:01:32.484864 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.484716    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "af1fb9db-4e24-432d-a6d9-cb313c86c9af" (UID: "af1fb9db-4e24-432d-a6d9-cb313c86c9af"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:01:32.484864 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.484768    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-service-ca" (OuterVolumeSpecName: "service-ca") pod "af1fb9db-4e24-432d-a6d9-cb313c86c9af" (UID: "af1fb9db-4e24-432d-a6d9-cb313c86c9af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:01:32.486492 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.486460    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af1fb9db-4e24-432d-a6d9-cb313c86c9af-kube-api-access-qcvxw" (OuterVolumeSpecName: "kube-api-access-qcvxw") pod "af1fb9db-4e24-432d-a6d9-cb313c86c9af" (UID: "af1fb9db-4e24-432d-a6d9-cb313c86c9af"). InnerVolumeSpecName "kube-api-access-qcvxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:01:32.486587 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.486505    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "af1fb9db-4e24-432d-a6d9-cb313c86c9af" (UID: "af1fb9db-4e24-432d-a6d9-cb313c86c9af"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:01:32.486587 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.486524    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "af1fb9db-4e24-432d-a6d9-cb313c86c9af" (UID: "af1fb9db-4e24-432d-a6d9-cb313c86c9af"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:01:32.585256 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.585225    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-serving-cert\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:01:32.585256 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.585256    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-trusted-ca-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:01:32.585442 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.585268    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcvxw\" (UniqueName: \"kubernetes.io/projected/af1fb9db-4e24-432d-a6d9-cb313c86c9af-kube-api-access-qcvxw\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:01:32.585442 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.585281    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af1fb9db-4e24-432d-a6d9-cb313c86c9af-console-oauth-config\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:01:32.585442 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:32.585293    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af1fb9db-4e24-432d-a6d9-cb313c86c9af-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:01:33.117845 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:33.117804    2579 generic.go:356] "Generic (PLEG): container finished" podID="af1fb9db-4e24-432d-a6d9-cb313c86c9af" containerID="e83e6bda53ba54d7280ab79570f37d28a0dfe3ea8981a7b356a8f02f6443e22d" exitCode=0
Jul 02 17:01:33.118378 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:33.117852    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d79bf7d4c-8d2tz"
Jul 02 17:01:33.118378 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:33.117892    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d79bf7d4c-8d2tz" event={"ID":"af1fb9db-4e24-432d-a6d9-cb313c86c9af","Type":"ContainerDied","Data":"e83e6bda53ba54d7280ab79570f37d28a0dfe3ea8981a7b356a8f02f6443e22d"}
Jul 02 17:01:33.118378 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:33.117956    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d79bf7d4c-8d2tz" event={"ID":"af1fb9db-4e24-432d-a6d9-cb313c86c9af","Type":"ContainerDied","Data":"61f3fe5618c5b7552f3f8b3072522a699baabf11f4663d617b77f2f94d03383d"}
Jul 02 17:01:33.118378 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:33.117989    2579 scope.go:117] "RemoveContainer" containerID="e83e6bda53ba54d7280ab79570f37d28a0dfe3ea8981a7b356a8f02f6443e22d"
Jul 02 17:01:33.126749 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:33.126735    2579 scope.go:117] "RemoveContainer" containerID="e83e6bda53ba54d7280ab79570f37d28a0dfe3ea8981a7b356a8f02f6443e22d"
Jul 02 17:01:33.127018 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:01:33.127000    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e83e6bda53ba54d7280ab79570f37d28a0dfe3ea8981a7b356a8f02f6443e22d\": container with ID starting with e83e6bda53ba54d7280ab79570f37d28a0dfe3ea8981a7b356a8f02f6443e22d not found: ID does not exist" containerID="e83e6bda53ba54d7280ab79570f37d28a0dfe3ea8981a7b356a8f02f6443e22d"
Jul 02 17:01:33.127064 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:33.127027    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e83e6bda53ba54d7280ab79570f37d28a0dfe3ea8981a7b356a8f02f6443e22d"} err="failed to get container status \"e83e6bda53ba54d7280ab79570f37d28a0dfe3ea8981a7b356a8f02f6443e22d\": rpc error: code = NotFound desc = could not find container \"e83e6bda53ba54d7280ab79570f37d28a0dfe3ea8981a7b356a8f02f6443e22d\": container with ID starting with e83e6bda53ba54d7280ab79570f37d28a0dfe3ea8981a7b356a8f02f6443e22d not found: ID does not exist"
Jul 02 17:01:33.139002 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:33.138981    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d79bf7d4c-8d2tz"]
Jul 02 17:01:33.142543 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:33.142522    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d79bf7d4c-8d2tz"]
Jul 02 17:01:33.719433 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:33.719405    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af1fb9db-4e24-432d-a6d9-cb313c86c9af" path="/var/lib/kubelet/pods/af1fb9db-4e24-432d-a6d9-cb313c86c9af/volumes"
Jul 02 17:01:48.568238 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:48.568145    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:01:48.667595 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:48.667563    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:01:49.104433 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.104394    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"]
Jul 02 17:01:49.104675 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.104663    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af1fb9db-4e24-432d-a6d9-cb313c86c9af" containerName="console"
Jul 02 17:01:49.104721 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.104676    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="af1fb9db-4e24-432d-a6d9-cb313c86c9af" containerName="console"
Jul 02 17:01:49.104754 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.104728    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="af1fb9db-4e24-432d-a6d9-cb313c86c9af" containerName="console"
Jul 02 17:01:49.106916 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.106899    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"
Jul 02 17:01:49.109471 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.109446    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f8brm\""
Jul 02 17:01:49.109581 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.109454    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 17:01:49.110219 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.110200    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 17:01:49.116230 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.116201    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"]
Jul 02 17:01:49.219962 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.219928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/106c2f5d-b77f-49fb-b56f-d5887543eec5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj\" (UID: \"106c2f5d-b77f-49fb-b56f-d5887543eec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"
Jul 02 17:01:49.220162 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.219997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97gqx\" (UniqueName: \"kubernetes.io/projected/106c2f5d-b77f-49fb-b56f-d5887543eec5-kube-api-access-97gqx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj\" (UID: \"106c2f5d-b77f-49fb-b56f-d5887543eec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"
Jul 02 17:01:49.220162 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.220028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/106c2f5d-b77f-49fb-b56f-d5887543eec5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj\" (UID: \"106c2f5d-b77f-49fb-b56f-d5887543eec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"
Jul 02 17:01:49.320596 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.320556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97gqx\" (UniqueName: \"kubernetes.io/projected/106c2f5d-b77f-49fb-b56f-d5887543eec5-kube-api-access-97gqx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj\" (UID: \"106c2f5d-b77f-49fb-b56f-d5887543eec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"
Jul 02 17:01:49.320785 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.320608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/106c2f5d-b77f-49fb-b56f-d5887543eec5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj\" (UID: \"106c2f5d-b77f-49fb-b56f-d5887543eec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"
Jul 02 17:01:49.320785 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.320669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/106c2f5d-b77f-49fb-b56f-d5887543eec5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj\" (UID: \"106c2f5d-b77f-49fb-b56f-d5887543eec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"
Jul 02 17:01:49.321139 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.321084    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/106c2f5d-b77f-49fb-b56f-d5887543eec5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj\" (UID: \"106c2f5d-b77f-49fb-b56f-d5887543eec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"
Jul 02 17:01:49.321222 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.321127    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/106c2f5d-b77f-49fb-b56f-d5887543eec5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj\" (UID: \"106c2f5d-b77f-49fb-b56f-d5887543eec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"
Jul 02 17:01:49.329631 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.329606    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97gqx\" (UniqueName: \"kubernetes.io/projected/106c2f5d-b77f-49fb-b56f-d5887543eec5-kube-api-access-97gqx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj\" (UID: \"106c2f5d-b77f-49fb-b56f-d5887543eec5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"
Jul 02 17:01:49.416165 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.416061    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"
Jul 02 17:01:49.542628 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:49.542594    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"]
Jul 02 17:01:49.545538 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:01:49.545504    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106c2f5d_b77f_49fb_b56f_d5887543eec5.slice/crio-d339bdad36f2e917f19c16bf016379a4217bdb7889dea1b5df9ca75a9d191954 WatchSource:0}: Error finding container d339bdad36f2e917f19c16bf016379a4217bdb7889dea1b5df9ca75a9d191954: Status 404 returned error can't find the container with id d339bdad36f2e917f19c16bf016379a4217bdb7889dea1b5df9ca75a9d191954
Jul 02 17:01:50.179692 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:50.179656    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj" event={"ID":"106c2f5d-b77f-49fb-b56f-d5887543eec5","Type":"ContainerStarted","Data":"d339bdad36f2e917f19c16bf016379a4217bdb7889dea1b5df9ca75a9d191954"}
Jul 02 17:01:59.223595 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:59.223548    2579 generic.go:356] "Generic (PLEG): container finished" podID="106c2f5d-b77f-49fb-b56f-d5887543eec5" containerID="379186a4b8725ec49557078ad4c9a6a4fc478d430d53864e779a70eb12be3076" exitCode=0
Jul 02 17:01:59.223981 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:01:59.223627    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj" event={"ID":"106c2f5d-b77f-49fb-b56f-d5887543eec5","Type":"ContainerDied","Data":"379186a4b8725ec49557078ad4c9a6a4fc478d430d53864e779a70eb12be3076"}
Jul 02 17:02:01.233386 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:01.233286    2579 generic.go:356] "Generic (PLEG): container finished" podID="106c2f5d-b77f-49fb-b56f-d5887543eec5" containerID="cdbdeeef1822d951dedcd823f6a7be14408319c9e0a5d14a1af6544460c2686e" exitCode=0
Jul 02 17:02:01.233386 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:01.233354    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj" event={"ID":"106c2f5d-b77f-49fb-b56f-d5887543eec5","Type":"ContainerDied","Data":"cdbdeeef1822d951dedcd823f6a7be14408319c9e0a5d14a1af6544460c2686e"}
Jul 02 17:02:02.889592 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:02.889558    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:10.269976 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:10.269941    2579 generic.go:356] "Generic (PLEG): container finished" podID="106c2f5d-b77f-49fb-b56f-d5887543eec5" containerID="86c785d044e0b45066b67d8e5a1238cecb15937b548b0b3b17a32353af8d229c" exitCode=0
Jul 02 17:02:10.270455 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:10.270034    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj" event={"ID":"106c2f5d-b77f-49fb-b56f-d5887543eec5","Type":"ContainerDied","Data":"86c785d044e0b45066b67d8e5a1238cecb15937b548b0b3b17a32353af8d229c"}
Jul 02 17:02:11.437063 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:11.437030    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"
Jul 02 17:02:11.497772 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:11.497741    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/106c2f5d-b77f-49fb-b56f-d5887543eec5-util\") pod \"106c2f5d-b77f-49fb-b56f-d5887543eec5\" (UID: \"106c2f5d-b77f-49fb-b56f-d5887543eec5\") "
Jul 02 17:02:11.497966 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:11.497828    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97gqx\" (UniqueName: \"kubernetes.io/projected/106c2f5d-b77f-49fb-b56f-d5887543eec5-kube-api-access-97gqx\") pod \"106c2f5d-b77f-49fb-b56f-d5887543eec5\" (UID: \"106c2f5d-b77f-49fb-b56f-d5887543eec5\") "
Jul 02 17:02:11.497966 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:11.497867    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/106c2f5d-b77f-49fb-b56f-d5887543eec5-bundle\") pod \"106c2f5d-b77f-49fb-b56f-d5887543eec5\" (UID: \"106c2f5d-b77f-49fb-b56f-d5887543eec5\") "
Jul 02 17:02:11.498602 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:11.498576    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/106c2f5d-b77f-49fb-b56f-d5887543eec5-bundle" (OuterVolumeSpecName: "bundle") pod "106c2f5d-b77f-49fb-b56f-d5887543eec5" (UID: "106c2f5d-b77f-49fb-b56f-d5887543eec5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:02:11.500009 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:11.499992    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/106c2f5d-b77f-49fb-b56f-d5887543eec5-kube-api-access-97gqx" (OuterVolumeSpecName: "kube-api-access-97gqx") pod "106c2f5d-b77f-49fb-b56f-d5887543eec5" (UID: "106c2f5d-b77f-49fb-b56f-d5887543eec5"). InnerVolumeSpecName "kube-api-access-97gqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:02:11.504311 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:11.504279    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/106c2f5d-b77f-49fb-b56f-d5887543eec5-util" (OuterVolumeSpecName: "util") pod "106c2f5d-b77f-49fb-b56f-d5887543eec5" (UID: "106c2f5d-b77f-49fb-b56f-d5887543eec5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:02:11.598343 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:11.598313    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/106c2f5d-b77f-49fb-b56f-d5887543eec5-util\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:02:11.598343 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:11.598345    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97gqx\" (UniqueName: \"kubernetes.io/projected/106c2f5d-b77f-49fb-b56f-d5887543eec5-kube-api-access-97gqx\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:02:11.598532 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:11.598355    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/106c2f5d-b77f-49fb-b56f-d5887543eec5-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:02:12.280189 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:12.280159    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj"
Jul 02 17:02:12.280189 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:12.280165    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tq8qj" event={"ID":"106c2f5d-b77f-49fb-b56f-d5887543eec5","Type":"ContainerDied","Data":"d339bdad36f2e917f19c16bf016379a4217bdb7889dea1b5df9ca75a9d191954"}
Jul 02 17:02:12.280391 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:12.280211    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d339bdad36f2e917f19c16bf016379a4217bdb7889dea1b5df9ca75a9d191954"
Jul 02 17:02:15.130680 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:15.130643    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:15.926662 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:15.926623    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:17.084111 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.084053    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt"]
Jul 02 17:02:17.084488 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.084324    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="106c2f5d-b77f-49fb-b56f-d5887543eec5" containerName="pull"
Jul 02 17:02:17.084488 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.084334    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="106c2f5d-b77f-49fb-b56f-d5887543eec5" containerName="pull"
Jul 02 17:02:17.084488 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.084348    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="106c2f5d-b77f-49fb-b56f-d5887543eec5" containerName="util"
Jul 02 17:02:17.084488 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.084354    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="106c2f5d-b77f-49fb-b56f-d5887543eec5" containerName="util"
Jul 02 17:02:17.084488 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.084360    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="106c2f5d-b77f-49fb-b56f-d5887543eec5" containerName="extract"
Jul 02 17:02:17.084488 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.084366    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="106c2f5d-b77f-49fb-b56f-d5887543eec5" containerName="extract"
Jul 02 17:02:17.084488 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.084430    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="106c2f5d-b77f-49fb-b56f-d5887543eec5" containerName="extract"
Jul 02 17:02:17.086154 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.086135    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt"
Jul 02 17:02:17.088502 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.088474    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 02 17:02:17.088502 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.088497    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 02 17:02:17.088659 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.088497    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jhtjs\""
Jul 02 17:02:17.099354 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.099328    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt"]
Jul 02 17:02:17.141803 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.141769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgp76\" (UniqueName: \"kubernetes.io/projected/813a78c0-5069-4026-a440-6a283bb6003d-kube-api-access-pgp76\") pod \"cert-manager-operator-controller-manager-55c444bf86-wfnjt\" (UID: \"813a78c0-5069-4026-a440-6a283bb6003d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt"
Jul 02 17:02:17.141966 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.141821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/813a78c0-5069-4026-a440-6a283bb6003d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wfnjt\" (UID: \"813a78c0-5069-4026-a440-6a283bb6003d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt"
Jul 02 17:02:17.243072 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.243036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgp76\" (UniqueName: \"kubernetes.io/projected/813a78c0-5069-4026-a440-6a283bb6003d-kube-api-access-pgp76\") pod \"cert-manager-operator-controller-manager-55c444bf86-wfnjt\" (UID: \"813a78c0-5069-4026-a440-6a283bb6003d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt"
Jul 02 17:02:17.243251 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.243112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/813a78c0-5069-4026-a440-6a283bb6003d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wfnjt\" (UID: \"813a78c0-5069-4026-a440-6a283bb6003d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt"
Jul 02 17:02:17.243453 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.243436    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/813a78c0-5069-4026-a440-6a283bb6003d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wfnjt\" (UID: \"813a78c0-5069-4026-a440-6a283bb6003d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt"
Jul 02 17:02:17.250613 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.250577    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgp76\" (UniqueName: \"kubernetes.io/projected/813a78c0-5069-4026-a440-6a283bb6003d-kube-api-access-pgp76\") pod \"cert-manager-operator-controller-manager-55c444bf86-wfnjt\" (UID: \"813a78c0-5069-4026-a440-6a283bb6003d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt"
Jul 02 17:02:17.395393 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.395305    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt"
Jul 02 17:02:17.530185 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:17.530161    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt"]
Jul 02 17:02:17.532838 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:02:17.532803    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813a78c0_5069_4026_a440_6a283bb6003d.slice/crio-614a954179dd902c5fb89c97da7c7c1e644bd8fafe449703db9e667640883c6a WatchSource:0}: Error finding container 614a954179dd902c5fb89c97da7c7c1e644bd8fafe449703db9e667640883c6a: Status 404 returned error can't find the container with id 614a954179dd902c5fb89c97da7c7c1e644bd8fafe449703db9e667640883c6a
Jul 02 17:02:18.304713 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:18.304674    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt" event={"ID":"813a78c0-5069-4026-a440-6a283bb6003d","Type":"ContainerStarted","Data":"614a954179dd902c5fb89c97da7c7c1e644bd8fafe449703db9e667640883c6a"}
Jul 02 17:02:18.734324 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:18.734277    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:18.834955 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:18.834922    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:20.290364 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.290329    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:20.315325 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.315288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt" event={"ID":"813a78c0-5069-4026-a440-6a283bb6003d","Type":"ContainerStarted","Data":"0c30eb7777015f16f7d29fb98e0815af14364a178c69ab69c5c5cac270307985"}
Jul 02 17:02:20.339953 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.339895    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wfnjt" podStartSLOduration=1.317895212 podStartE2EDuration="3.339873784s" totalImagesPullingTime="2.021978572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:02:20.338421633 +0000 UTC m=+479.705087596" watchObservedRunningTime="2026-07-02 17:02:20.339873784 +0000 UTC m=+479.706539745"
Jul 02 17:02:20.392504 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.392472    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:20.396005 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.395978    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zbjpw"]
Jul 02 17:02:20.398287 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.398272    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zbjpw"
Jul 02 17:02:20.400675 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.400655    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 02 17:02:20.400776 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.400709    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 02 17:02:20.400834 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.400779    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-l6p9s\""
Jul 02 17:02:20.406737 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.406715    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zbjpw"]
Jul 02 17:02:20.470774 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.470739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htjv2\" (UniqueName: \"kubernetes.io/projected/5c6a9967-f00c-4049-ad09-469f66d83a3f-kube-api-access-htjv2\") pod \"cert-manager-webhook-6486ffd997-zbjpw\" (UID: \"5c6a9967-f00c-4049-ad09-469f66d83a3f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zbjpw"
Jul 02 17:02:20.470930 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.470792    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c6a9967-f00c-4049-ad09-469f66d83a3f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zbjpw\" (UID: \"5c6a9967-f00c-4049-ad09-469f66d83a3f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zbjpw"
Jul 02 17:02:20.571384 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.571300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjv2\" (UniqueName: \"kubernetes.io/projected/5c6a9967-f00c-4049-ad09-469f66d83a3f-kube-api-access-htjv2\") pod \"cert-manager-webhook-6486ffd997-zbjpw\" (UID: \"5c6a9967-f00c-4049-ad09-469f66d83a3f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zbjpw"
Jul 02 17:02:20.571522 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.571382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c6a9967-f00c-4049-ad09-469f66d83a3f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zbjpw\" (UID: \"5c6a9967-f00c-4049-ad09-469f66d83a3f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zbjpw"
Jul 02 17:02:20.582290 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.582263    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c6a9967-f00c-4049-ad09-469f66d83a3f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zbjpw\" (UID: \"5c6a9967-f00c-4049-ad09-469f66d83a3f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zbjpw"
Jul 02 17:02:20.582514 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.582496    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htjv2\" (UniqueName: \"kubernetes.io/projected/5c6a9967-f00c-4049-ad09-469f66d83a3f-kube-api-access-htjv2\") pod \"cert-manager-webhook-6486ffd997-zbjpw\" (UID: \"5c6a9967-f00c-4049-ad09-469f66d83a3f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zbjpw"
Jul 02 17:02:20.721620 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.721575    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zbjpw"
Jul 02 17:02:20.737490 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.737458    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:20.858877 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.858844    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:20.870829 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:20.870804    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zbjpw"]
Jul 02 17:02:20.873565 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:02:20.873532    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c6a9967_f00c_4049_ad09_469f66d83a3f.slice/crio-9b6993176b5ebdf50f78fc459be3b99e86649ec1b521bc505acf55823cad4a2f WatchSource:0}: Error finding container 9b6993176b5ebdf50f78fc459be3b99e86649ec1b521bc505acf55823cad4a2f: Status 404 returned error can't find the container with id 9b6993176b5ebdf50f78fc459be3b99e86649ec1b521bc505acf55823cad4a2f
Jul 02 17:02:21.321119 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.321006    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zbjpw" event={"ID":"5c6a9967-f00c-4049-ad09-469f66d83a3f","Type":"ContainerStarted","Data":"9b6993176b5ebdf50f78fc459be3b99e86649ec1b521bc505acf55823cad4a2f"}
Jul 02 17:02:21.369482 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.369444    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"]
Jul 02 17:02:21.372461 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.372436    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"
Jul 02 17:02:21.374856 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.374834    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 17:02:21.374856 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.374837    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 17:02:21.375062 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.374883    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f8brm\""
Jul 02 17:02:21.388495 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.388465    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"]
Jul 02 17:02:21.477468 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.477428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09faeb3c-7083-4c49-920e-4816c4d41464-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh\" (UID: \"09faeb3c-7083-4c49-920e-4816c4d41464\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"
Jul 02 17:02:21.477648 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.477481    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68p4k\" (UniqueName: \"kubernetes.io/projected/09faeb3c-7083-4c49-920e-4816c4d41464-kube-api-access-68p4k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh\" (UID: \"09faeb3c-7083-4c49-920e-4816c4d41464\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"
Jul 02 17:02:21.477648 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.477556    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09faeb3c-7083-4c49-920e-4816c4d41464-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh\" (UID: \"09faeb3c-7083-4c49-920e-4816c4d41464\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"
Jul 02 17:02:21.578180 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.578065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09faeb3c-7083-4c49-920e-4816c4d41464-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh\" (UID: \"09faeb3c-7083-4c49-920e-4816c4d41464\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"
Jul 02 17:02:21.578180 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.578169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09faeb3c-7083-4c49-920e-4816c4d41464-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh\" (UID: \"09faeb3c-7083-4c49-920e-4816c4d41464\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"
Jul 02 17:02:21.578359 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.578203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68p4k\" (UniqueName: \"kubernetes.io/projected/09faeb3c-7083-4c49-920e-4816c4d41464-kube-api-access-68p4k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh\" (UID: \"09faeb3c-7083-4c49-920e-4816c4d41464\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"
Jul 02 17:02:21.578475 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.578455    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09faeb3c-7083-4c49-920e-4816c4d41464-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh\" (UID: \"09faeb3c-7083-4c49-920e-4816c4d41464\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"
Jul 02 17:02:21.578516 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.578499    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09faeb3c-7083-4c49-920e-4816c4d41464-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh\" (UID: \"09faeb3c-7083-4c49-920e-4816c4d41464\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"
Jul 02 17:02:21.586627 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.586598    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68p4k\" (UniqueName: \"kubernetes.io/projected/09faeb3c-7083-4c49-920e-4816c4d41464-kube-api-access-68p4k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh\" (UID: \"09faeb3c-7083-4c49-920e-4816c4d41464\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"
Jul 02 17:02:21.681742 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.681711    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"
Jul 02 17:02:21.821833 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:21.821801    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"]
Jul 02 17:02:21.825066 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:02:21.825035    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09faeb3c_7083_4c49_920e_4816c4d41464.slice/crio-9fe76c364940e205d22b9fb6df7440c4601f760d0db975854004e85b1ae37395 WatchSource:0}: Error finding container 9fe76c364940e205d22b9fb6df7440c4601f760d0db975854004e85b1ae37395: Status 404 returned error can't find the container with id 9fe76c364940e205d22b9fb6df7440c4601f760d0db975854004e85b1ae37395
Jul 02 17:02:22.326943 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:22.326906    2579 generic.go:356] "Generic (PLEG): container finished" podID="09faeb3c-7083-4c49-920e-4816c4d41464" containerID="f7b76f59adb6629bd3495597f8c71ec8b5f41f1b904775596de26813873292a5" exitCode=0
Jul 02 17:02:22.326943 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:22.326947    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh" event={"ID":"09faeb3c-7083-4c49-920e-4816c4d41464","Type":"ContainerDied","Data":"f7b76f59adb6629bd3495597f8c71ec8b5f41f1b904775596de26813873292a5"}
Jul 02 17:02:22.327384 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:22.326983    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh" event={"ID":"09faeb3c-7083-4c49-920e-4816c4d41464","Type":"ContainerStarted","Data":"9fe76c364940e205d22b9fb6df7440c4601f760d0db975854004e85b1ae37395"}
Jul 02 17:02:22.484404 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:22.484367    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:22.937034 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:22.936945    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:24.659301 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:24.659262    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:25.343185 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:25.343145    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zbjpw" event={"ID":"5c6a9967-f00c-4049-ad09-469f66d83a3f","Type":"ContainerStarted","Data":"434beca475bdcc53f0d69ca33de407c51461f6ff5739cbcd824f7aaca0c196ab"}
Jul 02 17:02:25.343343 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:25.343207    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zbjpw"
Jul 02 17:02:25.359754 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:25.359703    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-zbjpw" podStartSLOduration=1.9076033589999999 podStartE2EDuration="5.359686475s" totalImagesPullingTime="3.452083116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:02:25.357910579 +0000 UTC m=+484.724576543" watchObservedRunningTime="2026-07-02 17:02:25.359686475 +0000 UTC m=+484.726352436"
Jul 02 17:02:25.529458 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:25.529422    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:25.584262 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:25.584222    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:26.349739 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:26.349703    2579 generic.go:356] "Generic (PLEG): container finished" podID="09faeb3c-7083-4c49-920e-4816c4d41464" containerID="a6ca96df7b2162348c546fd564bd3e426dff934c18c7e2192d3baa1f24903f25" exitCode=0
Jul 02 17:02:26.350157 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:26.349797    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh" event={"ID":"09faeb3c-7083-4c49-920e-4816c4d41464","Type":"ContainerDied","Data":"a6ca96df7b2162348c546fd564bd3e426dff934c18c7e2192d3baa1f24903f25"}
Jul 02 17:02:27.357269 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:27.357229    2579 generic.go:356] "Generic (PLEG): container finished" podID="09faeb3c-7083-4c49-920e-4816c4d41464" containerID="e9490839715068698d90239bcf2832babb6d5fe07c686ef41aa5e6be28892a48" exitCode=0
Jul 02 17:02:27.357651 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:27.357275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh" event={"ID":"09faeb3c-7083-4c49-920e-4816c4d41464","Type":"ContainerDied","Data":"e9490839715068698d90239bcf2832babb6d5fe07c686ef41aa5e6be28892a48"}
Jul 02 17:02:28.486906 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:28.486881    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"
Jul 02 17:02:28.539145 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:28.539112    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68p4k\" (UniqueName: \"kubernetes.io/projected/09faeb3c-7083-4c49-920e-4816c4d41464-kube-api-access-68p4k\") pod \"09faeb3c-7083-4c49-920e-4816c4d41464\" (UID: \"09faeb3c-7083-4c49-920e-4816c4d41464\") "
Jul 02 17:02:28.539314 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:28.539198    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09faeb3c-7083-4c49-920e-4816c4d41464-bundle\") pod \"09faeb3c-7083-4c49-920e-4816c4d41464\" (UID: \"09faeb3c-7083-4c49-920e-4816c4d41464\") "
Jul 02 17:02:28.539314 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:28.539251    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09faeb3c-7083-4c49-920e-4816c4d41464-util\") pod \"09faeb3c-7083-4c49-920e-4816c4d41464\" (UID: \"09faeb3c-7083-4c49-920e-4816c4d41464\") "
Jul 02 17:02:28.539620 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:28.539591    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09faeb3c-7083-4c49-920e-4816c4d41464-bundle" (OuterVolumeSpecName: "bundle") pod "09faeb3c-7083-4c49-920e-4816c4d41464" (UID: "09faeb3c-7083-4c49-920e-4816c4d41464"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:02:28.541173 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:28.541141    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09faeb3c-7083-4c49-920e-4816c4d41464-kube-api-access-68p4k" (OuterVolumeSpecName: "kube-api-access-68p4k") pod "09faeb3c-7083-4c49-920e-4816c4d41464" (UID: "09faeb3c-7083-4c49-920e-4816c4d41464"). InnerVolumeSpecName "kube-api-access-68p4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:02:28.543591 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:28.543552    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09faeb3c-7083-4c49-920e-4816c4d41464-util" (OuterVolumeSpecName: "util") pod "09faeb3c-7083-4c49-920e-4816c4d41464" (UID: "09faeb3c-7083-4c49-920e-4816c4d41464"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:02:28.639950 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:28.639868    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09faeb3c-7083-4c49-920e-4816c4d41464-util\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:02:28.639950 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:28.639899    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68p4k\" (UniqueName: \"kubernetes.io/projected/09faeb3c-7083-4c49-920e-4816c4d41464-kube-api-access-68p4k\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:02:28.639950 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:28.639910    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09faeb3c-7083-4c49-920e-4816c4d41464-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:02:29.367084 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:29.367050    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh"
Jul 02 17:02:29.367329 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:29.367044    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fszdkh" event={"ID":"09faeb3c-7083-4c49-920e-4816c4d41464","Type":"ContainerDied","Data":"9fe76c364940e205d22b9fb6df7440c4601f760d0db975854004e85b1ae37395"}
Jul 02 17:02:29.367329 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:29.367186    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fe76c364940e205d22b9fb6df7440c4601f760d0db975854004e85b1ae37395"
Jul 02 17:02:30.895173 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:30.895132    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:31.352525 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:31.352493    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zbjpw"
Jul 02 17:02:37.347195 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:37.347155    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:37.442871 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:37.442842    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:39.356804 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.356764    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck"]
Jul 02 17:02:39.357207 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.357067    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09faeb3c-7083-4c49-920e-4816c4d41464" containerName="util"
Jul 02 17:02:39.357207 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.357078    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="09faeb3c-7083-4c49-920e-4816c4d41464" containerName="util"
Jul 02 17:02:39.357207 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.357105    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09faeb3c-7083-4c49-920e-4816c4d41464" containerName="pull"
Jul 02 17:02:39.357207 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.357111    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="09faeb3c-7083-4c49-920e-4816c4d41464" containerName="pull"
Jul 02 17:02:39.357207 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.357120    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09faeb3c-7083-4c49-920e-4816c4d41464" containerName="extract"
Jul 02 17:02:39.357207 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.357125    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="09faeb3c-7083-4c49-920e-4816c4d41464" containerName="extract"
Jul 02 17:02:39.357207 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.357178    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="09faeb3c-7083-4c49-920e-4816c4d41464" containerName="extract"
Jul 02 17:02:39.389851 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.389818    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck"]
Jul 02 17:02:39.390073 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.389953    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck"
Jul 02 17:02:39.393176 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.393154    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kfp85\""
Jul 02 17:02:39.393176 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.393167    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 17:02:39.393305 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.393172    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 17:02:39.535018 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.534975    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bws7w\" (UniqueName: \"kubernetes.io/projected/1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18-kube-api-access-bws7w\") pod \"openshift-lws-operator-fd8ccff4c-qb9ck\" (UID: \"1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck"
Jul 02 17:02:39.535018 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.535021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qb9ck\" (UID: \"1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck"
Jul 02 17:02:39.636491 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.636399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bws7w\" (UniqueName: \"kubernetes.io/projected/1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18-kube-api-access-bws7w\") pod \"openshift-lws-operator-fd8ccff4c-qb9ck\" (UID: \"1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck"
Jul 02 17:02:39.636491 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.636439    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qb9ck\" (UID: \"1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck"
Jul 02 17:02:39.636854 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.636831    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qb9ck\" (UID: \"1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck"
Jul 02 17:02:39.644228 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.644204    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bws7w\" (UniqueName: \"kubernetes.io/projected/1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18-kube-api-access-bws7w\") pod \"openshift-lws-operator-fd8ccff4c-qb9ck\" (UID: \"1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck"
Jul 02 17:02:39.699170 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.699138    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck"
Jul 02 17:02:39.860414 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:39.860388    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck"]
Jul 02 17:02:39.863375 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:02:39.863344    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1bbaf0ca_5b8c_4d58_a6f3_c3ccbfa2fe18.slice/crio-5bf05dc1c64e704ee59ba227e9a2817ec048e2b276fa683c14277513e7dcac1a WatchSource:0}: Error finding container 5bf05dc1c64e704ee59ba227e9a2817ec048e2b276fa683c14277513e7dcac1a: Status 404 returned error can't find the container with id 5bf05dc1c64e704ee59ba227e9a2817ec048e2b276fa683c14277513e7dcac1a
Jul 02 17:02:40.413182 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:40.413150    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck" event={"ID":"1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18","Type":"ContainerStarted","Data":"5bf05dc1c64e704ee59ba227e9a2817ec048e2b276fa683c14277513e7dcac1a"}
Jul 02 17:02:42.424036 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:42.423998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck" event={"ID":"1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18","Type":"ContainerStarted","Data":"38d62eff88a40a2ccfd8c48e5d98b5919abbf74c2542e8f2c52da98921a0d7a1"}
Jul 02 17:02:42.440804 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:42.440753    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qb9ck" podStartSLOduration=1.660696303 podStartE2EDuration="3.440737129s" totalImagesPullingTime="1.780040826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:02:42.438638847 +0000 UTC m=+501.805304810" watchObservedRunningTime="2026-07-02 17:02:42.440737129 +0000 UTC m=+501.807403090"
Jul 02 17:02:43.315645 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:43.315604    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:43.414267 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:43.414236    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:45.427354 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:45.427323    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:47.225292 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.225258    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"]
Jul 02 17:02:47.227594 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.227574    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"
Jul 02 17:02:47.230222 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.230195    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 17:02:47.230348 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.230235    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 17:02:47.230348 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.230201    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f8brm\""
Jul 02 17:02:47.236961 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.236936    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"]
Jul 02 17:02:47.304025 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.303984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a973ee30-71be-474f-81e3-e18746f100b0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l\" (UID: \"a973ee30-71be-474f-81e3-e18746f100b0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"
Jul 02 17:02:47.304213 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.304034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a973ee30-71be-474f-81e3-e18746f100b0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l\" (UID: \"a973ee30-71be-474f-81e3-e18746f100b0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"
Jul 02 17:02:47.304261 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.304211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7bwv\" (UniqueName: \"kubernetes.io/projected/a973ee30-71be-474f-81e3-e18746f100b0-kube-api-access-j7bwv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l\" (UID: \"a973ee30-71be-474f-81e3-e18746f100b0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"
Jul 02 17:02:47.405071 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.405027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7bwv\" (UniqueName: \"kubernetes.io/projected/a973ee30-71be-474f-81e3-e18746f100b0-kube-api-access-j7bwv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l\" (UID: \"a973ee30-71be-474f-81e3-e18746f100b0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"
Jul 02 17:02:47.405264 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.405124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a973ee30-71be-474f-81e3-e18746f100b0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l\" (UID: \"a973ee30-71be-474f-81e3-e18746f100b0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"
Jul 02 17:02:47.405314 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.405284    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a973ee30-71be-474f-81e3-e18746f100b0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l\" (UID: \"a973ee30-71be-474f-81e3-e18746f100b0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"
Jul 02 17:02:47.405540 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.405522    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a973ee30-71be-474f-81e3-e18746f100b0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l\" (UID: \"a973ee30-71be-474f-81e3-e18746f100b0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"
Jul 02 17:02:47.405578 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.405556    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a973ee30-71be-474f-81e3-e18746f100b0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l\" (UID: \"a973ee30-71be-474f-81e3-e18746f100b0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"
Jul 02 17:02:47.412912 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.412877    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7bwv\" (UniqueName: \"kubernetes.io/projected/a973ee30-71be-474f-81e3-e18746f100b0-kube-api-access-j7bwv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l\" (UID: \"a973ee30-71be-474f-81e3-e18746f100b0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"
Jul 02 17:02:47.538110 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.537988    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"
Jul 02 17:02:47.670002 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:47.669976    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"]
Jul 02 17:02:47.672321 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:02:47.672288    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda973ee30_71be_474f_81e3_e18746f100b0.slice/crio-9b04ebf0041b20f170632ccd5b5230b59cfa396db6b9ae959ae1ac03d4ad34e1 WatchSource:0}: Error finding container 9b04ebf0041b20f170632ccd5b5230b59cfa396db6b9ae959ae1ac03d4ad34e1: Status 404 returned error can't find the container with id 9b04ebf0041b20f170632ccd5b5230b59cfa396db6b9ae959ae1ac03d4ad34e1
Jul 02 17:02:48.449974 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:48.449931    2579 generic.go:356] "Generic (PLEG): container finished" podID="a973ee30-71be-474f-81e3-e18746f100b0" containerID="499a1f1db7b808885e5fcbdd068eff9f6d585d85711ed54414a53e01fcb71155" exitCode=0
Jul 02 17:02:48.450340 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:48.450010    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l" event={"ID":"a973ee30-71be-474f-81e3-e18746f100b0","Type":"ContainerDied","Data":"499a1f1db7b808885e5fcbdd068eff9f6d585d85711ed54414a53e01fcb71155"}
Jul 02 17:02:48.450340 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:48.450100    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l" event={"ID":"a973ee30-71be-474f-81e3-e18746f100b0","Type":"ContainerStarted","Data":"9b04ebf0041b20f170632ccd5b5230b59cfa396db6b9ae959ae1ac03d4ad34e1"}
Jul 02 17:02:49.455798 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:49.455764    2579 generic.go:356] "Generic (PLEG): container finished" podID="a973ee30-71be-474f-81e3-e18746f100b0" containerID="4dd43906a3c7f7f2c294b925b8a9842935f6af1ac4a3364e5aeb92290f280cba" exitCode=0
Jul 02 17:02:49.456256 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:49.455845    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l" event={"ID":"a973ee30-71be-474f-81e3-e18746f100b0","Type":"ContainerDied","Data":"4dd43906a3c7f7f2c294b925b8a9842935f6af1ac4a3364e5aeb92290f280cba"}
Jul 02 17:02:50.462739 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:50.462704    2579 generic.go:356] "Generic (PLEG): container finished" podID="a973ee30-71be-474f-81e3-e18746f100b0" containerID="44c28c370b61b012d493cde4f97425117e53319d4fdf62afdac4c63937d1a7ca" exitCode=0
Jul 02 17:02:50.463146 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:50.462767    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l" event={"ID":"a973ee30-71be-474f-81e3-e18746f100b0","Type":"ContainerDied","Data":"44c28c370b61b012d493cde4f97425117e53319d4fdf62afdac4c63937d1a7ca"}
Jul 02 17:02:51.588920 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:51.588895    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"
Jul 02 17:02:51.742958 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:51.742874    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7bwv\" (UniqueName: \"kubernetes.io/projected/a973ee30-71be-474f-81e3-e18746f100b0-kube-api-access-j7bwv\") pod \"a973ee30-71be-474f-81e3-e18746f100b0\" (UID: \"a973ee30-71be-474f-81e3-e18746f100b0\") "
Jul 02 17:02:51.742958 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:51.742929    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a973ee30-71be-474f-81e3-e18746f100b0-bundle\") pod \"a973ee30-71be-474f-81e3-e18746f100b0\" (UID: \"a973ee30-71be-474f-81e3-e18746f100b0\") "
Jul 02 17:02:51.743161 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:51.742978    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a973ee30-71be-474f-81e3-e18746f100b0-util\") pod \"a973ee30-71be-474f-81e3-e18746f100b0\" (UID: \"a973ee30-71be-474f-81e3-e18746f100b0\") "
Jul 02 17:02:51.743709 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:51.743675    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a973ee30-71be-474f-81e3-e18746f100b0-bundle" (OuterVolumeSpecName: "bundle") pod "a973ee30-71be-474f-81e3-e18746f100b0" (UID: "a973ee30-71be-474f-81e3-e18746f100b0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:02:51.744946 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:51.744927    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a973ee30-71be-474f-81e3-e18746f100b0-kube-api-access-j7bwv" (OuterVolumeSpecName: "kube-api-access-j7bwv") pod "a973ee30-71be-474f-81e3-e18746f100b0" (UID: "a973ee30-71be-474f-81e3-e18746f100b0"). InnerVolumeSpecName "kube-api-access-j7bwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:02:51.748589 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:51.748549    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a973ee30-71be-474f-81e3-e18746f100b0-util" (OuterVolumeSpecName: "util") pod "a973ee30-71be-474f-81e3-e18746f100b0" (UID: "a973ee30-71be-474f-81e3-e18746f100b0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:02:51.843961 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:51.843927    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a973ee30-71be-474f-81e3-e18746f100b0-util\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:02:51.843961 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:51.843953    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7bwv\" (UniqueName: \"kubernetes.io/projected/a973ee30-71be-474f-81e3-e18746f100b0-kube-api-access-j7bwv\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:02:51.843961 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:51.843963    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a973ee30-71be-474f-81e3-e18746f100b0-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:02:52.472746 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:52.472706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l" event={"ID":"a973ee30-71be-474f-81e3-e18746f100b0","Type":"ContainerDied","Data":"9b04ebf0041b20f170632ccd5b5230b59cfa396db6b9ae959ae1ac03d4ad34e1"}
Jul 02 17:02:52.472921 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:52.472765    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b04ebf0041b20f170632ccd5b5230b59cfa396db6b9ae959ae1ac03d4ad34e1"
Jul 02 17:02:52.472921 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:52.472721    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affx87l"
Jul 02 17:02:53.192624 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:53.192593    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:53.291210 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:53.291174    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:57.729224 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.729177    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:57.773698 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.773659    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"]
Jul 02 17:02:57.774067 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.774049    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a973ee30-71be-474f-81e3-e18746f100b0" containerName="pull"
Jul 02 17:02:57.774181 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.774070    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a973ee30-71be-474f-81e3-e18746f100b0" containerName="pull"
Jul 02 17:02:57.774181 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.774123    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a973ee30-71be-474f-81e3-e18746f100b0" containerName="util"
Jul 02 17:02:57.774181 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.774132    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a973ee30-71be-474f-81e3-e18746f100b0" containerName="util"
Jul 02 17:02:57.774181 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.774142    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a973ee30-71be-474f-81e3-e18746f100b0" containerName="extract"
Jul 02 17:02:57.774181 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.774150    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a973ee30-71be-474f-81e3-e18746f100b0" containerName="extract"
Jul 02 17:02:57.774419 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.774225    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a973ee30-71be-474f-81e3-e18746f100b0" containerName="extract"
Jul 02 17:02:57.777298 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.777277    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:57.781358 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.781332    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 17:02:57.781358 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.781347    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 17:02:57.781527 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.781332    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 17:02:57.781527 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.781403    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ss8bb\""
Jul 02 17:02:57.788838 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.788817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"]
Jul 02 17:02:57.794910 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.794885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51a22668-5d8c-42ed-ad0c-173261541d5c-cert\") pod \"lws-controller-manager-f87dff94c-xx7p5\" (UID: \"51a22668-5d8c-42ed-ad0c-173261541d5c\") " pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:57.795037 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.794936    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/51a22668-5d8c-42ed-ad0c-173261541d5c-manager-config\") pod \"lws-controller-manager-f87dff94c-xx7p5\" (UID: \"51a22668-5d8c-42ed-ad0c-173261541d5c\") " pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:57.795037 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.795009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkjrp\" (UniqueName: \"kubernetes.io/projected/51a22668-5d8c-42ed-ad0c-173261541d5c-kube-api-access-bkjrp\") pod \"lws-controller-manager-f87dff94c-xx7p5\" (UID: \"51a22668-5d8c-42ed-ad0c-173261541d5c\") " pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:57.795152 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.795064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/51a22668-5d8c-42ed-ad0c-173261541d5c-metrics-cert\") pod \"lws-controller-manager-f87dff94c-xx7p5\" (UID: \"51a22668-5d8c-42ed-ad0c-173261541d5c\") " pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:57.848041 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.848010    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:57.896338 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.896302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51a22668-5d8c-42ed-ad0c-173261541d5c-cert\") pod \"lws-controller-manager-f87dff94c-xx7p5\" (UID: \"51a22668-5d8c-42ed-ad0c-173261541d5c\") " pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:57.896509 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.896350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/51a22668-5d8c-42ed-ad0c-173261541d5c-manager-config\") pod \"lws-controller-manager-f87dff94c-xx7p5\" (UID: \"51a22668-5d8c-42ed-ad0c-173261541d5c\") " pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:57.896509 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.896386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkjrp\" (UniqueName: \"kubernetes.io/projected/51a22668-5d8c-42ed-ad0c-173261541d5c-kube-api-access-bkjrp\") pod \"lws-controller-manager-f87dff94c-xx7p5\" (UID: \"51a22668-5d8c-42ed-ad0c-173261541d5c\") " pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:57.896509 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.896413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/51a22668-5d8c-42ed-ad0c-173261541d5c-metrics-cert\") pod \"lws-controller-manager-f87dff94c-xx7p5\" (UID: \"51a22668-5d8c-42ed-ad0c-173261541d5c\") " pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:57.897144 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.897121    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/51a22668-5d8c-42ed-ad0c-173261541d5c-manager-config\") pod \"lws-controller-manager-f87dff94c-xx7p5\" (UID: \"51a22668-5d8c-42ed-ad0c-173261541d5c\") " pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:57.898887 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.898855    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/51a22668-5d8c-42ed-ad0c-173261541d5c-metrics-cert\") pod \"lws-controller-manager-f87dff94c-xx7p5\" (UID: \"51a22668-5d8c-42ed-ad0c-173261541d5c\") " pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:57.898988 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.898911    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51a22668-5d8c-42ed-ad0c-173261541d5c-cert\") pod \"lws-controller-manager-f87dff94c-xx7p5\" (UID: \"51a22668-5d8c-42ed-ad0c-173261541d5c\") " pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:57.910400 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:57.910375    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkjrp\" (UniqueName: \"kubernetes.io/projected/51a22668-5d8c-42ed-ad0c-173261541d5c-kube-api-access-bkjrp\") pod \"lws-controller-manager-f87dff94c-xx7p5\" (UID: \"51a22668-5d8c-42ed-ad0c-173261541d5c\") " pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:58.086447 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:58.086419    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:02:58.175078 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:58.175042    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:58.247429 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:58.247398    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"]
Jul 02 17:02:58.250319 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:02:58.250288    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a22668_5d8c_42ed_ad0c_173261541d5c.slice/crio-4040f87387ec31c34061ab9f1934f0554e552cdfffbce9eeb7c07c21a57e625c WatchSource:0}: Error finding container 4040f87387ec31c34061ab9f1934f0554e552cdfffbce9eeb7c07c21a57e625c: Status 404 returned error can't find the container with id 4040f87387ec31c34061ab9f1934f0554e552cdfffbce9eeb7c07c21a57e625c
Jul 02 17:02:58.280528 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:58.280484    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:58.499830 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:58.499744    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5" event={"ID":"51a22668-5d8c-42ed-ad0c-173261541d5c","Type":"ContainerStarted","Data":"4040f87387ec31c34061ab9f1934f0554e552cdfffbce9eeb7c07c21a57e625c"}
Jul 02 17:02:58.788626 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:58.788536    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:59.013620 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.013583    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:59.113786 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.113758    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:59.151130 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.151068    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"]
Jul 02 17:02:59.154207 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.154184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.157331 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.157308    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 17:02:59.157554 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.157532    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 17:02:59.157554 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.157545    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k2nc7\""
Jul 02 17:02:59.157715 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.157540    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 17:02:59.157715 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.157608    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 17:02:59.179538 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.179442    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"]
Jul 02 17:02:59.207240 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.207212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.207426 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.207293    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-manifests\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.207426 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.207335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.207426 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.207361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-tmp\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.207426 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.207393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62hhz\" (UniqueName: \"kubernetes.io/projected/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-kube-api-access-62hhz\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.307812 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.307777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hhz\" (UniqueName: \"kubernetes.io/projected/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-kube-api-access-62hhz\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.308000 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.307839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.308000 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.307899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-manifests\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.308000 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.307935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.308000 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.307955    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-tmp\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.308476 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.308391    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-manifests\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.310829 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.310800    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-tmp\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.310936 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.310872    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.310992 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.310956    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.317759 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.317730    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62hhz\" (UniqueName: \"kubernetes.io/projected/7ede4f31-d5ad-4a10-ba81-9008d2ee14dc-kube-api-access-62hhz\") pod \"opendatahub-operator-controller-manager-845f459c56-28hvq\" (UID: \"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc\") " pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.319581 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.319550    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:59.422598 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.422509    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:59.464612 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.464567    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:02:59.520533 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.520478    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:59.594783 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.594741    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:59.635406 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.635368    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"]
Jul 02 17:02:59.679209 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.679127    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:59.775334 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:02:59.775283    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:02:59.982367 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:02:59.982070    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ede4f31_d5ad_4a10_ba81_9008d2ee14dc.slice/crio-1fc649231619d6a4a627fa0c0702f7022d4158fa04170814dfbf907bb3d0b324 WatchSource:0}: Error finding container 1fc649231619d6a4a627fa0c0702f7022d4158fa04170814dfbf907bb3d0b324: Status 404 returned error can't find the container with id 1fc649231619d6a4a627fa0c0702f7022d4158fa04170814dfbf907bb3d0b324
Jul 02 17:03:00.519662 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:00.519622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq" event={"ID":"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc","Type":"ContainerStarted","Data":"1fc649231619d6a4a627fa0c0702f7022d4158fa04170814dfbf907bb3d0b324"}
Jul 02 17:03:00.521787 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:00.521748    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5" event={"ID":"51a22668-5d8c-42ed-ad0c-173261541d5c","Type":"ContainerStarted","Data":"379718532e28a5c1a64e559836f6259ac495da7f0be63603362761c7c1bf8bb8"}
Jul 02 17:03:00.521972 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:00.521900    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:03:00.538709 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:00.538648    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5" podStartSLOduration=1.774190955 podStartE2EDuration="3.538626573s" totalImagesPullingTime="1.764435618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:02:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:00.538333948 +0000 UTC m=+519.904999911" watchObservedRunningTime="2026-07-02 17:03:00.538626573 +0000 UTC m=+519.905292538"
Jul 02 17:03:03.540155 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:03.540061    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq" event={"ID":"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc","Type":"ContainerStarted","Data":"7baf988dce6d3de80d33b9e0fc0ddb3664434fa2a2b9c6b40fd4a92b0502c131"}
Jul 02 17:03:04.546298 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:04.546266    2579 generic.go:356] "Generic (PLEG): container finished" podID="7ede4f31-d5ad-4a10-ba81-9008d2ee14dc" containerID="7baf988dce6d3de80d33b9e0fc0ddb3664434fa2a2b9c6b40fd4a92b0502c131" exitCode=0
Jul 02 17:03:04.546724 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:04.546314    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq" event={"ID":"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc","Type":"ContainerDied","Data":"7baf988dce6d3de80d33b9e0fc0ddb3664434fa2a2b9c6b40fd4a92b0502c131"}
Jul 02 17:03:05.552972 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:05.552934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq" event={"ID":"7ede4f31-d5ad-4a10-ba81-9008d2ee14dc","Type":"ContainerStarted","Data":"0f8b1b154b4cd66341885f8ee6e50347c7dcb4ccd01f3241c7fb1db12f476a7e"}
Jul 02 17:03:05.553502 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:05.553019    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:03:05.574826 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:05.574769    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq" podStartSLOduration=1.935155008 podStartE2EDuration="6.574751199s" totalImagesPullingTime="3.576487816s" totalInitContainerRuntime="1.063108375s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:02:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:05.573714952 +0000 UTC m=+524.940380930" watchObservedRunningTime="2026-07-02 17:03:05.574751199 +0000 UTC m=+524.941417163"
Jul 02 17:03:10.330901 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:10.330864    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:10.433787 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:10.433755    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:11.529823 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:11.529788    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f87dff94c-xx7p5"
Jul 02 17:03:16.198279 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:16.198187    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:16.298344 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:16.298308    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:16.560507 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:16.560430    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-845f459c56-28hvq"
Jul 02 17:03:18.145524 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:18.145491    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:18.284030 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:18.283990    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:19.203561 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.203515    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:19.300334 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.300280    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:19.572882 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.572793    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:19.771573 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.771535    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"]
Jul 02 17:03:19.775010 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.774991    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"
Jul 02 17:03:19.778340 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.778314    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gpqz8\""
Jul 02 17:03:19.779182 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.779162    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 17:03:19.779326 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.779306    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 17:03:19.791835 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.791799    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"]
Jul 02 17:03:19.870787 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.870755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a9a9dbf-7184-4fa5-811a-b85ec20e68ae-tmp\") pod \"kube-auth-proxy-7bc8ccd95b-2lt8r\" (UID: \"7a9a9dbf-7184-4fa5-811a-b85ec20e68ae\") " pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"
Jul 02 17:03:19.870977 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.870823    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a9a9dbf-7184-4fa5-811a-b85ec20e68ae-tls-certs\") pod \"kube-auth-proxy-7bc8ccd95b-2lt8r\" (UID: \"7a9a9dbf-7184-4fa5-811a-b85ec20e68ae\") " pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"
Jul 02 17:03:19.870977 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.870878    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmwgt\" (UniqueName: \"kubernetes.io/projected/7a9a9dbf-7184-4fa5-811a-b85ec20e68ae-kube-api-access-nmwgt\") pod \"kube-auth-proxy-7bc8ccd95b-2lt8r\" (UID: \"7a9a9dbf-7184-4fa5-811a-b85ec20e68ae\") " pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"
Jul 02 17:03:19.934067 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.934031    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:19.972110 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.972059    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a9a9dbf-7184-4fa5-811a-b85ec20e68ae-tmp\") pod \"kube-auth-proxy-7bc8ccd95b-2lt8r\" (UID: \"7a9a9dbf-7184-4fa5-811a-b85ec20e68ae\") " pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"
Jul 02 17:03:19.972285 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.972173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a9a9dbf-7184-4fa5-811a-b85ec20e68ae-tls-certs\") pod \"kube-auth-proxy-7bc8ccd95b-2lt8r\" (UID: \"7a9a9dbf-7184-4fa5-811a-b85ec20e68ae\") " pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"
Jul 02 17:03:19.972285 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.972204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmwgt\" (UniqueName: \"kubernetes.io/projected/7a9a9dbf-7184-4fa5-811a-b85ec20e68ae-kube-api-access-nmwgt\") pod \"kube-auth-proxy-7bc8ccd95b-2lt8r\" (UID: \"7a9a9dbf-7184-4fa5-811a-b85ec20e68ae\") " pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"
Jul 02 17:03:19.972373 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:03:19.972338    2579 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 02 17:03:19.972459 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:03:19.972421    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9a9dbf-7184-4fa5-811a-b85ec20e68ae-tls-certs podName:7a9a9dbf-7184-4fa5-811a-b85ec20e68ae nodeName:}" failed. No retries permitted until 2026-07-02 17:03:20.472397742 +0000 UTC m=+539.839063686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7a9a9dbf-7184-4fa5-811a-b85ec20e68ae-tls-certs") pod "kube-auth-proxy-7bc8ccd95b-2lt8r" (UID: "7a9a9dbf-7184-4fa5-811a-b85ec20e68ae") : secret "kube-auth-proxy-tls" not found
Jul 02 17:03:19.975636 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.975601    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a9a9dbf-7184-4fa5-811a-b85ec20e68ae-tmp\") pod \"kube-auth-proxy-7bc8ccd95b-2lt8r\" (UID: \"7a9a9dbf-7184-4fa5-811a-b85ec20e68ae\") " pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"
Jul 02 17:03:19.997316 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:19.997242    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmwgt\" (UniqueName: \"kubernetes.io/projected/7a9a9dbf-7184-4fa5-811a-b85ec20e68ae-kube-api-access-nmwgt\") pod \"kube-auth-proxy-7bc8ccd95b-2lt8r\" (UID: \"7a9a9dbf-7184-4fa5-811a-b85ec20e68ae\") " pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"
Jul 02 17:03:20.047775 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:20.047737    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:20.147466 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:20.147367    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:20.248677 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:20.248634    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:20.478491 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:20.478400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a9a9dbf-7184-4fa5-811a-b85ec20e68ae-tls-certs\") pod \"kube-auth-proxy-7bc8ccd95b-2lt8r\" (UID: \"7a9a9dbf-7184-4fa5-811a-b85ec20e68ae\") " pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"
Jul 02 17:03:20.481190 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:20.481162    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a9a9dbf-7184-4fa5-811a-b85ec20e68ae-tls-certs\") pod \"kube-auth-proxy-7bc8ccd95b-2lt8r\" (UID: \"7a9a9dbf-7184-4fa5-811a-b85ec20e68ae\") " pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"
Jul 02 17:03:20.685336 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:20.685146    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"
Jul 02 17:03:20.783714 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:20.783677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:20.874884 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:20.874045    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r"]
Jul 02 17:03:20.877026 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:03:20.876995    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9a9dbf_7184_4fa5_811a_b85ec20e68ae.slice/crio-f516fd3e8b703ef03ff5b4d7b09d979981b7399cf63e4766dad105efbaead434 WatchSource:0}: Error finding container f516fd3e8b703ef03ff5b4d7b09d979981b7399cf63e4766dad105efbaead434: Status 404 returned error can't find the container with id f516fd3e8b703ef03ff5b4d7b09d979981b7399cf63e4766dad105efbaead434
Jul 02 17:03:20.975330 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:20.975296    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:21.074150 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:21.074014    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:21.628610 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:21.628570    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r" event={"ID":"7a9a9dbf-7184-4fa5-811a-b85ec20e68ae","Type":"ContainerStarted","Data":"f516fd3e8b703ef03ff5b4d7b09d979981b7399cf63e4766dad105efbaead434"}
Jul 02 17:03:21.995427 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:21.995344    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:24.414864 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:24.414835    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 17:03:24.648151 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:24.648117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r" event={"ID":"7a9a9dbf-7184-4fa5-811a-b85ec20e68ae","Type":"ContainerStarted","Data":"be3bdcbb8f8c2d8478b58defeb46f023a2012100a3cb1e06fc3e62535ccb338a"}
Jul 02 17:03:24.665279 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:24.665169    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7bc8ccd95b-2lt8r" podStartSLOduration=2.132197323 podStartE2EDuration="5.665150282s" totalImagesPullingTime="3.532952959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:03:24.663701972 +0000 UTC m=+544.030367948" watchObservedRunningTime="2026-07-02 17:03:24.665150282 +0000 UTC m=+544.031816286"
Jul 02 17:03:27.286612 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:27.286563    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:27.386825 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:27.386788    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:27.879801 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:27.879760    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:28.268900 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:28.268812    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:28.584000 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:28.583950    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:30.520923 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:30.520893    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:30.651108 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:30.651063    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:30.752761 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:30.752726    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:30.859851 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:30.859803    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:30.976879 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:30.976813    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:03:43.782832 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:03:43.782777    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:04:11.533675 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:11.533629    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:04:20.703217 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:20.703165    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:04:20.801329 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:20.801298    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:04:20.901276 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:20.901244    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:04:21.707432 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:21.707319    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:04:21.711455 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:21.708453    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:04:36.040193 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.040156    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"]
Jul 02 17:04:36.043635 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.043609    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"
Jul 02 17:04:36.045760 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.045743    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 17:04:36.045856 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.045781    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8c4pr\""
Jul 02 17:04:36.046598 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.046583    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 17:04:36.051126 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.051081    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"]
Jul 02 17:04:36.133444 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.133406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be8a6e93-77bd-4097-99bf-7c4def421b36-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg\" (UID: \"be8a6e93-77bd-4097-99bf-7c4def421b36\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"
Jul 02 17:04:36.133621 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.133464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp29b\" (UniqueName: \"kubernetes.io/projected/be8a6e93-77bd-4097-99bf-7c4def421b36-kube-api-access-qp29b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg\" (UID: \"be8a6e93-77bd-4097-99bf-7c4def421b36\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"
Jul 02 17:04:36.133621 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.133513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be8a6e93-77bd-4097-99bf-7c4def421b36-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg\" (UID: \"be8a6e93-77bd-4097-99bf-7c4def421b36\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"
Jul 02 17:04:36.234654 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.234612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be8a6e93-77bd-4097-99bf-7c4def421b36-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg\" (UID: \"be8a6e93-77bd-4097-99bf-7c4def421b36\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"
Jul 02 17:04:36.234845 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.234672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp29b\" (UniqueName: \"kubernetes.io/projected/be8a6e93-77bd-4097-99bf-7c4def421b36-kube-api-access-qp29b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg\" (UID: \"be8a6e93-77bd-4097-99bf-7c4def421b36\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"
Jul 02 17:04:36.234845 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.234707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be8a6e93-77bd-4097-99bf-7c4def421b36-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg\" (UID: \"be8a6e93-77bd-4097-99bf-7c4def421b36\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"
Jul 02 17:04:36.235039 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.234998    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be8a6e93-77bd-4097-99bf-7c4def421b36-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg\" (UID: \"be8a6e93-77bd-4097-99bf-7c4def421b36\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"
Jul 02 17:04:36.235132 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.235049    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be8a6e93-77bd-4097-99bf-7c4def421b36-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg\" (UID: \"be8a6e93-77bd-4097-99bf-7c4def421b36\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"
Jul 02 17:04:36.242575 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.242551    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp29b\" (UniqueName: \"kubernetes.io/projected/be8a6e93-77bd-4097-99bf-7c4def421b36-kube-api-access-qp29b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg\" (UID: \"be8a6e93-77bd-4097-99bf-7c4def421b36\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"
Jul 02 17:04:36.354406 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.354372    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"
Jul 02 17:04:36.487481 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.487455    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"]
Jul 02 17:04:36.489942 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:04:36.489916    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8a6e93_77bd_4097_99bf_7c4def421b36.slice/crio-7e9c5f29d1209be9c5436d8355e15eec52b24e8d633b24c5d6f77a9dd1659525 WatchSource:0}: Error finding container 7e9c5f29d1209be9c5436d8355e15eec52b24e8d633b24c5d6f77a9dd1659525: Status 404 returned error can't find the container with id 7e9c5f29d1209be9c5436d8355e15eec52b24e8d633b24c5d6f77a9dd1659525
Jul 02 17:04:36.829724 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.829636    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"]
Jul 02 17:04:36.832777 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.832755    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"
Jul 02 17:04:36.841462 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.841436    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"]
Jul 02 17:04:36.941629 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.941586    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2rsv\" (UniqueName: \"kubernetes.io/projected/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-kube-api-access-x2rsv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d\" (UID: \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"
Jul 02 17:04:36.941629 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.941639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d\" (UID: \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"
Jul 02 17:04:36.941861 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.941767    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d\" (UID: \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"
Jul 02 17:04:36.980858 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.980820    2579 generic.go:356] "Generic (PLEG): container finished" podID="be8a6e93-77bd-4097-99bf-7c4def421b36" containerID="c1c734a73bf61c0679d157fb0c1dbabeb6285c1ba5a531a4760350f9de171778" exitCode=0
Jul 02 17:04:36.981033 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.980902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg" event={"ID":"be8a6e93-77bd-4097-99bf-7c4def421b36","Type":"ContainerDied","Data":"c1c734a73bf61c0679d157fb0c1dbabeb6285c1ba5a531a4760350f9de171778"}
Jul 02 17:04:36.981033 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.980953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg" event={"ID":"be8a6e93-77bd-4097-99bf-7c4def421b36","Type":"ContainerStarted","Data":"7e9c5f29d1209be9c5436d8355e15eec52b24e8d633b24c5d6f77a9dd1659525"}
Jul 02 17:04:36.981797 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:36.981773    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 17:04:37.042450 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.042410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d\" (UID: \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"
Jul 02 17:04:37.042866 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.042464    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2rsv\" (UniqueName: \"kubernetes.io/projected/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-kube-api-access-x2rsv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d\" (UID: \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"
Jul 02 17:04:37.042866 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.042575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d\" (UID: \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"
Jul 02 17:04:37.042950 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.042865    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d\" (UID: \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"
Jul 02 17:04:37.042950 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.042882    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d\" (UID: \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"
Jul 02 17:04:37.050466 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.050435    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2rsv\" (UniqueName: \"kubernetes.io/projected/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-kube-api-access-x2rsv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d\" (UID: \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"
Jul 02 17:04:37.142799 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.142741    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"
Jul 02 17:04:37.269522 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.269480    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"]
Jul 02 17:04:37.272313 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:04:37.272281    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ae3f4d_5a61_472d_9a6b_237d99ebcf59.slice/crio-dd644c501ce42e121a7e3dedd4400c845d96c2bcdb15c3b5efe13f5cb33e1613 WatchSource:0}: Error finding container dd644c501ce42e121a7e3dedd4400c845d96c2bcdb15c3b5efe13f5cb33e1613: Status 404 returned error can't find the container with id dd644c501ce42e121a7e3dedd4400c845d96c2bcdb15c3b5efe13f5cb33e1613
Jul 02 17:04:37.430753 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.430677    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"]
Jul 02 17:04:37.434186 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.434163    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"
Jul 02 17:04:37.442514 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.442488    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"]
Jul 02 17:04:37.546348 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.546308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfkdw\" (UniqueName: \"kubernetes.io/projected/9a496653-903b-4ef7-9e8e-91a0900be20d-kube-api-access-qfkdw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7\" (UID: \"9a496653-903b-4ef7-9e8e-91a0900be20d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"
Jul 02 17:04:37.546525 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.546360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a496653-903b-4ef7-9e8e-91a0900be20d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7\" (UID: \"9a496653-903b-4ef7-9e8e-91a0900be20d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"
Jul 02 17:04:37.546525 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.546411    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a496653-903b-4ef7-9e8e-91a0900be20d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7\" (UID: \"9a496653-903b-4ef7-9e8e-91a0900be20d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"
Jul 02 17:04:37.647518 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.647482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfkdw\" (UniqueName: \"kubernetes.io/projected/9a496653-903b-4ef7-9e8e-91a0900be20d-kube-api-access-qfkdw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7\" (UID: \"9a496653-903b-4ef7-9e8e-91a0900be20d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"
Jul 02 17:04:37.647646 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.647534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a496653-903b-4ef7-9e8e-91a0900be20d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7\" (UID: \"9a496653-903b-4ef7-9e8e-91a0900be20d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"
Jul 02 17:04:37.647646 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.647579    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a496653-903b-4ef7-9e8e-91a0900be20d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7\" (UID: \"9a496653-903b-4ef7-9e8e-91a0900be20d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"
Jul 02 17:04:37.647870 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.647852    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a496653-903b-4ef7-9e8e-91a0900be20d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7\" (UID: \"9a496653-903b-4ef7-9e8e-91a0900be20d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"
Jul 02 17:04:37.647934 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.647918    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a496653-903b-4ef7-9e8e-91a0900be20d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7\" (UID: \"9a496653-903b-4ef7-9e8e-91a0900be20d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"
Jul 02 17:04:37.655289 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.655266    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfkdw\" (UniqueName: \"kubernetes.io/projected/9a496653-903b-4ef7-9e8e-91a0900be20d-kube-api-access-qfkdw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7\" (UID: \"9a496653-903b-4ef7-9e8e-91a0900be20d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"
Jul 02 17:04:37.757025 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.756948    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"
Jul 02 17:04:37.830668 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.830636    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"]
Jul 02 17:04:37.834798 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.834772    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"
Jul 02 17:04:37.845469 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.843727    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"]
Jul 02 17:04:37.892390 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.892364    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"]
Jul 02 17:04:37.894494 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:04:37.894470    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a496653_903b_4ef7_9e8e_91a0900be20d.slice/crio-77d495927d54a51c360a7b931ef7b7e5af1736d6ad9b05dd6640a84642bb95ad WatchSource:0}: Error finding container 77d495927d54a51c360a7b931ef7b7e5af1736d6ad9b05dd6640a84642bb95ad: Status 404 returned error can't find the container with id 77d495927d54a51c360a7b931ef7b7e5af1736d6ad9b05dd6640a84642bb95ad
Jul 02 17:04:37.950116 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.950076    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q6z8\" (UniqueName: \"kubernetes.io/projected/433bd566-3daa-4979-89b8-f2cc82c872f7-kube-api-access-8q6z8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt\" (UID: \"433bd566-3daa-4979-89b8-f2cc82c872f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"
Jul 02 17:04:37.950245 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.950157    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/433bd566-3daa-4979-89b8-f2cc82c872f7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt\" (UID: \"433bd566-3daa-4979-89b8-f2cc82c872f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"
Jul 02 17:04:37.950288 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.950272    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/433bd566-3daa-4979-89b8-f2cc82c872f7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt\" (UID: \"433bd566-3daa-4979-89b8-f2cc82c872f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"
Jul 02 17:04:37.986955 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.986918    2579 generic.go:356] "Generic (PLEG): container finished" podID="58ae3f4d-5a61-472d-9a6b-237d99ebcf59" containerID="74cf3820640e03a28f8746df1bfb744babc3f28cb97f91eefb0f07af557d3226" exitCode=0
Jul 02 17:04:37.987184 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.987001    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d" event={"ID":"58ae3f4d-5a61-472d-9a6b-237d99ebcf59","Type":"ContainerDied","Data":"74cf3820640e03a28f8746df1bfb744babc3f28cb97f91eefb0f07af557d3226"}
Jul 02 17:04:37.987184 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.987054    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d" event={"ID":"58ae3f4d-5a61-472d-9a6b-237d99ebcf59","Type":"ContainerStarted","Data":"dd644c501ce42e121a7e3dedd4400c845d96c2bcdb15c3b5efe13f5cb33e1613"}
Jul 02 17:04:37.989252 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.989220    2579 generic.go:356] "Generic (PLEG): container finished" podID="be8a6e93-77bd-4097-99bf-7c4def421b36" containerID="eb6f1b9c2cd7d481d506eabcddea138f9ac5911f0839f4c37b467399fe7839cc" exitCode=0
Jul 02 17:04:37.989398 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.989300    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg" event={"ID":"be8a6e93-77bd-4097-99bf-7c4def421b36","Type":"ContainerDied","Data":"eb6f1b9c2cd7d481d506eabcddea138f9ac5911f0839f4c37b467399fe7839cc"}
Jul 02 17:04:37.991003 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.990978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7" event={"ID":"9a496653-903b-4ef7-9e8e-91a0900be20d","Type":"ContainerStarted","Data":"c851f430876686c24dbdf5e1719900d2166200e1610c75119a5deebb6be7bc2e"}
Jul 02 17:04:37.991058 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:37.991024    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7" event={"ID":"9a496653-903b-4ef7-9e8e-91a0900be20d","Type":"ContainerStarted","Data":"77d495927d54a51c360a7b931ef7b7e5af1736d6ad9b05dd6640a84642bb95ad"}
Jul 02 17:04:38.050879 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:38.050782    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/433bd566-3daa-4979-89b8-f2cc82c872f7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt\" (UID: \"433bd566-3daa-4979-89b8-f2cc82c872f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"
Jul 02 17:04:38.050879 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:38.050826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q6z8\" (UniqueName: \"kubernetes.io/projected/433bd566-3daa-4979-89b8-f2cc82c872f7-kube-api-access-8q6z8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt\" (UID: \"433bd566-3daa-4979-89b8-f2cc82c872f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"
Jul 02 17:04:38.050879 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:38.050848    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/433bd566-3daa-4979-89b8-f2cc82c872f7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt\" (UID: \"433bd566-3daa-4979-89b8-f2cc82c872f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"
Jul 02 17:04:38.051417 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:38.051260    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/433bd566-3daa-4979-89b8-f2cc82c872f7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt\" (UID: \"433bd566-3daa-4979-89b8-f2cc82c872f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"
Jul 02 17:04:38.051417 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:38.051268    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/433bd566-3daa-4979-89b8-f2cc82c872f7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt\" (UID: \"433bd566-3daa-4979-89b8-f2cc82c872f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"
Jul 02 17:04:38.059205 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:38.059177    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q6z8\" (UniqueName: \"kubernetes.io/projected/433bd566-3daa-4979-89b8-f2cc82c872f7-kube-api-access-8q6z8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt\" (UID: \"433bd566-3daa-4979-89b8-f2cc82c872f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"
Jul 02 17:04:38.147176 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:38.147152    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"
Jul 02 17:04:38.278737 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:38.278709    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"]
Jul 02 17:04:38.280602 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:04:38.280576    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433bd566_3daa_4979_89b8_f2cc82c872f7.slice/crio-7cad169ed0ce2c0b6943fc2cb1b97f4723491dbbf29d0d276fa50e325334b2bf WatchSource:0}: Error finding container 7cad169ed0ce2c0b6943fc2cb1b97f4723491dbbf29d0d276fa50e325334b2bf: Status 404 returned error can't find the container with id 7cad169ed0ce2c0b6943fc2cb1b97f4723491dbbf29d0d276fa50e325334b2bf
Jul 02 17:04:38.997346 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:38.997261    2579 generic.go:356] "Generic (PLEG): container finished" podID="58ae3f4d-5a61-472d-9a6b-237d99ebcf59" containerID="3a5287dde37a7f50fc15ae24596cfc3ce101001d3bbe248cbf9c42d32f84e2a8" exitCode=0
Jul 02 17:04:38.997504 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:38.997355    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d" event={"ID":"58ae3f4d-5a61-472d-9a6b-237d99ebcf59","Type":"ContainerDied","Data":"3a5287dde37a7f50fc15ae24596cfc3ce101001d3bbe248cbf9c42d32f84e2a8"}
Jul 02 17:04:38.998949 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:38.998843    2579 generic.go:356] "Generic (PLEG): container finished" podID="433bd566-3daa-4979-89b8-f2cc82c872f7" containerID="c0ec094c9db65bb3245df552b1e3ec8a112ce28b2b504585a0192c28765e0950" exitCode=0
Jul 02 17:04:38.998949 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:38.998934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt" event={"ID":"433bd566-3daa-4979-89b8-f2cc82c872f7","Type":"ContainerDied","Data":"c0ec094c9db65bb3245df552b1e3ec8a112ce28b2b504585a0192c28765e0950"}
Jul 02 17:04:38.999100 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:38.998973    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt" event={"ID":"433bd566-3daa-4979-89b8-f2cc82c872f7","Type":"ContainerStarted","Data":"7cad169ed0ce2c0b6943fc2cb1b97f4723491dbbf29d0d276fa50e325334b2bf"}
Jul 02 17:04:39.001128 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:39.001109    2579 generic.go:356] "Generic (PLEG): container finished" podID="be8a6e93-77bd-4097-99bf-7c4def421b36" containerID="1728f145a8ea3f653a0d4ea087598c6d22ad926055aae9aea5910a2b0ee0f939" exitCode=0
Jul 02 17:04:39.001220 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:39.001198    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg" event={"ID":"be8a6e93-77bd-4097-99bf-7c4def421b36","Type":"ContainerDied","Data":"1728f145a8ea3f653a0d4ea087598c6d22ad926055aae9aea5910a2b0ee0f939"}
Jul 02 17:04:39.002793 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:39.002775    2579 generic.go:356] "Generic (PLEG): container finished" podID="9a496653-903b-4ef7-9e8e-91a0900be20d" containerID="c851f430876686c24dbdf5e1719900d2166200e1610c75119a5deebb6be7bc2e" exitCode=0
Jul 02 17:04:39.002881 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:39.002802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7" event={"ID":"9a496653-903b-4ef7-9e8e-91a0900be20d","Type":"ContainerDied","Data":"c851f430876686c24dbdf5e1719900d2166200e1610c75119a5deebb6be7bc2e"}
Jul 02 17:04:40.011169 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:40.011136    2579 generic.go:356] "Generic (PLEG): container finished" podID="58ae3f4d-5a61-472d-9a6b-237d99ebcf59" containerID="1e657e8f766416546ec747a59c290dfa81dd5cba65ff9f04c7eac2c1cc4c5106" exitCode=0
Jul 02 17:04:40.011642 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:40.011226    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d" event={"ID":"58ae3f4d-5a61-472d-9a6b-237d99ebcf59","Type":"ContainerDied","Data":"1e657e8f766416546ec747a59c290dfa81dd5cba65ff9f04c7eac2c1cc4c5106"}
Jul 02 17:04:40.202142 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:40.202109    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"
Jul 02 17:04:40.370958 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:40.370906    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be8a6e93-77bd-4097-99bf-7c4def421b36-util\") pod \"be8a6e93-77bd-4097-99bf-7c4def421b36\" (UID: \"be8a6e93-77bd-4097-99bf-7c4def421b36\") "
Jul 02 17:04:40.371144 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:40.371012    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp29b\" (UniqueName: \"kubernetes.io/projected/be8a6e93-77bd-4097-99bf-7c4def421b36-kube-api-access-qp29b\") pod \"be8a6e93-77bd-4097-99bf-7c4def421b36\" (UID: \"be8a6e93-77bd-4097-99bf-7c4def421b36\") "
Jul 02 17:04:40.371144 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:40.371040    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be8a6e93-77bd-4097-99bf-7c4def421b36-bundle\") pod \"be8a6e93-77bd-4097-99bf-7c4def421b36\" (UID: \"be8a6e93-77bd-4097-99bf-7c4def421b36\") "
Jul 02 17:04:40.371622 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:40.371580    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8a6e93-77bd-4097-99bf-7c4def421b36-bundle" (OuterVolumeSpecName: "bundle") pod "be8a6e93-77bd-4097-99bf-7c4def421b36" (UID: "be8a6e93-77bd-4097-99bf-7c4def421b36"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:04:40.373275 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:40.373246    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be8a6e93-77bd-4097-99bf-7c4def421b36-kube-api-access-qp29b" (OuterVolumeSpecName: "kube-api-access-qp29b") pod "be8a6e93-77bd-4097-99bf-7c4def421b36" (UID: "be8a6e93-77bd-4097-99bf-7c4def421b36"). InnerVolumeSpecName "kube-api-access-qp29b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:04:40.376436 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:40.376401    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8a6e93-77bd-4097-99bf-7c4def421b36-util" (OuterVolumeSpecName: "util") pod "be8a6e93-77bd-4097-99bf-7c4def421b36" (UID: "be8a6e93-77bd-4097-99bf-7c4def421b36"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:04:40.472334 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:40.472299    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be8a6e93-77bd-4097-99bf-7c4def421b36-util\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:04:40.472334 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:40.472329    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp29b\" (UniqueName: \"kubernetes.io/projected/be8a6e93-77bd-4097-99bf-7c4def421b36-kube-api-access-qp29b\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:04:40.472334 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:40.472340    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be8a6e93-77bd-4097-99bf-7c4def421b36-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:04:41.018132 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.018069    2579 generic.go:356] "Generic (PLEG): container finished" podID="433bd566-3daa-4979-89b8-f2cc82c872f7" containerID="aa9537c8b080468733fc0a314822712a9241623d291f641d0922d4d63209fc7c" exitCode=0
Jul 02 17:04:41.018587 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.018154    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt" event={"ID":"433bd566-3daa-4979-89b8-f2cc82c872f7","Type":"ContainerDied","Data":"aa9537c8b080468733fc0a314822712a9241623d291f641d0922d4d63209fc7c"}
Jul 02 17:04:41.020271 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.020244    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg" event={"ID":"be8a6e93-77bd-4097-99bf-7c4def421b36","Type":"ContainerDied","Data":"7e9c5f29d1209be9c5436d8355e15eec52b24e8d633b24c5d6f77a9dd1659525"}
Jul 02 17:04:41.020271 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.020264    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg"
Jul 02 17:04:41.020427 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.020285    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e9c5f29d1209be9c5436d8355e15eec52b24e8d633b24c5d6f77a9dd1659525"
Jul 02 17:04:41.022363 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.022335    2579 generic.go:356] "Generic (PLEG): container finished" podID="9a496653-903b-4ef7-9e8e-91a0900be20d" containerID="97dffd363ac6934fdf871e097edd537700f5de50bf75c0ba350f3d5482460a10" exitCode=0
Jul 02 17:04:41.022458 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.022417    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7" event={"ID":"9a496653-903b-4ef7-9e8e-91a0900be20d","Type":"ContainerDied","Data":"97dffd363ac6934fdf871e097edd537700f5de50bf75c0ba350f3d5482460a10"}
Jul 02 17:04:41.160124 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.160074    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"
Jul 02 17:04:41.278374 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.278304    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-util\") pod \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\" (UID: \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\") "
Jul 02 17:04:41.278374 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.278361    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2rsv\" (UniqueName: \"kubernetes.io/projected/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-kube-api-access-x2rsv\") pod \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\" (UID: \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\") "
Jul 02 17:04:41.278537 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.278405    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-bundle\") pod \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\" (UID: \"58ae3f4d-5a61-472d-9a6b-237d99ebcf59\") "
Jul 02 17:04:41.278941 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.278913    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-bundle" (OuterVolumeSpecName: "bundle") pod "58ae3f4d-5a61-472d-9a6b-237d99ebcf59" (UID: "58ae3f4d-5a61-472d-9a6b-237d99ebcf59"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:04:41.280603 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.280578    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-kube-api-access-x2rsv" (OuterVolumeSpecName: "kube-api-access-x2rsv") pod "58ae3f4d-5a61-472d-9a6b-237d99ebcf59" (UID: "58ae3f4d-5a61-472d-9a6b-237d99ebcf59"). InnerVolumeSpecName "kube-api-access-x2rsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:04:41.285481 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.285455    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-util" (OuterVolumeSpecName: "util") pod "58ae3f4d-5a61-472d-9a6b-237d99ebcf59" (UID: "58ae3f4d-5a61-472d-9a6b-237d99ebcf59"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:04:41.379971 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.379937    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-util\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:04:41.379971 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.379967    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2rsv\" (UniqueName: \"kubernetes.io/projected/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-kube-api-access-x2rsv\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:04:41.379971 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:41.379976    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58ae3f4d-5a61-472d-9a6b-237d99ebcf59-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:04:42.029912 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:42.029828    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d"
Jul 02 17:04:42.029912 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:42.029841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d" event={"ID":"58ae3f4d-5a61-472d-9a6b-237d99ebcf59","Type":"ContainerDied","Data":"dd644c501ce42e121a7e3dedd4400c845d96c2bcdb15c3b5efe13f5cb33e1613"}
Jul 02 17:04:42.029912 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:42.029888    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd644c501ce42e121a7e3dedd4400c845d96c2bcdb15c3b5efe13f5cb33e1613"
Jul 02 17:04:42.032137 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:42.032069    2579 generic.go:356] "Generic (PLEG): container finished" podID="433bd566-3daa-4979-89b8-f2cc82c872f7" containerID="ae44a2bb700b8b5519eae83856e640da5b56b27948f7d4ff4baa02b93e5827ae" exitCode=0
Jul 02 17:04:42.032270 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:42.032136    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt" event={"ID":"433bd566-3daa-4979-89b8-f2cc82c872f7","Type":"ContainerDied","Data":"ae44a2bb700b8b5519eae83856e640da5b56b27948f7d4ff4baa02b93e5827ae"}
Jul 02 17:04:42.034219 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:42.034200    2579 generic.go:356] "Generic (PLEG): container finished" podID="9a496653-903b-4ef7-9e8e-91a0900be20d" containerID="78048c6ff9905765a17971baff4b59e648874fe7d27adc54bd2959fc40569c9e" exitCode=0
Jul 02 17:04:42.034309 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:42.034223    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7" event={"ID":"9a496653-903b-4ef7-9e8e-91a0900be20d","Type":"ContainerDied","Data":"78048c6ff9905765a17971baff4b59e648874fe7d27adc54bd2959fc40569c9e"}
Jul 02 17:04:43.169670 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.169641    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"
Jul 02 17:04:43.205720 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.205690    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"
Jul 02 17:04:43.297676 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.297582    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a496653-903b-4ef7-9e8e-91a0900be20d-util\") pod \"9a496653-903b-4ef7-9e8e-91a0900be20d\" (UID: \"9a496653-903b-4ef7-9e8e-91a0900be20d\") "
Jul 02 17:04:43.297676 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.297646    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfkdw\" (UniqueName: \"kubernetes.io/projected/9a496653-903b-4ef7-9e8e-91a0900be20d-kube-api-access-qfkdw\") pod \"9a496653-903b-4ef7-9e8e-91a0900be20d\" (UID: \"9a496653-903b-4ef7-9e8e-91a0900be20d\") "
Jul 02 17:04:43.297885 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.297711    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a496653-903b-4ef7-9e8e-91a0900be20d-bundle\") pod \"9a496653-903b-4ef7-9e8e-91a0900be20d\" (UID: \"9a496653-903b-4ef7-9e8e-91a0900be20d\") "
Jul 02 17:04:43.298207 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.298171    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a496653-903b-4ef7-9e8e-91a0900be20d-bundle" (OuterVolumeSpecName: "bundle") pod "9a496653-903b-4ef7-9e8e-91a0900be20d" (UID: "9a496653-903b-4ef7-9e8e-91a0900be20d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:04:43.299799 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.299771    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a496653-903b-4ef7-9e8e-91a0900be20d-kube-api-access-qfkdw" (OuterVolumeSpecName: "kube-api-access-qfkdw") pod "9a496653-903b-4ef7-9e8e-91a0900be20d" (UID: "9a496653-903b-4ef7-9e8e-91a0900be20d"). InnerVolumeSpecName "kube-api-access-qfkdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:04:43.301577 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.301553    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a496653-903b-4ef7-9e8e-91a0900be20d-util" (OuterVolumeSpecName: "util") pod "9a496653-903b-4ef7-9e8e-91a0900be20d" (UID: "9a496653-903b-4ef7-9e8e-91a0900be20d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:04:43.398809 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.398759    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q6z8\" (UniqueName: \"kubernetes.io/projected/433bd566-3daa-4979-89b8-f2cc82c872f7-kube-api-access-8q6z8\") pod \"433bd566-3daa-4979-89b8-f2cc82c872f7\" (UID: \"433bd566-3daa-4979-89b8-f2cc82c872f7\") "
Jul 02 17:04:43.398991 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.398830    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/433bd566-3daa-4979-89b8-f2cc82c872f7-bundle\") pod \"433bd566-3daa-4979-89b8-f2cc82c872f7\" (UID: \"433bd566-3daa-4979-89b8-f2cc82c872f7\") "
Jul 02 17:04:43.398991 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.398852    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/433bd566-3daa-4979-89b8-f2cc82c872f7-util\") pod \"433bd566-3daa-4979-89b8-f2cc82c872f7\" (UID: \"433bd566-3daa-4979-89b8-f2cc82c872f7\") "
Jul 02 17:04:43.399128 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.399005    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a496653-903b-4ef7-9e8e-91a0900be20d-util\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:04:43.399128 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.399020    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfkdw\" (UniqueName: \"kubernetes.io/projected/9a496653-903b-4ef7-9e8e-91a0900be20d-kube-api-access-qfkdw\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:04:43.399128 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.399030    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a496653-903b-4ef7-9e8e-91a0900be20d-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:04:43.399500 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.399473    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/433bd566-3daa-4979-89b8-f2cc82c872f7-bundle" (OuterVolumeSpecName: "bundle") pod "433bd566-3daa-4979-89b8-f2cc82c872f7" (UID: "433bd566-3daa-4979-89b8-f2cc82c872f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:04:43.400894 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.400870    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/433bd566-3daa-4979-89b8-f2cc82c872f7-kube-api-access-8q6z8" (OuterVolumeSpecName: "kube-api-access-8q6z8") pod "433bd566-3daa-4979-89b8-f2cc82c872f7" (UID: "433bd566-3daa-4979-89b8-f2cc82c872f7"). InnerVolumeSpecName "kube-api-access-8q6z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:04:43.404406 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.404382    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/433bd566-3daa-4979-89b8-f2cc82c872f7-util" (OuterVolumeSpecName: "util") pod "433bd566-3daa-4979-89b8-f2cc82c872f7" (UID: "433bd566-3daa-4979-89b8-f2cc82c872f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:04:43.500215 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.500179    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q6z8\" (UniqueName: \"kubernetes.io/projected/433bd566-3daa-4979-89b8-f2cc82c872f7-kube-api-access-8q6z8\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:04:43.500215 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.500209    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/433bd566-3daa-4979-89b8-f2cc82c872f7-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:04:43.500215 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:43.500222    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/433bd566-3daa-4979-89b8-f2cc82c872f7-util\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:04:44.046409 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:44.046334    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7"
Jul 02 17:04:44.046409 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:44.046362    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7" event={"ID":"9a496653-903b-4ef7-9e8e-91a0900be20d","Type":"ContainerDied","Data":"77d495927d54a51c360a7b931ef7b7e5af1736d6ad9b05dd6640a84642bb95ad"}
Jul 02 17:04:44.046409 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:44.046410    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77d495927d54a51c360a7b931ef7b7e5af1736d6ad9b05dd6640a84642bb95ad"
Jul 02 17:04:44.048385 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:44.048358    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt" event={"ID":"433bd566-3daa-4979-89b8-f2cc82c872f7","Type":"ContainerDied","Data":"7cad169ed0ce2c0b6943fc2cb1b97f4723491dbbf29d0d276fa50e325334b2bf"}
Jul 02 17:04:44.048523 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:44.048404    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cad169ed0ce2c0b6943fc2cb1b97f4723491dbbf29d0d276fa50e325334b2bf"
Jul 02 17:04:44.048523 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:44.048429    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt"
Jul 02 17:04:49.771303 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:49.771232    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:04:53.962266 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:53.962221    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:04:54.428375 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428344    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79788fcff4-bsrtz"]
Jul 02 17:04:54.428699 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428686    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ae3f4d-5a61-472d-9a6b-237d99ebcf59" containerName="util"
Jul 02 17:04:54.428743 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428703    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ae3f4d-5a61-472d-9a6b-237d99ebcf59" containerName="util"
Jul 02 17:04:54.428743 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428715    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="433bd566-3daa-4979-89b8-f2cc82c872f7" containerName="extract"
Jul 02 17:04:54.428743 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428721    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="433bd566-3daa-4979-89b8-f2cc82c872f7" containerName="extract"
Jul 02 17:04:54.428743 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428728    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="433bd566-3daa-4979-89b8-f2cc82c872f7" containerName="pull"
Jul 02 17:04:54.428743 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428733    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="433bd566-3daa-4979-89b8-f2cc82c872f7" containerName="pull"
Jul 02 17:04:54.428743 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428740    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be8a6e93-77bd-4097-99bf-7c4def421b36" containerName="util"
Jul 02 17:04:54.428743 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428745    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be8a6e93-77bd-4097-99bf-7c4def421b36" containerName="util"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428752    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a496653-903b-4ef7-9e8e-91a0900be20d" containerName="util"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428756    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a496653-903b-4ef7-9e8e-91a0900be20d" containerName="util"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428763    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ae3f4d-5a61-472d-9a6b-237d99ebcf59" containerName="extract"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428768    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ae3f4d-5a61-472d-9a6b-237d99ebcf59" containerName="extract"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428776    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a496653-903b-4ef7-9e8e-91a0900be20d" containerName="pull"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428784    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a496653-903b-4ef7-9e8e-91a0900be20d" containerName="pull"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428795    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be8a6e93-77bd-4097-99bf-7c4def421b36" containerName="extract"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428800    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be8a6e93-77bd-4097-99bf-7c4def421b36" containerName="extract"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428810    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="433bd566-3daa-4979-89b8-f2cc82c872f7" containerName="util"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428815    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="433bd566-3daa-4979-89b8-f2cc82c872f7" containerName="util"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428825    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ae3f4d-5a61-472d-9a6b-237d99ebcf59" containerName="pull"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428830    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ae3f4d-5a61-472d-9a6b-237d99ebcf59" containerName="pull"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428835    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a496653-903b-4ef7-9e8e-91a0900be20d" containerName="extract"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428839    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a496653-903b-4ef7-9e8e-91a0900be20d" containerName="extract"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428848    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be8a6e93-77bd-4097-99bf-7c4def421b36" containerName="pull"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428853    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be8a6e93-77bd-4097-99bf-7c4def421b36" containerName="pull"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428905    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="58ae3f4d-5a61-472d-9a6b-237d99ebcf59" containerName="extract"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428911    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="433bd566-3daa-4979-89b8-f2cc82c872f7" containerName="extract"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428918    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a496653-903b-4ef7-9e8e-91a0900be20d" containerName="extract"
Jul 02 17:04:54.428945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.428923    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be8a6e93-77bd-4097-99bf-7c4def421b36" containerName="extract"
Jul 02 17:04:54.431770 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.431749    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.446166 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.446137    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79788fcff4-bsrtz"]
Jul 02 17:04:54.492169 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.492126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7727a0b-7d1a-4c97-821d-f762a9b379da-console-config\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.492344 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.492174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7727a0b-7d1a-4c97-821d-f762a9b379da-trusted-ca-bundle\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.492344 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.492232    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7727a0b-7d1a-4c97-821d-f762a9b379da-service-ca\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.492344 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.492256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7727a0b-7d1a-4c97-821d-f762a9b379da-oauth-serving-cert\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.492473 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.492346    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7727a0b-7d1a-4c97-821d-f762a9b379da-console-oauth-config\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.492473 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.492379    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c756\" (UniqueName: \"kubernetes.io/projected/b7727a0b-7d1a-4c97-821d-f762a9b379da-kube-api-access-8c756\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.492473 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.492455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7727a0b-7d1a-4c97-821d-f762a9b379da-console-serving-cert\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.501011 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.500984    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:04:54.593268 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.593235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7727a0b-7d1a-4c97-821d-f762a9b379da-console-oauth-config\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.593268 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.593271    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c756\" (UniqueName: \"kubernetes.io/projected/b7727a0b-7d1a-4c97-821d-f762a9b379da-kube-api-access-8c756\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.593487 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.593407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7727a0b-7d1a-4c97-821d-f762a9b379da-console-serving-cert\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.593487 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.593463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7727a0b-7d1a-4c97-821d-f762a9b379da-console-config\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.593557 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.593493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7727a0b-7d1a-4c97-821d-f762a9b379da-trusted-ca-bundle\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.593557 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.593539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7727a0b-7d1a-4c97-821d-f762a9b379da-service-ca\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.593658 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.593567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7727a0b-7d1a-4c97-821d-f762a9b379da-oauth-serving-cert\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.594313 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.594285    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7727a0b-7d1a-4c97-821d-f762a9b379da-console-config\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.594451 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.594331    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7727a0b-7d1a-4c97-821d-f762a9b379da-oauth-serving-cert\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.594451 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.594366    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7727a0b-7d1a-4c97-821d-f762a9b379da-trusted-ca-bundle\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.594451 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.594369    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7727a0b-7d1a-4c97-821d-f762a9b379da-service-ca\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.595915 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.595886    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7727a0b-7d1a-4c97-821d-f762a9b379da-console-serving-cert\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.596021 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.595919    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7727a0b-7d1a-4c97-821d-f762a9b379da-console-oauth-config\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.603122 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.603069    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:04:54.603377 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.603361    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c756\" (UniqueName: \"kubernetes.io/projected/b7727a0b-7d1a-4c97-821d-f762a9b379da-kube-api-access-8c756\") pod \"console-79788fcff4-bsrtz\" (UID: \"b7727a0b-7d1a-4c97-821d-f762a9b379da\") " pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.740812 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.740707    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:04:54.876352 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:54.876314    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79788fcff4-bsrtz"]
Jul 02 17:04:54.879455 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:04:54.879428    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7727a0b_7d1a_4c97_821d_f762a9b379da.slice/crio-0779ac4c7086804e5f91dd192170aedb519453855d417a19c3a299a30026efcb WatchSource:0}: Error finding container 0779ac4c7086804e5f91dd192170aedb519453855d417a19c3a299a30026efcb: Status 404 returned error can't find the container with id 0779ac4c7086804e5f91dd192170aedb519453855d417a19c3a299a30026efcb
Jul 02 17:04:55.103285 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:55.103249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79788fcff4-bsrtz" event={"ID":"b7727a0b-7d1a-4c97-821d-f762a9b379da","Type":"ContainerStarted","Data":"3a70aca3622cfe0ac3feb92f3252b8308efbeb1bc65c49056bbb93f580099f28"}
Jul 02 17:04:55.103688 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:55.103297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79788fcff4-bsrtz" event={"ID":"b7727a0b-7d1a-4c97-821d-f762a9b379da","Type":"ContainerStarted","Data":"0779ac4c7086804e5f91dd192170aedb519453855d417a19c3a299a30026efcb"}
Jul 02 17:04:55.121154 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:55.121072    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79788fcff4-bsrtz" podStartSLOduration=1.121056501 podStartE2EDuration="1.121056501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:04:55.11964904 +0000 UTC m=+634.486315003" watchObservedRunningTime="2026-07-02 17:04:55.121056501 +0000 UTC m=+634.487722463"
Jul 02 17:04:56.361604 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:56.361570    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:04:56.609190 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:56.609158    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:04:56.966825 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:04:56.966788    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:00.360595 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:00.360562    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:01.399958 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:01.399920    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:03.416860 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:03.416818    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:04.741031 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:04.740991    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:05:04.741567 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:04.741059    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:05:04.745806 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:04.745784    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:05:05.161204 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:05.161176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79788fcff4-bsrtz"
Jul 02 17:05:05.201557 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:05.201515    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:05.224348 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:05.224318    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f679c7df7-75vmc"]
Jul 02 17:05:05.344163 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:05.344133    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:05.446367 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:05.446281    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:05.547261 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:05.547230    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:06.608639 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:06.608604    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:06.750280 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:06.750243    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:10.376574 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:10.376535    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:10.472262 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:10.472222    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:14.558137 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:14.558072    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:14.614874 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:14.614838    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:15.010836 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:15.010802    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:15.110426 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:15.110386    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:16.044020 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.043984    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"]
Jul 02 17:05:16.047044 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.047026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"
Jul 02 17:05:16.049419 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.049397    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 02 17:05:16.049419 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.049407    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 17:05:16.049591 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.049453    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 17:05:16.050164 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.050142    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8c4pr\""
Jul 02 17:05:16.050259 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.050163    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 02 17:05:16.054954 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.054934    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"]
Jul 02 17:05:16.057129 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.057105    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:16.185792 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.185758    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74c180aa-1475-40b4-868d-a650dc2c1dde-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6kj56\" (UID: \"74c180aa-1475-40b4-868d-a650dc2c1dde\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"
Jul 02 17:05:16.185792 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.185792    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/74c180aa-1475-40b4-868d-a650dc2c1dde-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6kj56\" (UID: \"74c180aa-1475-40b4-868d-a650dc2c1dde\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"
Jul 02 17:05:16.186061 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.185812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7z97\" (UniqueName: \"kubernetes.io/projected/74c180aa-1475-40b4-868d-a650dc2c1dde-kube-api-access-f7z97\") pod \"kuadrant-console-plugin-66b5774985-6kj56\" (UID: \"74c180aa-1475-40b4-868d-a650dc2c1dde\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"
Jul 02 17:05:16.248383 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.248353    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:16.286583 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.286542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74c180aa-1475-40b4-868d-a650dc2c1dde-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6kj56\" (UID: \"74c180aa-1475-40b4-868d-a650dc2c1dde\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"
Jul 02 17:05:16.286583 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.286581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/74c180aa-1475-40b4-868d-a650dc2c1dde-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6kj56\" (UID: \"74c180aa-1475-40b4-868d-a650dc2c1dde\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"
Jul 02 17:05:16.286833 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.286601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7z97\" (UniqueName: \"kubernetes.io/projected/74c180aa-1475-40b4-868d-a650dc2c1dde-kube-api-access-f7z97\") pod \"kuadrant-console-plugin-66b5774985-6kj56\" (UID: \"74c180aa-1475-40b4-868d-a650dc2c1dde\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"
Jul 02 17:05:16.287244 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.287223    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/74c180aa-1475-40b4-868d-a650dc2c1dde-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6kj56\" (UID: \"74c180aa-1475-40b4-868d-a650dc2c1dde\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"
Jul 02 17:05:16.289065 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.289043    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74c180aa-1475-40b4-868d-a650dc2c1dde-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6kj56\" (UID: \"74c180aa-1475-40b4-868d-a650dc2c1dde\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"
Jul 02 17:05:16.294426 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.294369    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7z97\" (UniqueName: \"kubernetes.io/projected/74c180aa-1475-40b4-868d-a650dc2c1dde-kube-api-access-f7z97\") pod \"kuadrant-console-plugin-66b5774985-6kj56\" (UID: \"74c180aa-1475-40b4-868d-a650dc2c1dde\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"
Jul 02 17:05:16.358232 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.358189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"
Jul 02 17:05:16.487933 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:16.487904    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56"]
Jul 02 17:05:16.489371 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:05:16.489337    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74c180aa_1475_40b4_868d_a650dc2c1dde.slice/crio-0e4c08341ed18d8d0df21c953faf2a5bc5044e6277f158f734b272461f0c3578 WatchSource:0}: Error finding container 0e4c08341ed18d8d0df21c953faf2a5bc5044e6277f158f734b272461f0c3578: Status 404 returned error can't find the container with id 0e4c08341ed18d8d0df21c953faf2a5bc5044e6277f158f734b272461f0c3578
Jul 02 17:05:17.216871 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:17.216839    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56" event={"ID":"74c180aa-1475-40b4-868d-a650dc2c1dde","Type":"ContainerStarted","Data":"0e4c08341ed18d8d0df21c953faf2a5bc5044e6277f158f734b272461f0c3578"}
Jul 02 17:05:18.843575 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:18.843536    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:18.944395 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:18.944358    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:25.488290 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:25.488250    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:25.580345 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:25.580309    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:25.777107 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:25.776994    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:25.877656 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:25.877581    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:28.303147 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:28.303058    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:28.414378 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:28.414341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:30.247293 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:30.247253    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f679c7df7-75vmc" podUID="d7645d99-6802-45c5-9cce-7d6338fd0bcc" containerName="console" containerID="cri-o://5468989cf92aab6509fa73146aa77034d0b5f70891f49d3c8bf4937275197c9b" gracePeriod=15
Jul 02 17:05:33.096446 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:33.096407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:33.193886 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:33.193848    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:36.613476 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:36.613446    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:36.715531 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:36.715486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:37.026573 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:37.026492    2579 patch_prober.go:28] interesting pod/console-f679c7df7-75vmc container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body=
Jul 02 17:05:37.026573 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:37.026556    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-f679c7df7-75vmc" podUID="d7645d99-6802-45c5-9cce-7d6338fd0bcc" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused"
Jul 02 17:05:42.571320 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.571296    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:05:42.640876 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.640781    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-trusted-ca-bundle\") pod \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") "
Jul 02 17:05:42.640876 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.640828    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-service-ca\") pod \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") "
Jul 02 17:05:42.640876 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.640865    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-config\") pod \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") "
Jul 02 17:05:42.641151 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.640925    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpr7c\" (UniqueName: \"kubernetes.io/projected/d7645d99-6802-45c5-9cce-7d6338fd0bcc-kube-api-access-fpr7c\") pod \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") "
Jul 02 17:05:42.641151 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.640948    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-oauth-serving-cert\") pod \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") "
Jul 02 17:05:42.641151 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.640984    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-oauth-config\") pod \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") "
Jul 02 17:05:42.641151 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.641008    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-serving-cert\") pod \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\" (UID: \"d7645d99-6802-45c5-9cce-7d6338fd0bcc\") "
Jul 02 17:05:42.641363 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.641326    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7645d99-6802-45c5-9cce-7d6338fd0bcc" (UID: "d7645d99-6802-45c5-9cce-7d6338fd0bcc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:05:42.641422 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.641356    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-config" (OuterVolumeSpecName: "console-config") pod "d7645d99-6802-45c5-9cce-7d6338fd0bcc" (UID: "d7645d99-6802-45c5-9cce-7d6338fd0bcc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:05:42.641422 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.641369    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d7645d99-6802-45c5-9cce-7d6338fd0bcc" (UID: "d7645d99-6802-45c5-9cce-7d6338fd0bcc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:05:42.641601 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.641448    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7645d99-6802-45c5-9cce-7d6338fd0bcc" (UID: "d7645d99-6802-45c5-9cce-7d6338fd0bcc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:05:42.643203 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.643171    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7645d99-6802-45c5-9cce-7d6338fd0bcc-kube-api-access-fpr7c" (OuterVolumeSpecName: "kube-api-access-fpr7c") pod "d7645d99-6802-45c5-9cce-7d6338fd0bcc" (UID: "d7645d99-6802-45c5-9cce-7d6338fd0bcc"). InnerVolumeSpecName "kube-api-access-fpr7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:05:42.643321 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.643215    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7645d99-6802-45c5-9cce-7d6338fd0bcc" (UID: "d7645d99-6802-45c5-9cce-7d6338fd0bcc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:05:42.643321 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.643283    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7645d99-6802-45c5-9cce-7d6338fd0bcc" (UID: "d7645d99-6802-45c5-9cce-7d6338fd0bcc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:05:42.741648 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.741606    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-config\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:05:42.741648 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.741640    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpr7c\" (UniqueName: \"kubernetes.io/projected/d7645d99-6802-45c5-9cce-7d6338fd0bcc-kube-api-access-fpr7c\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:05:42.741648 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.741654    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-oauth-serving-cert\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:05:42.741892 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.741668    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-oauth-config\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:05:42.741892 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.741680    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7645d99-6802-45c5-9cce-7d6338fd0bcc-console-serving-cert\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:05:42.741892 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.741691    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-trusted-ca-bundle\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:05:42.741892 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:42.741702    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7645d99-6802-45c5-9cce-7d6338fd0bcc-service-ca\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:05:43.261847 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.261810    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:43.363978 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.363944    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:43.365292 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.365262    2579 generic.go:356] "Generic (PLEG): container finished" podID="d7645d99-6802-45c5-9cce-7d6338fd0bcc" containerID="5468989cf92aab6509fa73146aa77034d0b5f70891f49d3c8bf4937275197c9b" exitCode=0
Jul 02 17:05:43.365429 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.365292    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f679c7df7-75vmc" event={"ID":"d7645d99-6802-45c5-9cce-7d6338fd0bcc","Type":"ContainerDied","Data":"5468989cf92aab6509fa73146aa77034d0b5f70891f49d3c8bf4937275197c9b"}
Jul 02 17:05:43.365429 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.365342    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f679c7df7-75vmc" event={"ID":"d7645d99-6802-45c5-9cce-7d6338fd0bcc","Type":"ContainerDied","Data":"7f260dbf1052c1462c8d584d71fd6a8fb2bcd66575ce2ef6c6da21230e855208"}
Jul 02 17:05:43.365429 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.365361    2579 scope.go:117] "RemoveContainer" containerID="5468989cf92aab6509fa73146aa77034d0b5f70891f49d3c8bf4937275197c9b"
Jul 02 17:05:43.365429 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.365302    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f679c7df7-75vmc"
Jul 02 17:05:43.367060 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.367034    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56" event={"ID":"74c180aa-1475-40b4-868d-a650dc2c1dde","Type":"ContainerStarted","Data":"f3db87868b9ba17f3445411eeba5e89ea7ef218a08175a276b333791f34296e1"}
Jul 02 17:05:43.374126 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.374103    2579 scope.go:117] "RemoveContainer" containerID="5468989cf92aab6509fa73146aa77034d0b5f70891f49d3c8bf4937275197c9b"
Jul 02 17:05:43.374397 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:05:43.374376    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5468989cf92aab6509fa73146aa77034d0b5f70891f49d3c8bf4937275197c9b\": container with ID starting with 5468989cf92aab6509fa73146aa77034d0b5f70891f49d3c8bf4937275197c9b not found: ID does not exist" containerID="5468989cf92aab6509fa73146aa77034d0b5f70891f49d3c8bf4937275197c9b"
Jul 02 17:05:43.374447 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.374405    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5468989cf92aab6509fa73146aa77034d0b5f70891f49d3c8bf4937275197c9b"} err="failed to get container status \"5468989cf92aab6509fa73146aa77034d0b5f70891f49d3c8bf4937275197c9b\": rpc error: code = NotFound desc = could not find container \"5468989cf92aab6509fa73146aa77034d0b5f70891f49d3c8bf4937275197c9b\": container with ID starting with 5468989cf92aab6509fa73146aa77034d0b5f70891f49d3c8bf4937275197c9b not found: ID does not exist"
Jul 02 17:05:43.389152 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.389077    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6kj56" podStartSLOduration=1.4241363470000001 podStartE2EDuration="27.389060298s" totalImagesPullingTime="25.964923951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:05:43.388458427 +0000 UTC m=+682.755124389" watchObservedRunningTime="2026-07-02 17:05:43.389060298 +0000 UTC m=+682.755726262"
Jul 02 17:05:43.419736 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.419684    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f679c7df7-75vmc"]
Jul 02 17:05:43.425605 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.425578    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f679c7df7-75vmc"]
Jul 02 17:05:43.720786 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:43.720746    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7645d99-6802-45c5-9cce-7d6338fd0bcc" path="/var/lib/kubelet/pods/d7645d99-6802-45c5-9cce-7d6338fd0bcc/volumes"
Jul 02 17:05:46.453815 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:46.453779    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:46.552868 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:46.552833    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:51.052734 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:51.052701    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:51.152492 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:51.152458    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:51.252497 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:51.252462    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:51.363081 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:51.363053    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:56.248261 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:56.248217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:56.307506 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:56.307466    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:56.738381 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:56.738346    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:59.015340 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:59.015301    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:05:59.398108 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:05:59.398048    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:10.459656 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:10.459623    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:10.566655 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:10.566616    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:10.621507 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:10.621475    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:11.244949 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.244906    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-w76xg"]
Jul 02 17:06:11.245367 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.245346    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7645d99-6802-45c5-9cce-7d6338fd0bcc" containerName="console"
Jul 02 17:06:11.245472 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.245369    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7645d99-6802-45c5-9cce-7d6338fd0bcc" containerName="console"
Jul 02 17:06:11.245472 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.245445    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7645d99-6802-45c5-9cce-7d6338fd0bcc" containerName="console"
Jul 02 17:06:11.281951 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.281920    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:11.318746 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.318712    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-w76xg"]
Jul 02 17:06:11.318929 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.318823    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-w76xg"
Jul 02 17:06:11.321274 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.321252    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x8g2d\""
Jul 02 17:06:11.356593 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.356565    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:11.360412 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.360386    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nr2fz"]
Jul 02 17:06:11.363540 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.363518    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nr2fz"
Jul 02 17:06:11.371754 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.371728    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nr2fz"]
Jul 02 17:06:11.399376 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.399346    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll7m7\" (UniqueName: \"kubernetes.io/projected/34c303f1-9171-4608-a8a2-9ddf3c5f84e0-kube-api-access-ll7m7\") pod \"authorino-75d556bd77-nr2fz\" (UID: \"34c303f1-9171-4608-a8a2-9ddf3c5f84e0\") " pod="kuadrant-system/authorino-75d556bd77-nr2fz"
Jul 02 17:06:11.399532 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.399420    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnqsq\" (UniqueName: \"kubernetes.io/projected/5855d488-e45d-4663-8b10-5bf67fe12356-kube-api-access-cnqsq\") pod \"authorino-58cd955675-w76xg\" (UID: \"5855d488-e45d-4663-8b10-5bf67fe12356\") " pod="kuadrant-system/authorino-58cd955675-w76xg"
Jul 02 17:06:11.500642 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.500561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnqsq\" (UniqueName: \"kubernetes.io/projected/5855d488-e45d-4663-8b10-5bf67fe12356-kube-api-access-cnqsq\") pod \"authorino-58cd955675-w76xg\" (UID: \"5855d488-e45d-4663-8b10-5bf67fe12356\") " pod="kuadrant-system/authorino-58cd955675-w76xg"
Jul 02 17:06:11.500642 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.500602    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll7m7\" (UniqueName: \"kubernetes.io/projected/34c303f1-9171-4608-a8a2-9ddf3c5f84e0-kube-api-access-ll7m7\") pod \"authorino-75d556bd77-nr2fz\" (UID: \"34c303f1-9171-4608-a8a2-9ddf3c5f84e0\") " pod="kuadrant-system/authorino-75d556bd77-nr2fz"
Jul 02 17:06:11.507891 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.507855    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnqsq\" (UniqueName: \"kubernetes.io/projected/5855d488-e45d-4663-8b10-5bf67fe12356-kube-api-access-cnqsq\") pod \"authorino-58cd955675-w76xg\" (UID: \"5855d488-e45d-4663-8b10-5bf67fe12356\") " pod="kuadrant-system/authorino-58cd955675-w76xg"
Jul 02 17:06:11.508022 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.507885    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll7m7\" (UniqueName: \"kubernetes.io/projected/34c303f1-9171-4608-a8a2-9ddf3c5f84e0-kube-api-access-ll7m7\") pod \"authorino-75d556bd77-nr2fz\" (UID: \"34c303f1-9171-4608-a8a2-9ddf3c5f84e0\") " pod="kuadrant-system/authorino-75d556bd77-nr2fz"
Jul 02 17:06:11.627508 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.627468    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-w76xg"
Jul 02 17:06:11.672528 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.672496    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nr2fz"
Jul 02 17:06:11.774014 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.773984    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-w76xg"]
Jul 02 17:06:11.777336 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:06:11.777306    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5855d488_e45d_4663_8b10_5bf67fe12356.slice/crio-250742b4042c51a23f0c3390f47e0fbbd9cb52cae4338117d431938ad2139e82 WatchSource:0}: Error finding container 250742b4042c51a23f0c3390f47e0fbbd9cb52cae4338117d431938ad2139e82: Status 404 returned error can't find the container with id 250742b4042c51a23f0c3390f47e0fbbd9cb52cae4338117d431938ad2139e82
Jul 02 17:06:11.818202 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:11.818178    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nr2fz"]
Jul 02 17:06:11.819984 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:06:11.819951    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34c303f1_9171_4608_a8a2_9ddf3c5f84e0.slice/crio-d878e53a2456eed469643ad14023ab55be478a7998792de9bcf89c73d2994571 WatchSource:0}: Error finding container d878e53a2456eed469643ad14023ab55be478a7998792de9bcf89c73d2994571: Status 404 returned error can't find the container with id d878e53a2456eed469643ad14023ab55be478a7998792de9bcf89c73d2994571
Jul 02 17:06:12.508435 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:12.508352    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nr2fz" event={"ID":"34c303f1-9171-4608-a8a2-9ddf3c5f84e0","Type":"ContainerStarted","Data":"d878e53a2456eed469643ad14023ab55be478a7998792de9bcf89c73d2994571"}
Jul 02 17:06:12.510590 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:12.510556    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-w76xg" event={"ID":"5855d488-e45d-4663-8b10-5bf67fe12356","Type":"ContainerStarted","Data":"250742b4042c51a23f0c3390f47e0fbbd9cb52cae4338117d431938ad2139e82"}
Jul 02 17:06:16.539177 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:16.539138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nr2fz" event={"ID":"34c303f1-9171-4608-a8a2-9ddf3c5f84e0","Type":"ContainerStarted","Data":"1e09772382b42763c0584d9a6d6d1857e887273c022fb4fc019e9594b92bfc4f"}
Jul 02 17:06:16.540728 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:16.540696    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-w76xg" event={"ID":"5855d488-e45d-4663-8b10-5bf67fe12356","Type":"ContainerStarted","Data":"3c9b36595518e00dfce5704639db6f00a1cd24b69a77565286eb31efb14606fc"}
Jul 02 17:06:16.553484 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:16.553437    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nr2fz" podStartSLOduration=1.6614310570000002 podStartE2EDuration="5.553421161s" totalImagesPullingTime="3.891990104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:06:16.552247206 +0000 UTC m=+715.918913170" watchObservedRunningTime="2026-07-02 17:06:16.553421161 +0000 UTC m=+715.920087123"
Jul 02 17:06:16.568407 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:16.568356    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-w76xg" podStartSLOduration=1.622309789 podStartE2EDuration="5.568338932s" totalImagesPullingTime="3.946029143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:06:16.566019504 +0000 UTC m=+715.932685491" watchObservedRunningTime="2026-07-02 17:06:16.568338932 +0000 UTC m=+715.935004893"
Jul 02 17:06:16.589907 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:16.589867    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-w76xg"]
Jul 02 17:06:18.551000 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:18.550959    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-w76xg" podUID="5855d488-e45d-4663-8b10-5bf67fe12356" containerName="authorino" containerID="cri-o://3c9b36595518e00dfce5704639db6f00a1cd24b69a77565286eb31efb14606fc" gracePeriod=30
Jul 02 17:06:18.802665 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:18.802608    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-w76xg"
Jul 02 17:06:18.866380 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:18.866344    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnqsq\" (UniqueName: \"kubernetes.io/projected/5855d488-e45d-4663-8b10-5bf67fe12356-kube-api-access-cnqsq\") pod \"5855d488-e45d-4663-8b10-5bf67fe12356\" (UID: \"5855d488-e45d-4663-8b10-5bf67fe12356\") "
Jul 02 17:06:18.868358 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:18.868332    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5855d488-e45d-4663-8b10-5bf67fe12356-kube-api-access-cnqsq" (OuterVolumeSpecName: "kube-api-access-cnqsq") pod "5855d488-e45d-4663-8b10-5bf67fe12356" (UID: "5855d488-e45d-4663-8b10-5bf67fe12356"). InnerVolumeSpecName "kube-api-access-cnqsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:06:18.967966 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:18.967929    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnqsq\" (UniqueName: \"kubernetes.io/projected/5855d488-e45d-4663-8b10-5bf67fe12356-kube-api-access-cnqsq\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:06:19.556810 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:19.556775    2579 generic.go:356] "Generic (PLEG): container finished" podID="5855d488-e45d-4663-8b10-5bf67fe12356" containerID="3c9b36595518e00dfce5704639db6f00a1cd24b69a77565286eb31efb14606fc" exitCode=0
Jul 02 17:06:19.557301 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:19.556821    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-w76xg"
Jul 02 17:06:19.557301 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:19.556863    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-w76xg" event={"ID":"5855d488-e45d-4663-8b10-5bf67fe12356","Type":"ContainerDied","Data":"3c9b36595518e00dfce5704639db6f00a1cd24b69a77565286eb31efb14606fc"}
Jul 02 17:06:19.557301 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:19.556911    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-w76xg" event={"ID":"5855d488-e45d-4663-8b10-5bf67fe12356","Type":"ContainerDied","Data":"250742b4042c51a23f0c3390f47e0fbbd9cb52cae4338117d431938ad2139e82"}
Jul 02 17:06:19.557301 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:19.556941    2579 scope.go:117] "RemoveContainer" containerID="3c9b36595518e00dfce5704639db6f00a1cd24b69a77565286eb31efb14606fc"
Jul 02 17:06:19.566435 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:19.566419    2579 scope.go:117] "RemoveContainer" containerID="3c9b36595518e00dfce5704639db6f00a1cd24b69a77565286eb31efb14606fc"
Jul 02 17:06:19.566723 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:06:19.566705    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c9b36595518e00dfce5704639db6f00a1cd24b69a77565286eb31efb14606fc\": container with ID starting with 3c9b36595518e00dfce5704639db6f00a1cd24b69a77565286eb31efb14606fc not found: ID does not exist" containerID="3c9b36595518e00dfce5704639db6f00a1cd24b69a77565286eb31efb14606fc"
Jul 02 17:06:19.566772 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:19.566734    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c9b36595518e00dfce5704639db6f00a1cd24b69a77565286eb31efb14606fc"} err="failed to get container status \"3c9b36595518e00dfce5704639db6f00a1cd24b69a77565286eb31efb14606fc\": rpc error: code = NotFound desc = could not find container \"3c9b36595518e00dfce5704639db6f00a1cd24b69a77565286eb31efb14606fc\": container with ID starting with 3c9b36595518e00dfce5704639db6f00a1cd24b69a77565286eb31efb14606fc not found: ID does not exist"
Jul 02 17:06:19.578020 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:19.577991    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-w76xg"]
Jul 02 17:06:19.582377 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:19.582355    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-w76xg"]
Jul 02 17:06:19.726050 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:19.726011    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5855d488-e45d-4663-8b10-5bf67fe12356" path="/var/lib/kubelet/pods/5855d488-e45d-4663-8b10-5bf67fe12356/volumes"
Jul 02 17:06:28.408502 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:28.408464    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:32.732814 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:32.732780    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:33.543115 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:33.543055    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:41.675583 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:41.675548    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:41.834418 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:41.834378    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:41.917311 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:41.917276    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-76db7"]
Jul 02 17:06:41.917626 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:41.917612    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5855d488-e45d-4663-8b10-5bf67fe12356" containerName="authorino"
Jul 02 17:06:41.917626 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:41.917626    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5855d488-e45d-4663-8b10-5bf67fe12356" containerName="authorino"
Jul 02 17:06:41.917769 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:41.917682    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5855d488-e45d-4663-8b10-5bf67fe12356" containerName="authorino"
Jul 02 17:06:41.922022 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:41.921999    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-76db7"
Jul 02 17:06:41.927309 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:41.927231    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-76db7"]
Jul 02 17:06:42.072691 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.072640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwgfj\" (UniqueName: \"kubernetes.io/projected/910c2645-24af-492f-9ec0-747836dfbc9e-kube-api-access-vwgfj\") pod \"authorino-5d4b67c446-76db7\" (UID: \"910c2645-24af-492f-9ec0-747836dfbc9e\") " pod="kuadrant-system/authorino-5d4b67c446-76db7"
Jul 02 17:06:42.173587 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.173546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwgfj\" (UniqueName: \"kubernetes.io/projected/910c2645-24af-492f-9ec0-747836dfbc9e-kube-api-access-vwgfj\") pod \"authorino-5d4b67c446-76db7\" (UID: \"910c2645-24af-492f-9ec0-747836dfbc9e\") " pod="kuadrant-system/authorino-5d4b67c446-76db7"
Jul 02 17:06:42.182508 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.182438    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwgfj\" (UniqueName: \"kubernetes.io/projected/910c2645-24af-492f-9ec0-747836dfbc9e-kube-api-access-vwgfj\") pod \"authorino-5d4b67c446-76db7\" (UID: \"910c2645-24af-492f-9ec0-747836dfbc9e\") " pod="kuadrant-system/authorino-5d4b67c446-76db7"
Jul 02 17:06:42.187875 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.187845    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-76db7"]
Jul 02 17:06:42.188201 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.188184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-76db7"
Jul 02 17:06:42.212973 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.212932    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-745884dd9d-d8ltr"]
Jul 02 17:06:42.216335 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.216310    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-745884dd9d-d8ltr"
Jul 02 17:06:42.226783 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.226758    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-745884dd9d-d8ltr"]
Jul 02 17:06:42.280394 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.280361    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-745884dd9d-d8ltr"]
Jul 02 17:06:42.280716 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:06:42.280689    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ft7n2], unattached volumes=[], failed to process volumes=[kube-api-access-ft7n2]: context canceled" pod="kuadrant-system/authorino-745884dd9d-d8ltr" podUID="2b14d159-ad0d-444e-b946-a12360518cba"
Jul 02 17:06:42.305781 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.305746    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b7f99fbcd-gwbjk"]
Jul 02 17:06:42.309394 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.309371    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b7f99fbcd-gwbjk"
Jul 02 17:06:42.311514 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.311487    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 02 17:06:42.322577 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.320796    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b7f99fbcd-gwbjk"]
Jul 02 17:06:42.335318 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.335291    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-76db7"]
Jul 02 17:06:42.335922 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:06:42.335898    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod910c2645_24af_492f_9ec0_747836dfbc9e.slice/crio-4ac6344529ddd79b1075bd925b3e8bfab06eda5b6a2d35c2bfe1c5ab95f01d4a WatchSource:0}: Error finding container 4ac6344529ddd79b1075bd925b3e8bfab06eda5b6a2d35c2bfe1c5ab95f01d4a: Status 404 returned error can't find the container with id 4ac6344529ddd79b1075bd925b3e8bfab06eda5b6a2d35c2bfe1c5ab95f01d4a
Jul 02 17:06:42.375760 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.375730    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft7n2\" (UniqueName: \"kubernetes.io/projected/2b14d159-ad0d-444e-b946-a12360518cba-kube-api-access-ft7n2\") pod \"authorino-745884dd9d-d8ltr\" (UID: \"2b14d159-ad0d-444e-b946-a12360518cba\") " pod="kuadrant-system/authorino-745884dd9d-d8ltr"
Jul 02 17:06:42.477137 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.477037    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft7n2\" (UniqueName: \"kubernetes.io/projected/2b14d159-ad0d-444e-b946-a12360518cba-kube-api-access-ft7n2\") pod \"authorino-745884dd9d-d8ltr\" (UID: \"2b14d159-ad0d-444e-b946-a12360518cba\") " pod="kuadrant-system/authorino-745884dd9d-d8ltr"
Jul 02 17:06:42.477291 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.477150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e54c3f8a-2408-4333-943d-901bbd0f636c-tls-cert\") pod \"authorino-b7f99fbcd-gwbjk\" (UID: \"e54c3f8a-2408-4333-943d-901bbd0f636c\") " pod="kuadrant-system/authorino-b7f99fbcd-gwbjk"
Jul 02 17:06:42.477291 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.477180    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j8qk\" (UniqueName: \"kubernetes.io/projected/e54c3f8a-2408-4333-943d-901bbd0f636c-kube-api-access-2j8qk\") pod \"authorino-b7f99fbcd-gwbjk\" (UID: \"e54c3f8a-2408-4333-943d-901bbd0f636c\") " pod="kuadrant-system/authorino-b7f99fbcd-gwbjk"
Jul 02 17:06:42.484627 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.484595    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft7n2\" (UniqueName: \"kubernetes.io/projected/2b14d159-ad0d-444e-b946-a12360518cba-kube-api-access-ft7n2\") pod \"authorino-745884dd9d-d8ltr\" (UID: \"2b14d159-ad0d-444e-b946-a12360518cba\") " pod="kuadrant-system/authorino-745884dd9d-d8ltr"
Jul 02 17:06:42.578328 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.578293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e54c3f8a-2408-4333-943d-901bbd0f636c-tls-cert\") pod \"authorino-b7f99fbcd-gwbjk\" (UID: \"e54c3f8a-2408-4333-943d-901bbd0f636c\") " pod="kuadrant-system/authorino-b7f99fbcd-gwbjk"
Jul 02 17:06:42.578525 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.578343    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j8qk\" (UniqueName: \"kubernetes.io/projected/e54c3f8a-2408-4333-943d-901bbd0f636c-kube-api-access-2j8qk\") pod \"authorino-b7f99fbcd-gwbjk\" (UID: \"e54c3f8a-2408-4333-943d-901bbd0f636c\") " pod="kuadrant-system/authorino-b7f99fbcd-gwbjk"
Jul 02 17:06:42.580745 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.580713    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e54c3f8a-2408-4333-943d-901bbd0f636c-tls-cert\") pod \"authorino-b7f99fbcd-gwbjk\" (UID: \"e54c3f8a-2408-4333-943d-901bbd0f636c\") " pod="kuadrant-system/authorino-b7f99fbcd-gwbjk"
Jul 02 17:06:42.585905 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.585876    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j8qk\" (UniqueName: \"kubernetes.io/projected/e54c3f8a-2408-4333-943d-901bbd0f636c-kube-api-access-2j8qk\") pod \"authorino-b7f99fbcd-gwbjk\" (UID: \"e54c3f8a-2408-4333-943d-901bbd0f636c\") " pod="kuadrant-system/authorino-b7f99fbcd-gwbjk"
Jul 02 17:06:42.627283 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.627253    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b7f99fbcd-gwbjk"
Jul 02 17:06:42.671663 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.671623    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-76db7" event={"ID":"910c2645-24af-492f-9ec0-747836dfbc9e","Type":"ContainerStarted","Data":"4ac6344529ddd79b1075bd925b3e8bfab06eda5b6a2d35c2bfe1c5ab95f01d4a"}
Jul 02 17:06:42.671663 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.671651    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-745884dd9d-d8ltr"
Jul 02 17:06:42.680634 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.680606    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-745884dd9d-d8ltr"
Jul 02 17:06:42.766268 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.766235    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b7f99fbcd-gwbjk"]
Jul 02 17:06:42.768358 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:06:42.768332    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode54c3f8a_2408_4333_943d_901bbd0f636c.slice/crio-81e5260751fd5075c9c2471057ef1f606431d1f2177cf2760079ec1646edbf71 WatchSource:0}: Error finding container 81e5260751fd5075c9c2471057ef1f606431d1f2177cf2760079ec1646edbf71: Status 404 returned error can't find the container with id 81e5260751fd5075c9c2471057ef1f606431d1f2177cf2760079ec1646edbf71
Jul 02 17:06:42.780339 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.780307    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft7n2\" (UniqueName: \"kubernetes.io/projected/2b14d159-ad0d-444e-b946-a12360518cba-kube-api-access-ft7n2\") pod \"2b14d159-ad0d-444e-b946-a12360518cba\" (UID: \"2b14d159-ad0d-444e-b946-a12360518cba\") "
Jul 02 17:06:42.783016 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.782991    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b14d159-ad0d-444e-b946-a12360518cba-kube-api-access-ft7n2" (OuterVolumeSpecName: "kube-api-access-ft7n2") pod "2b14d159-ad0d-444e-b946-a12360518cba" (UID: "2b14d159-ad0d-444e-b946-a12360518cba"). InnerVolumeSpecName "kube-api-access-ft7n2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:06:42.881200 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:42.881163    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft7n2\" (UniqueName: \"kubernetes.io/projected/2b14d159-ad0d-444e-b946-a12360518cba-kube-api-access-ft7n2\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:06:43.678268 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:43.678227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-76db7" event={"ID":"910c2645-24af-492f-9ec0-747836dfbc9e","Type":"ContainerStarted","Data":"8269a6e7e2ccb9664dd6d3f73b699e82348cf23fd90518abf5627a77783600fe"}
Jul 02 17:06:43.678474 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:43.678278    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-76db7" podUID="910c2645-24af-492f-9ec0-747836dfbc9e" containerName="authorino" containerID="cri-o://8269a6e7e2ccb9664dd6d3f73b699e82348cf23fd90518abf5627a77783600fe" gracePeriod=30
Jul 02 17:06:43.679831 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:43.679799    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b7f99fbcd-gwbjk" event={"ID":"e54c3f8a-2408-4333-943d-901bbd0f636c","Type":"ContainerStarted","Data":"146ef06204bf8653caca6aa1b25f6b3e2924b718140c81d2ca0d6affee69ae43"}
Jul 02 17:06:43.679831 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:43.679835    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b7f99fbcd-gwbjk" event={"ID":"e54c3f8a-2408-4333-943d-901bbd0f636c","Type":"ContainerStarted","Data":"81e5260751fd5075c9c2471057ef1f606431d1f2177cf2760079ec1646edbf71"}
Jul 02 17:06:43.680028 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:43.679875    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-745884dd9d-d8ltr"
Jul 02 17:06:43.694329 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:43.694288    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-76db7" podStartSLOduration=2.37239652 podStartE2EDuration="2.694274247s" totalImagesPullingTime="321.877727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:06:43.693269315 +0000 UTC m=+743.059935289" watchObservedRunningTime="2026-07-02 17:06:43.694274247 +0000 UTC m=+743.060940210"
Jul 02 17:06:43.714549 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:43.714505    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b7f99fbcd-gwbjk" podStartSLOduration=1.327519376 podStartE2EDuration="1.714490114s" totalImagesPullingTime="386.970738ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:06:43.712562113 +0000 UTC m=+743.079228090" watchObservedRunningTime="2026-07-02 17:06:43.714490114 +0000 UTC m=+743.081156076"
Jul 02 17:06:43.739582 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:43.739552    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nr2fz"]
Jul 02 17:06:43.739762 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:43.739737    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nr2fz" podUID="34c303f1-9171-4608-a8a2-9ddf3c5f84e0" containerName="authorino" containerID="cri-o://1e09772382b42763c0584d9a6d6d1857e887273c022fb4fc019e9594b92bfc4f" gracePeriod=30
Jul 02 17:06:43.783520 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:43.783479    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-745884dd9d-d8ltr"]
Jul 02 17:06:43.785668 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:43.785638    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-745884dd9d-d8ltr"]
Jul 02 17:06:44.007972 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.007949    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-76db7"
Jul 02 17:06:44.010076 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.010055    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nr2fz"
Jul 02 17:06:44.091604 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.091570    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll7m7\" (UniqueName: \"kubernetes.io/projected/34c303f1-9171-4608-a8a2-9ddf3c5f84e0-kube-api-access-ll7m7\") pod \"34c303f1-9171-4608-a8a2-9ddf3c5f84e0\" (UID: \"34c303f1-9171-4608-a8a2-9ddf3c5f84e0\") "
Jul 02 17:06:44.091604 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.091606    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwgfj\" (UniqueName: \"kubernetes.io/projected/910c2645-24af-492f-9ec0-747836dfbc9e-kube-api-access-vwgfj\") pod \"910c2645-24af-492f-9ec0-747836dfbc9e\" (UID: \"910c2645-24af-492f-9ec0-747836dfbc9e\") "
Jul 02 17:06:44.093762 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.093737    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/910c2645-24af-492f-9ec0-747836dfbc9e-kube-api-access-vwgfj" (OuterVolumeSpecName: "kube-api-access-vwgfj") pod "910c2645-24af-492f-9ec0-747836dfbc9e" (UID: "910c2645-24af-492f-9ec0-747836dfbc9e"). InnerVolumeSpecName "kube-api-access-vwgfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:06:44.093762 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.093758    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34c303f1-9171-4608-a8a2-9ddf3c5f84e0-kube-api-access-ll7m7" (OuterVolumeSpecName: "kube-api-access-ll7m7") pod "34c303f1-9171-4608-a8a2-9ddf3c5f84e0" (UID: "34c303f1-9171-4608-a8a2-9ddf3c5f84e0"). InnerVolumeSpecName "kube-api-access-ll7m7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:06:44.192488 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.192408    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll7m7\" (UniqueName: \"kubernetes.io/projected/34c303f1-9171-4608-a8a2-9ddf3c5f84e0-kube-api-access-ll7m7\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:06:44.192488 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.192438    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwgfj\" (UniqueName: \"kubernetes.io/projected/910c2645-24af-492f-9ec0-747836dfbc9e-kube-api-access-vwgfj\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:06:44.690331 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.690297    2579 generic.go:356] "Generic (PLEG): container finished" podID="910c2645-24af-492f-9ec0-747836dfbc9e" containerID="8269a6e7e2ccb9664dd6d3f73b699e82348cf23fd90518abf5627a77783600fe" exitCode=0
Jul 02 17:06:44.690544 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.690369    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-76db7"
Jul 02 17:06:44.690544 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.690393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-76db7" event={"ID":"910c2645-24af-492f-9ec0-747836dfbc9e","Type":"ContainerDied","Data":"8269a6e7e2ccb9664dd6d3f73b699e82348cf23fd90518abf5627a77783600fe"}
Jul 02 17:06:44.690544 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.690443    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-76db7" event={"ID":"910c2645-24af-492f-9ec0-747836dfbc9e","Type":"ContainerDied","Data":"4ac6344529ddd79b1075bd925b3e8bfab06eda5b6a2d35c2bfe1c5ab95f01d4a"}
Jul 02 17:06:44.690544 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.690466    2579 scope.go:117] "RemoveContainer" containerID="8269a6e7e2ccb9664dd6d3f73b699e82348cf23fd90518abf5627a77783600fe"
Jul 02 17:06:44.692131 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.692083    2579 generic.go:356] "Generic (PLEG): container finished" podID="34c303f1-9171-4608-a8a2-9ddf3c5f84e0" containerID="1e09772382b42763c0584d9a6d6d1857e887273c022fb4fc019e9594b92bfc4f" exitCode=0
Jul 02 17:06:44.692257 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.692146    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nr2fz"
Jul 02 17:06:44.692257 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.692181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nr2fz" event={"ID":"34c303f1-9171-4608-a8a2-9ddf3c5f84e0","Type":"ContainerDied","Data":"1e09772382b42763c0584d9a6d6d1857e887273c022fb4fc019e9594b92bfc4f"}
Jul 02 17:06:44.692257 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.692221    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nr2fz" event={"ID":"34c303f1-9171-4608-a8a2-9ddf3c5f84e0","Type":"ContainerDied","Data":"d878e53a2456eed469643ad14023ab55be478a7998792de9bcf89c73d2994571"}
Jul 02 17:06:44.701326 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.701261    2579 scope.go:117] "RemoveContainer" containerID="8269a6e7e2ccb9664dd6d3f73b699e82348cf23fd90518abf5627a77783600fe"
Jul 02 17:06:44.701752 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:06:44.701622    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8269a6e7e2ccb9664dd6d3f73b699e82348cf23fd90518abf5627a77783600fe\": container with ID starting with 8269a6e7e2ccb9664dd6d3f73b699e82348cf23fd90518abf5627a77783600fe not found: ID does not exist" containerID="8269a6e7e2ccb9664dd6d3f73b699e82348cf23fd90518abf5627a77783600fe"
Jul 02 17:06:44.701752 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.701657    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8269a6e7e2ccb9664dd6d3f73b699e82348cf23fd90518abf5627a77783600fe"} err="failed to get container status \"8269a6e7e2ccb9664dd6d3f73b699e82348cf23fd90518abf5627a77783600fe\": rpc error: code = NotFound desc = could not find container \"8269a6e7e2ccb9664dd6d3f73b699e82348cf23fd90518abf5627a77783600fe\": container with ID starting with 8269a6e7e2ccb9664dd6d3f73b699e82348cf23fd90518abf5627a77783600fe not found: ID does not exist"
Jul 02 17:06:44.701752 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.701680    2579 scope.go:117] "RemoveContainer" containerID="1e09772382b42763c0584d9a6d6d1857e887273c022fb4fc019e9594b92bfc4f"
Jul 02 17:06:44.710939 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.710919    2579 scope.go:117] "RemoveContainer" containerID="1e09772382b42763c0584d9a6d6d1857e887273c022fb4fc019e9594b92bfc4f"
Jul 02 17:06:44.711233 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:06:44.711216    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e09772382b42763c0584d9a6d6d1857e887273c022fb4fc019e9594b92bfc4f\": container with ID starting with 1e09772382b42763c0584d9a6d6d1857e887273c022fb4fc019e9594b92bfc4f not found: ID does not exist" containerID="1e09772382b42763c0584d9a6d6d1857e887273c022fb4fc019e9594b92bfc4f"
Jul 02 17:06:44.711298 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.711239    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e09772382b42763c0584d9a6d6d1857e887273c022fb4fc019e9594b92bfc4f"} err="failed to get container status \"1e09772382b42763c0584d9a6d6d1857e887273c022fb4fc019e9594b92bfc4f\": rpc error: code = NotFound desc = could not find container \"1e09772382b42763c0584d9a6d6d1857e887273c022fb4fc019e9594b92bfc4f\": container with ID starting with 1e09772382b42763c0584d9a6d6d1857e887273c022fb4fc019e9594b92bfc4f not found: ID does not exist"
Jul 02 17:06:44.717745 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.717721    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-76db7"]
Jul 02 17:06:44.723730 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.723699    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-76db7"]
Jul 02 17:06:44.736798 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.736770    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nr2fz"]
Jul 02 17:06:44.740320 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:44.740294    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nr2fz"]
Jul 02 17:06:45.720241 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:45.720196    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b14d159-ad0d-444e-b946-a12360518cba" path="/var/lib/kubelet/pods/2b14d159-ad0d-444e-b946-a12360518cba/volumes"
Jul 02 17:06:45.720734 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:45.720527    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34c303f1-9171-4608-a8a2-9ddf3c5f84e0" path="/var/lib/kubelet/pods/34c303f1-9171-4608-a8a2-9ddf3c5f84e0/volumes"
Jul 02 17:06:45.720929 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:45.720910    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="910c2645-24af-492f-9ec0-747836dfbc9e" path="/var/lib/kubelet/pods/910c2645-24af-492f-9ec0-747836dfbc9e/volumes"
Jul 02 17:06:48.185770 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:48.185733    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:48.282327 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:48.282294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:48.342211 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:48.342175    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:51.731154 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:51.731112    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:06:51.819006 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:06:51.818964    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:07:16.811508 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:16.811459    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:07:23.202272 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:23.202237    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:07:23.645983 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:23.645952    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:07:23.749947 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:23.749908    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:07:24.077167 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.077047    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:07:24.158840 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.158810    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:07:24.174733 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.174702    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2gn7d"]
Jul 02 17:07:24.175052 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.175040    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="910c2645-24af-492f-9ec0-747836dfbc9e" containerName="authorino"
Jul 02 17:07:24.175120 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.175054    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="910c2645-24af-492f-9ec0-747836dfbc9e" containerName="authorino"
Jul 02 17:07:24.175120 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.175067    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c303f1-9171-4608-a8a2-9ddf3c5f84e0" containerName="authorino"
Jul 02 17:07:24.175120 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.175072    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c303f1-9171-4608-a8a2-9ddf3c5f84e0" containerName="authorino"
Jul 02 17:07:24.175242 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.175149    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c303f1-9171-4608-a8a2-9ddf3c5f84e0" containerName="authorino"
Jul 02 17:07:24.175242 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.175158    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="910c2645-24af-492f-9ec0-747836dfbc9e" containerName="authorino"
Jul 02 17:07:24.179540 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.179508    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-2gn7d"
Jul 02 17:07:24.183176 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.183151    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 02 17:07:24.189247 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.189212    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2gn7d"]
Jul 02 17:07:24.197801 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.197765    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wngmr\" (UniqueName: \"kubernetes.io/projected/3fbb9ba9-4d07-4af8-8431-437d115e18eb-kube-api-access-wngmr\") pod \"payload-pre-processing-7964457696-2gn7d\" (UID: \"3fbb9ba9-4d07-4af8-8431-437d115e18eb\") " pod="openshift-ingress/payload-pre-processing-7964457696-2gn7d"
Jul 02 17:07:24.198118 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.197992    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fbb9ba9-4d07-4af8-8431-437d115e18eb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2gn7d\" (UID: \"3fbb9ba9-4d07-4af8-8431-437d115e18eb\") " pod="openshift-ingress/payload-pre-processing-7964457696-2gn7d"
Jul 02 17:07:24.210808 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.210782    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-fvr4z"]
Jul 02 17:07:24.213999 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.213977    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-fvr4z"
Jul 02 17:07:24.216797 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.216775    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-cd6lx\""
Jul 02 17:07:24.228634 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.228607    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-fvr4z"]
Jul 02 17:07:24.298869 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.298833    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fbb9ba9-4d07-4af8-8431-437d115e18eb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2gn7d\" (UID: \"3fbb9ba9-4d07-4af8-8431-437d115e18eb\") " pod="openshift-ingress/payload-pre-processing-7964457696-2gn7d"
Jul 02 17:07:24.299034 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.298880    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wngmr\" (UniqueName: \"kubernetes.io/projected/3fbb9ba9-4d07-4af8-8431-437d115e18eb-kube-api-access-wngmr\") pod \"payload-pre-processing-7964457696-2gn7d\" (UID: \"3fbb9ba9-4d07-4af8-8431-437d115e18eb\") " pod="openshift-ingress/payload-pre-processing-7964457696-2gn7d"
Jul 02 17:07:24.299034 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.298903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e09414fc-1889-44df-b8ef-96093599b96f-plugins-config-volume\") pod \"payload-processing-58f86c7798-fvr4z\" (UID: \"e09414fc-1889-44df-b8ef-96093599b96f\") " pod="openshift-ingress/payload-processing-58f86c7798-fvr4z"
Jul 02 17:07:24.299034 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.298926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h6gw\" (UniqueName: \"kubernetes.io/projected/e09414fc-1889-44df-b8ef-96093599b96f-kube-api-access-7h6gw\") pod \"payload-processing-58f86c7798-fvr4z\" (UID: \"e09414fc-1889-44df-b8ef-96093599b96f\") " pod="openshift-ingress/payload-processing-58f86c7798-fvr4z"
Jul 02 17:07:24.299563 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.299538    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3fbb9ba9-4d07-4af8-8431-437d115e18eb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2gn7d\" (UID: \"3fbb9ba9-4d07-4af8-8431-437d115e18eb\") " pod="openshift-ingress/payload-pre-processing-7964457696-2gn7d"
Jul 02 17:07:24.306790 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.306764    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wngmr\" (UniqueName: \"kubernetes.io/projected/3fbb9ba9-4d07-4af8-8431-437d115e18eb-kube-api-access-wngmr\") pod \"payload-pre-processing-7964457696-2gn7d\" (UID: \"3fbb9ba9-4d07-4af8-8431-437d115e18eb\") " pod="openshift-ingress/payload-pre-processing-7964457696-2gn7d"
Jul 02 17:07:24.399847 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.399816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e09414fc-1889-44df-b8ef-96093599b96f-plugins-config-volume\") pod \"payload-processing-58f86c7798-fvr4z\" (UID: \"e09414fc-1889-44df-b8ef-96093599b96f\") " pod="openshift-ingress/payload-processing-58f86c7798-fvr4z"
Jul 02 17:07:24.399847 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.399857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h6gw\" (UniqueName: \"kubernetes.io/projected/e09414fc-1889-44df-b8ef-96093599b96f-kube-api-access-7h6gw\") pod \"payload-processing-58f86c7798-fvr4z\" (UID: \"e09414fc-1889-44df-b8ef-96093599b96f\") " pod="openshift-ingress/payload-processing-58f86c7798-fvr4z"
Jul 02 17:07:24.400542 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.400522    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e09414fc-1889-44df-b8ef-96093599b96f-plugins-config-volume\") pod \"payload-processing-58f86c7798-fvr4z\" (UID: \"e09414fc-1889-44df-b8ef-96093599b96f\") " pod="openshift-ingress/payload-processing-58f86c7798-fvr4z"
Jul 02 17:07:24.407478 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.407458    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h6gw\" (UniqueName: \"kubernetes.io/projected/e09414fc-1889-44df-b8ef-96093599b96f-kube-api-access-7h6gw\") pod \"payload-processing-58f86c7798-fvr4z\" (UID: \"e09414fc-1889-44df-b8ef-96093599b96f\") " pod="openshift-ingress/payload-processing-58f86c7798-fvr4z"
Jul 02 17:07:24.490764 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.490716    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-2gn7d"
Jul 02 17:07:24.526376 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.526340    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-fvr4z"
Jul 02 17:07:24.636684 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.636655    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2gn7d"]
Jul 02 17:07:24.639368 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:07:24.639317    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fbb9ba9_4d07_4af8_8431_437d115e18eb.slice/crio-2d6a1842c64b749d818bdd099132d8af268032a429887bb8ecaa4d483508e151 WatchSource:0}: Error finding container 2d6a1842c64b749d818bdd099132d8af268032a429887bb8ecaa4d483508e151: Status 404 returned error can't find the container with id 2d6a1842c64b749d818bdd099132d8af268032a429887bb8ecaa4d483508e151
Jul 02 17:07:24.670369 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.670345    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-fvr4z"]
Jul 02 17:07:24.672203 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:07:24.672179    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode09414fc_1889_44df_b8ef_96093599b96f.slice/crio-7721629389a24931d0f6f94d630e44740ab7fe694696e420b1c6bfe8170f2adc WatchSource:0}: Error finding container 7721629389a24931d0f6f94d630e44740ab7fe694696e420b1c6bfe8170f2adc: Status 404 returned error can't find the container with id 7721629389a24931d0f6f94d630e44740ab7fe694696e420b1c6bfe8170f2adc
Jul 02 17:07:24.901342 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.901304    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-fvr4z" event={"ID":"e09414fc-1889-44df-b8ef-96093599b96f","Type":"ContainerStarted","Data":"7721629389a24931d0f6f94d630e44740ab7fe694696e420b1c6bfe8170f2adc"}
Jul 02 17:07:24.902616 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:24.902584    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-2gn7d" event={"ID":"3fbb9ba9-4d07-4af8-8431-437d115e18eb","Type":"ContainerStarted","Data":"2d6a1842c64b749d818bdd099132d8af268032a429887bb8ecaa4d483508e151"}
Jul 02 17:07:26.914245 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:26.914210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-fvr4z" event={"ID":"e09414fc-1889-44df-b8ef-96093599b96f","Type":"ContainerStarted","Data":"49f8c4c78ffbf8d57427af373bff6ecb9929a956ded700c8df4be62a6d002d0f"}
Jul 02 17:07:26.914702 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:26.914271    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-fvr4z"
Jul 02 17:07:26.915738 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:26.915712    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-2gn7d" event={"ID":"3fbb9ba9-4d07-4af8-8431-437d115e18eb","Type":"ContainerStarted","Data":"1d24cbc939e8e79cdcf16beb8043ff9810b29bda3cd95090e2efe3d456b6920a"}
Jul 02 17:07:26.915855 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:26.915838    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-2gn7d"
Jul 02 17:07:26.930978 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:26.930923    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-fvr4z" podStartSLOduration=1.043363547 podStartE2EDuration="2.93090403s" totalImagesPullingTime="1.887540483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:07:26.928961089 +0000 UTC m=+786.295627051" watchObservedRunningTime="2026-07-02 17:07:26.93090403 +0000 UTC m=+786.297569993"
Jul 02 17:07:26.944600 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:26.944543    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-2gn7d" podStartSLOduration=1.027324977 podStartE2EDuration="2.944528074s" totalImagesPullingTime="1.917203097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:07:26.944292254 +0000 UTC m=+786.310958217" watchObservedRunningTime="2026-07-02 17:07:26.944528074 +0000 UTC m=+786.311194036"
Jul 02 17:07:33.705504 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:33.705447    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:07:33.804553 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:33.804522    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:07:37.922850 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:37.922817    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-fvr4z"
Jul 02 17:07:37.923266 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:07:37.922936    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-2gn7d"
Jul 02 17:08:04.210178 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:04.210054    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:08:10.989864 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:10.989823    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:08:23.345760 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.345723    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"]
Jul 02 17:08:23.349045 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.349022    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.351455 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.351430    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 17:08:23.351577 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.351468    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 02 17:08:23.351723 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.351710    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 17:08:23.352479 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.352462    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gxrr7\""
Jul 02 17:08:23.361325 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.361298    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"]
Jul 02 17:08:23.376860 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.376828    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:08:23.399168 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.399132    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmv2c\" (UniqueName: \"kubernetes.io/projected/7b935586-fe59-4cbb-9530-25cd0a535508-kube-api-access-wmv2c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.399334 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.399189    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b935586-fe59-4cbb-9530-25cd0a535508-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.399334 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.399227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b935586-fe59-4cbb-9530-25cd0a535508-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.399334 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.399248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b935586-fe59-4cbb-9530-25cd0a535508-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.399334 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.399263    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b935586-fe59-4cbb-9530-25cd0a535508-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.399523 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.399353    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b935586-fe59-4cbb-9530-25cd0a535508-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.499963 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.499923    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmv2c\" (UniqueName: \"kubernetes.io/projected/7b935586-fe59-4cbb-9530-25cd0a535508-kube-api-access-wmv2c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.500179 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.499980    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b935586-fe59-4cbb-9530-25cd0a535508-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.500179 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.500003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b935586-fe59-4cbb-9530-25cd0a535508-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.500179 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.500025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b935586-fe59-4cbb-9530-25cd0a535508-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.500179 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.500040    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b935586-fe59-4cbb-9530-25cd0a535508-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.500179 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.500080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b935586-fe59-4cbb-9530-25cd0a535508-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.500511 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.500474    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b935586-fe59-4cbb-9530-25cd0a535508-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.500511 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.500494    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b935586-fe59-4cbb-9530-25cd0a535508-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.500679 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.500559    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b935586-fe59-4cbb-9530-25cd0a535508-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.502421 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.502396    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b935586-fe59-4cbb-9530-25cd0a535508-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.502601 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.502583    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b935586-fe59-4cbb-9530-25cd0a535508-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.508179 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.508162    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmv2c\" (UniqueName: \"kubernetes.io/projected/7b935586-fe59-4cbb-9530-25cd0a535508-kube-api-access-wmv2c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tztmk\" (UID: \"7b935586-fe59-4cbb-9530-25cd0a535508\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.660053 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.659958    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:23.796265 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:23.796208    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"]
Jul 02 17:08:23.799753 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:08:23.799714    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b935586_fe59_4cbb_9530_25cd0a535508.slice/crio-cde7eb01768e064719f3b92cd10faaf3f475cf8a4396d0007455a0b77a138cab WatchSource:0}: Error finding container cde7eb01768e064719f3b92cd10faaf3f475cf8a4396d0007455a0b77a138cab: Status 404 returned error can't find the container with id cde7eb01768e064719f3b92cd10faaf3f475cf8a4396d0007455a0b77a138cab
Jul 02 17:08:24.210840 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:24.210806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk" event={"ID":"7b935586-fe59-4cbb-9530-25cd0a535508","Type":"ContainerStarted","Data":"cde7eb01768e064719f3b92cd10faaf3f475cf8a4396d0007455a0b77a138cab"}
Jul 02 17:08:25.218003 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:25.217912    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk" event={"ID":"7b935586-fe59-4cbb-9530-25cd0a535508","Type":"ContainerStarted","Data":"5ba4d49f0ec80d3f81fd7b43717cbc0d32b08c87c9591d094929c0a8e4fc26c2"}
Jul 02 17:08:25.238314 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:25.238261    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk" podStartSLOduration=1.145391367 podStartE2EDuration="2.23824651s" totalImagesPullingTime="1.092855143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:08:25.236490186 +0000 UTC m=+844.603156148" watchObservedRunningTime="2026-07-02 17:08:25.23824651 +0000 UTC m=+844.604912472"
Jul 02 17:08:33.660229 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:33.660187    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:33.660833 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:33.660264    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:33.672611 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:33.672583    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:34.274323 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:34.274289    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tztmk"
Jul 02 17:08:49.479689 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.479657    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"]
Jul 02 17:08:49.482992 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.482975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.485639 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.485615    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 02 17:08:49.500167 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.500138    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"]
Jul 02 17:08:49.507320 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.507295    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:08:49.632671 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.632624    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc2134c2-5c06-47b7-b44b-4d965fe95afa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.632671 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.632674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc2134c2-5c06-47b7-b44b-4d965fe95afa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.632886 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.632691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wstb2\" (UniqueName: \"kubernetes.io/projected/cc2134c2-5c06-47b7-b44b-4d965fe95afa-kube-api-access-wstb2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.632886 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.632766    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc2134c2-5c06-47b7-b44b-4d965fe95afa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.632886 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.632813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2134c2-5c06-47b7-b44b-4d965fe95afa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.632886 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.632853    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2134c2-5c06-47b7-b44b-4d965fe95afa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.734378 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.734286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2134c2-5c06-47b7-b44b-4d965fe95afa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.734378 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.734371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc2134c2-5c06-47b7-b44b-4d965fe95afa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.734626 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.734409    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc2134c2-5c06-47b7-b44b-4d965fe95afa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.734626 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.734431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wstb2\" (UniqueName: \"kubernetes.io/projected/cc2134c2-5c06-47b7-b44b-4d965fe95afa-kube-api-access-wstb2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.734626 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.734456    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc2134c2-5c06-47b7-b44b-4d965fe95afa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.734626 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.734501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2134c2-5c06-47b7-b44b-4d965fe95afa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.734909 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.734887    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc2134c2-5c06-47b7-b44b-4d965fe95afa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.735009 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.734945    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc2134c2-5c06-47b7-b44b-4d965fe95afa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.735009 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.734959    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc2134c2-5c06-47b7-b44b-4d965fe95afa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.736712 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.736682    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc2134c2-5c06-47b7-b44b-4d965fe95afa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.736843 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.736830    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2134c2-5c06-47b7-b44b-4d965fe95afa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.742761 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.742738    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wstb2\" (UniqueName: \"kubernetes.io/projected/cc2134c2-5c06-47b7-b44b-4d965fe95afa-kube-api-access-wstb2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm\" (UID: \"cc2134c2-5c06-47b7-b44b-4d965fe95afa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.795408 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.795380    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:49.984855 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:49.984782    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"]
Jul 02 17:08:49.986379 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:08:49.986350    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2134c2_5c06_47b7_b44b_4d965fe95afa.slice/crio-4d5dce6df44c06ad1432389099329c6b848b130ecada4dd51f7a4365ee0ee8ea WatchSource:0}: Error finding container 4d5dce6df44c06ad1432389099329c6b848b130ecada4dd51f7a4365ee0ee8ea: Status 404 returned error can't find the container with id 4d5dce6df44c06ad1432389099329c6b848b130ecada4dd51f7a4365ee0ee8ea
Jul 02 17:08:50.346473 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:50.346437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm" event={"ID":"cc2134c2-5c06-47b7-b44b-4d965fe95afa","Type":"ContainerStarted","Data":"d77056e4437848fd7760fd7f570314a7234392c10d890796c7b488e98bf2614f"}
Jul 02 17:08:50.346642 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:50.346494    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm" event={"ID":"cc2134c2-5c06-47b7-b44b-4d965fe95afa","Type":"ContainerStarted","Data":"4d5dce6df44c06ad1432389099329c6b848b130ecada4dd51f7a4365ee0ee8ea"}
Jul 02 17:08:50.363809 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:50.363753    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm" podStartSLOduration=1.125842472 podStartE2EDuration="1.363733477s" totalImagesPullingTime="237.891005ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:08:50.362714851 +0000 UTC m=+869.729380813" watchObservedRunningTime="2026-07-02 17:08:50.363733477 +0000 UTC m=+869.730399439"
Jul 02 17:08:54.671606 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:54.671568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:08:59.796500 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:59.796459    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:59.796974 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:59.796555    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:08:59.809490 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:08:59.809462    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:09:00.415708 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.415672    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm"
Jul 02 17:09:00.660899 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.660867    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"]
Jul 02 17:09:00.665207 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.665184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.668080 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.668021    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 02 17:09:00.682911 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.682884    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"]
Jul 02 17:09:00.709438 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.709398    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:09:00.734883 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.734855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82d8976f-74f8-4013-a475-35986bde4453-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.734883 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.734884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82d8976f-74f8-4013-a475-35986bde4453-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.735175 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.734912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6wx2\" (UniqueName: \"kubernetes.io/projected/82d8976f-74f8-4013-a475-35986bde4453-kube-api-access-n6wx2\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.735175 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.735018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82d8976f-74f8-4013-a475-35986bde4453-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.735175 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.735071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82d8976f-74f8-4013-a475-35986bde4453-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.735291 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.735182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82d8976f-74f8-4013-a475-35986bde4453-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.836342 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.836301    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82d8976f-74f8-4013-a475-35986bde4453-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.836342 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.836339    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82d8976f-74f8-4013-a475-35986bde4453-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.836903 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.836361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6wx2\" (UniqueName: \"kubernetes.io/projected/82d8976f-74f8-4013-a475-35986bde4453-kube-api-access-n6wx2\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.836903 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.836503    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82d8976f-74f8-4013-a475-35986bde4453-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.836903 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.836569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82d8976f-74f8-4013-a475-35986bde4453-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.836903 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.836651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82d8976f-74f8-4013-a475-35986bde4453-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.836903 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.836738    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82d8976f-74f8-4013-a475-35986bde4453-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.836903 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.836772    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82d8976f-74f8-4013-a475-35986bde4453-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.836903 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.836807    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82d8976f-74f8-4013-a475-35986bde4453-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.838807 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.838783    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82d8976f-74f8-4013-a475-35986bde4453-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.839103 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.839068    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82d8976f-74f8-4013-a475-35986bde4453-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.845007 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.844985    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6wx2\" (UniqueName: \"kubernetes.io/projected/82d8976f-74f8-4013-a475-35986bde4453-kube-api-access-n6wx2\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl\" (UID: \"82d8976f-74f8-4013-a475-35986bde4453\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:00.974768 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:00.974675    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:01.116130 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:01.116102    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"]
Jul 02 17:09:01.117666 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:09:01.117636    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82d8976f_74f8_4013_a475_35986bde4453.slice/crio-76adeda10606b4d1c3d5ca2a3e572132f1c9d811c9f7e610ab639cb549a7bcf0 WatchSource:0}: Error finding container 76adeda10606b4d1c3d5ca2a3e572132f1c9d811c9f7e610ab639cb549a7bcf0: Status 404 returned error can't find the container with id 76adeda10606b4d1c3d5ca2a3e572132f1c9d811c9f7e610ab639cb549a7bcf0
Jul 02 17:09:01.417583 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:01.417540    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl" event={"ID":"82d8976f-74f8-4013-a475-35986bde4453","Type":"ContainerStarted","Data":"4362a5b10940f98358e43ff6fa1fdc5c6c3e7edafd761cc83501c6a532f013da"}
Jul 02 17:09:01.417757 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:01.417596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl" event={"ID":"82d8976f-74f8-4013-a475-35986bde4453","Type":"ContainerStarted","Data":"76adeda10606b4d1c3d5ca2a3e572132f1c9d811c9f7e610ab639cb549a7bcf0"}
Jul 02 17:09:01.440892 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:01.440845    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl" podStartSLOduration=1.24785064 podStartE2EDuration="1.440829574s" totalImagesPullingTime="192.978934ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:09:01.438733353 +0000 UTC m=+880.805399317" watchObservedRunningTime="2026-07-02 17:09:01.440829574 +0000 UTC m=+880.807495578"
Jul 02 17:09:10.974806 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:10.974765    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:10.974806 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:10.974817    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:10.987469 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:10.987433    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:11.479808 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:11.479777    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl"
Jul 02 17:09:21.740844 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:21.740699    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:09:21.748486 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:21.748461    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:09:25.668483 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:25.668448    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:09:25.769953 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:25.769920    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:09:42.142339 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.142302    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:09:42.219439 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.219407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:09:42.264006 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.263976    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c664cf6b7-76tf4"]
Jul 02 17:09:42.267578 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.267560    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c664cf6b7-76tf4"
Jul 02 17:09:42.276309 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.276285    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c664cf6b7-76tf4"]
Jul 02 17:09:42.410973 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.410888    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5856d8c0-7996-43a9-a621-f81ad6d9ec95-tls-cert\") pod \"authorino-5c664cf6b7-76tf4\" (UID: \"5856d8c0-7996-43a9-a621-f81ad6d9ec95\") " pod="kuadrant-system/authorino-5c664cf6b7-76tf4"
Jul 02 17:09:42.410973 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.410961    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5nb4\" (UniqueName: \"kubernetes.io/projected/5856d8c0-7996-43a9-a621-f81ad6d9ec95-kube-api-access-l5nb4\") pod \"authorino-5c664cf6b7-76tf4\" (UID: \"5856d8c0-7996-43a9-a621-f81ad6d9ec95\") " pod="kuadrant-system/authorino-5c664cf6b7-76tf4"
Jul 02 17:09:42.511713 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.511676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5nb4\" (UniqueName: \"kubernetes.io/projected/5856d8c0-7996-43a9-a621-f81ad6d9ec95-kube-api-access-l5nb4\") pod \"authorino-5c664cf6b7-76tf4\" (UID: \"5856d8c0-7996-43a9-a621-f81ad6d9ec95\") " pod="kuadrant-system/authorino-5c664cf6b7-76tf4"
Jul 02 17:09:42.511926 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.511745    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5856d8c0-7996-43a9-a621-f81ad6d9ec95-tls-cert\") pod \"authorino-5c664cf6b7-76tf4\" (UID: \"5856d8c0-7996-43a9-a621-f81ad6d9ec95\") " pod="kuadrant-system/authorino-5c664cf6b7-76tf4"
Jul 02 17:09:42.514120 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.514099    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5856d8c0-7996-43a9-a621-f81ad6d9ec95-tls-cert\") pod \"authorino-5c664cf6b7-76tf4\" (UID: \"5856d8c0-7996-43a9-a621-f81ad6d9ec95\") " pod="kuadrant-system/authorino-5c664cf6b7-76tf4"
Jul 02 17:09:42.520136 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.520106    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5nb4\" (UniqueName: \"kubernetes.io/projected/5856d8c0-7996-43a9-a621-f81ad6d9ec95-kube-api-access-l5nb4\") pod \"authorino-5c664cf6b7-76tf4\" (UID: \"5856d8c0-7996-43a9-a621-f81ad6d9ec95\") " pod="kuadrant-system/authorino-5c664cf6b7-76tf4"
Jul 02 17:09:42.576880 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.576849    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c664cf6b7-76tf4"
Jul 02 17:09:42.738304 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.738195    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:09:42.740754 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.740726    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c664cf6b7-76tf4"]
Jul 02 17:09:42.742501 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:09:42.742478    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5856d8c0_7996_43a9_a621_f81ad6d9ec95.slice/crio-ded41ce45356c04bf50f5f5b5361c54c7cc614e4fab90ab921cc9e0c87fbd558 WatchSource:0}: Error finding container ded41ce45356c04bf50f5f5b5361c54c7cc614e4fab90ab921cc9e0c87fbd558: Status 404 returned error can't find the container with id ded41ce45356c04bf50f5f5b5361c54c7cc614e4fab90ab921cc9e0c87fbd558
Jul 02 17:09:42.743811 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.743786    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 17:09:42.841452 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:42.841420    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:09:43.629392 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:43.629359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c664cf6b7-76tf4" event={"ID":"5856d8c0-7996-43a9-a621-f81ad6d9ec95","Type":"ContainerStarted","Data":"ba7fedcfd111fd3de3edbf22e8ba58f164180f8e942620f0a420ea25220837f2"}
Jul 02 17:09:43.629392 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:43.629401    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c664cf6b7-76tf4" event={"ID":"5856d8c0-7996-43a9-a621-f81ad6d9ec95","Type":"ContainerStarted","Data":"ded41ce45356c04bf50f5f5b5361c54c7cc614e4fab90ab921cc9e0c87fbd558"}
Jul 02 17:09:43.660058 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:43.659989    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c664cf6b7-76tf4" podStartSLOduration=1.16803074 podStartE2EDuration="1.659967374s" totalImagesPullingTime="491.936634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:09:43.656275049 +0000 UTC m=+923.022941013" watchObservedRunningTime="2026-07-02 17:09:43.659967374 +0000 UTC m=+923.026633337"
Jul 02 17:09:43.712937 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:43.712901    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b7f99fbcd-gwbjk"]
Jul 02 17:09:43.713394 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:43.713360    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-b7f99fbcd-gwbjk" podUID="e54c3f8a-2408-4333-943d-901bbd0f636c" containerName="authorino" containerID="cri-o://146ef06204bf8653caca6aa1b25f6b3e2924b718140c81d2ca0d6affee69ae43" gracePeriod=30
Jul 02 17:09:43.984945 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:43.984912    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b7f99fbcd-gwbjk"
Jul 02 17:09:44.127830 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.127788    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j8qk\" (UniqueName: \"kubernetes.io/projected/e54c3f8a-2408-4333-943d-901bbd0f636c-kube-api-access-2j8qk\") pod \"e54c3f8a-2408-4333-943d-901bbd0f636c\" (UID: \"e54c3f8a-2408-4333-943d-901bbd0f636c\") "
Jul 02 17:09:44.128021 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.127880    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e54c3f8a-2408-4333-943d-901bbd0f636c-tls-cert\") pod \"e54c3f8a-2408-4333-943d-901bbd0f636c\" (UID: \"e54c3f8a-2408-4333-943d-901bbd0f636c\") "
Jul 02 17:09:44.141682 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.140599    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e54c3f8a-2408-4333-943d-901bbd0f636c-kube-api-access-2j8qk" (OuterVolumeSpecName: "kube-api-access-2j8qk") pod "e54c3f8a-2408-4333-943d-901bbd0f636c" (UID: "e54c3f8a-2408-4333-943d-901bbd0f636c"). InnerVolumeSpecName "kube-api-access-2j8qk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:09:44.148523 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.148450    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e54c3f8a-2408-4333-943d-901bbd0f636c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e54c3f8a-2408-4333-943d-901bbd0f636c" (UID: "e54c3f8a-2408-4333-943d-901bbd0f636c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:09:44.229242 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.229207    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j8qk\" (UniqueName: \"kubernetes.io/projected/e54c3f8a-2408-4333-943d-901bbd0f636c-kube-api-access-2j8qk\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:09:44.229242 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.229236    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e54c3f8a-2408-4333-943d-901bbd0f636c-tls-cert\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:09:44.635640 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.635602    2579 generic.go:356] "Generic (PLEG): container finished" podID="e54c3f8a-2408-4333-943d-901bbd0f636c" containerID="146ef06204bf8653caca6aa1b25f6b3e2924b718140c81d2ca0d6affee69ae43" exitCode=0
Jul 02 17:09:44.636025 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.635649    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b7f99fbcd-gwbjk"
Jul 02 17:09:44.636025 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.635690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b7f99fbcd-gwbjk" event={"ID":"e54c3f8a-2408-4333-943d-901bbd0f636c","Type":"ContainerDied","Data":"146ef06204bf8653caca6aa1b25f6b3e2924b718140c81d2ca0d6affee69ae43"}
Jul 02 17:09:44.636025 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.635747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b7f99fbcd-gwbjk" event={"ID":"e54c3f8a-2408-4333-943d-901bbd0f636c","Type":"ContainerDied","Data":"81e5260751fd5075c9c2471057ef1f606431d1f2177cf2760079ec1646edbf71"}
Jul 02 17:09:44.636025 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.635776    2579 scope.go:117] "RemoveContainer" containerID="146ef06204bf8653caca6aa1b25f6b3e2924b718140c81d2ca0d6affee69ae43"
Jul 02 17:09:44.645259 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.645240    2579 scope.go:117] "RemoveContainer" containerID="146ef06204bf8653caca6aa1b25f6b3e2924b718140c81d2ca0d6affee69ae43"
Jul 02 17:09:44.645558 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:09:44.645537    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"146ef06204bf8653caca6aa1b25f6b3e2924b718140c81d2ca0d6affee69ae43\": container with ID starting with 146ef06204bf8653caca6aa1b25f6b3e2924b718140c81d2ca0d6affee69ae43 not found: ID does not exist" containerID="146ef06204bf8653caca6aa1b25f6b3e2924b718140c81d2ca0d6affee69ae43"
Jul 02 17:09:44.645604 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.645568    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146ef06204bf8653caca6aa1b25f6b3e2924b718140c81d2ca0d6affee69ae43"} err="failed to get container status \"146ef06204bf8653caca6aa1b25f6b3e2924b718140c81d2ca0d6affee69ae43\": rpc error: code = NotFound desc = could not find container \"146ef06204bf8653caca6aa1b25f6b3e2924b718140c81d2ca0d6affee69ae43\": container with ID starting with 146ef06204bf8653caca6aa1b25f6b3e2924b718140c81d2ca0d6affee69ae43 not found: ID does not exist"
Jul 02 17:09:44.660422 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.660395    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b7f99fbcd-gwbjk"]
Jul 02 17:09:44.667687 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.667662    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b7f99fbcd-gwbjk"]
Jul 02 17:09:44.933185 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:44.933146    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:09:45.025581 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:45.025547    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:09:45.721119 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:09:45.721069    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e54c3f8a-2408-4333-943d-901bbd0f636c" path="/var/lib/kubelet/pods/e54c3f8a-2408-4333-943d-901bbd0f636c/volumes"
Jul 02 17:10:41.578430 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:10:41.578390    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:10:59.792259 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:10:59.792174    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:01.207849 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:11:01.207810    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:26.333792 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:11:26.333751    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:26.389080 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:11:26.389045    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:34.890168 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:11:34.890113    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:34.988998 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:11:34.988959    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:35.114528 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:11:35.114495    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:40.741557 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:11:40.741525    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:40.807034 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:11:40.806992    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:40.895547 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:11:40.895512    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:40.994529 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:11:40.994440    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:41.095180 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:11:41.095146    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:46.897399 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:11:46.897354    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:46.997510 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:11:46.997476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:13:39.718121 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:13:39.718068    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:21.778653 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:14:21.778534    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:14:21.784706 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:14:21.784680    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:14:51.872286 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:14:51.872245    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:32.848023 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:18:32.847930    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:21.817349 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:19:21.817240    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:19:21.825619 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:19:21.825590    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:20:15.282499 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:20:15.282457    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:26.854333 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:20:26.854294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:09.396322 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:09.396279    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:23.150490 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:23.150446    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:30.659846 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:30.659801    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:38.923689 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:38.923643    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:44.076923 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:44.076815    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:47.039858 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:47.039787    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:47.138939 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:47.138902    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:47.494677 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:47.494644    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:53.314966 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:53.314929    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:53.418928 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:53.418886    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:53.558005 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:53.557965    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:53.651537 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:53.651503    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:54.733804 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:54.733763    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:54.818288 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:54.818239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:54.893496 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:54.893437    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:54.994233 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:54.994137    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:55.304429 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:55.304320    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:55.403192 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:55.403151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:56.926571 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:56.926521    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:59.923704 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:22:59.923665    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:00.117270 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:00.117234    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:00.207121 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:00.206983    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:00.313384 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:00.313348    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:01.512572 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:01.512530    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:05.993990 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:05.993946    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:06.093979 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:06.093936    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:06.241367 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:06.241329    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:06.312626 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:06.312535    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:07.425191 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:07.425147    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:07.522748 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:07.522711    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:07.624181 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:07.624147    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:07.754932 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:07.754843    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:08.165216 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:08.165181    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:08.265418 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:08.265381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:09.439700 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:09.439668    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:12.696175 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:12.696142    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:13.035545 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:13.035442    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:19.044510 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:19.044475    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:19.147967 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:19.147923    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:24.928014 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:24.927978    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:24.994571 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:24.994533    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:25.138327 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:25.138289    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:26.015957 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:26.015883    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:26.082422 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:26.082376    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:26.353918 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:26.353886    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:26.440833 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:26.440793    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:26.540892 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:26.540851    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:26.641767 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:26.641672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:26.924637 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:26.924545    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:27.025568 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:27.025511    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:29.889217 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:29.889169    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:30.844872 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:30.844835    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:31.030814 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:31.030777    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:31.130392 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:31.130305    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:31.230939 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:31.230883    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:32.444389 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:32.444342    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:36.937707 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:36.937672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:38.017467 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:38.017399    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:39.025459 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:39.025420    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:44.758772 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:44.758733    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:44.871453 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:44.871411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:44.963340 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:44.963304    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:45.071399 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:45.071307    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:45.503571 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:23:45.503535    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:11.482314 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:11.482276    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:17.439750 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:17.439708    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:17.503954 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:17.503916    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:17.587936 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:17.587887    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:17.687171 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:17.687134    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:21.851799 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:21.851770    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:24:21.863773 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:21.863746    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:24:33.537695 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:33.537660    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:39.199911 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:39.199880    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:39.315932 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:39.315893    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:39.419828 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:39.419789    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:49.862061 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:49.862025    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:50.659807 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:50.659768    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:56.416984 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:56.416948    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:56.551727 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:56.551687    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:56.699797 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:56.699711    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:56.795826 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:56.795790    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:57.512106 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:57.512039    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:57.605773 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:57.605739    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:57.704374 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:57.704341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:59.290055 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:24:59.290018    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:05.028904 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:05.028860    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:05.085987 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:05.085936    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:05.704120 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:05.704070    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:11.624547 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:11.624514    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:11.690163 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:11.690129    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:11.857357 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:11.857327    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:12.192437 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:12.192397    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:12.295046 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:12.295001    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:15.058419 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:15.058369    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:15.151276 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:15.151243    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:15.220361 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:15.220322    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:15.362990 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:15.362952    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:15.820489 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:15.820400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:15.921894 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:15.921861    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:19.491269 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:19.491227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:20.128243 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:20.128203    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:20.224676 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:20.224635    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:20.579557 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:20.579458    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:26.427240 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:26.427195    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:26.599968 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:26.599915    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:26.900789 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:26.900746    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:27.307896 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:27.307814    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:27.371715 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:27.371674    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:32.997338 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:32.997296    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:33.068799 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:33.068761    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:33.278480 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:33.278383    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:33.494855 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:33.494818    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:33.627953 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:33.627916    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:33.723658 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:33.723626    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:33.830806 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:33.830755    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:39.370622 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:39.370588    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:39.430269 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:39.430234    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:39.509373 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:39.509334    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:39.609183 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:39.609143    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:39.709252 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:39.709167    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:45.218312 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:45.218219    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:45.297512 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:45.297465    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:51.646515 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:51.646480    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:51.961474 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:51.961394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:52.271892 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:52.271767    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:55.115071 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:55.115031    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:55.202365 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:55.202324    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:55.275790 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:55.275750    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:55.587432 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:55.587390    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:55.837312 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:55.837281    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:55.934846 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:55.934749    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:59.620398 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:25:59.620354    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:06.461704 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.461667    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"]
Jul 02 17:26:06.462159 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.462143    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e54c3f8a-2408-4333-943d-901bbd0f636c" containerName="authorino"
Jul 02 17:26:06.462159 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.462160    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e54c3f8a-2408-4333-943d-901bbd0f636c" containerName="authorino"
Jul 02 17:26:06.462242 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.462217    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e54c3f8a-2408-4333-943d-901bbd0f636c" containerName="authorino"
Jul 02 17:26:06.465253 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.465235    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.468530 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.468503    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3245e5b9\"/\"e2e-lifecycle-model-3245e5b9-kserve-self-signed-certs\""
Jul 02 17:26:06.468530 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.468515    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3245e5b9\"/\"default-dockercfg-jjbgb\""
Jul 02 17:26:06.468530 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.468519    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3245e5b9\"/\"openshift-service-ca.crt\""
Jul 02 17:26:06.468745 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.468634    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3245e5b9\"/\"kube-root-ca.crt\""
Jul 02 17:26:06.474662 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.474639    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"]
Jul 02 17:26:06.491689 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.491649    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:06.607462 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.607415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-tmp-dir\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.607648 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.607499    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-model-cache\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.607648 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.607528    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-dshm\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.607648 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.607553    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f67d169b-b758-4807-9d31-a8b1e26cab7c-tls-certs\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.607648 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.607610    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz9qn\" (UniqueName: \"kubernetes.io/projected/f67d169b-b758-4807-9d31-a8b1e26cab7c-kube-api-access-sz9qn\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.607795 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.607653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-home\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.708660 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.708624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-model-cache\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.708856 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.708666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-dshm\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.708856 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.708698    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f67d169b-b758-4807-9d31-a8b1e26cab7c-tls-certs\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.708856 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.708733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz9qn\" (UniqueName: \"kubernetes.io/projected/f67d169b-b758-4807-9d31-a8b1e26cab7c-kube-api-access-sz9qn\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.708856 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.708774    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-home\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.708856 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.708839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-tmp-dir\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.709177 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.709153    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-model-cache\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.709236 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.709206    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-home\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.709281 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.709249    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-tmp-dir\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.711621 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.711594    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-dshm\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.711805 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.711765    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f67d169b-b758-4807-9d31-a8b1e26cab7c-tls-certs\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.717153 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.717134    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz9qn\" (UniqueName: \"kubernetes.io/projected/f67d169b-b758-4807-9d31-a8b1e26cab7c-kube-api-access-sz9qn\") pod \"e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") " pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.775521 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.775485    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:06.917125 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:06.917080    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"]
Jul 02 17:26:06.919420 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:26:06.919345    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf67d169b_b758_4807_9d31_a8b1e26cab7c.slice/crio-3a5bad237bd02eee049d8233aac31ac3e939744e1b27a579723ad04c9c6e685e WatchSource:0}: Error finding container 3a5bad237bd02eee049d8233aac31ac3e939744e1b27a579723ad04c9c6e685e: Status 404 returned error can't find the container with id 3a5bad237bd02eee049d8233aac31ac3e939744e1b27a579723ad04c9c6e685e
Jul 02 17:26:07.738714 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:07.738679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h" event={"ID":"f67d169b-b758-4807-9d31-a8b1e26cab7c","Type":"ContainerStarted","Data":"cfe4d086dcea66df2d5c408ff758625126fd06e1ac9afcb31bdb1ffe12dbf783"}
Jul 02 17:26:07.738714 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:07.738718    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h" event={"ID":"f67d169b-b758-4807-9d31-a8b1e26cab7c","Type":"ContainerStarted","Data":"3a5bad237bd02eee049d8233aac31ac3e939744e1b27a579723ad04c9c6e685e"}
Jul 02 17:26:07.756492 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:07.756449    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h" podStartSLOduration=1.756432784 podStartE2EDuration="1.756432784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:26:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:26:07.754753656 +0000 UTC m=+1907.121419618" watchObservedRunningTime="2026-07-02 17:26:07.756432784 +0000 UTC m=+1907.123098747"
Jul 02 17:26:16.776381 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:16.776336    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:16.776845 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:16.776405    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:16.789253 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:16.789224    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:16.800900 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:16.800873    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:22.817502 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:22.817461    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:22.913682 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:22.913648    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:26.945859 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:26.945825    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:27.437593 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:27.437555    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:27.538284 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:27.538247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:27.724659 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:27.724567    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:33.046163 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:33.046129    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:38.028817 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:38.028780    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"]
Jul 02 17:26:38.122433 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:38.122399    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:53.049480 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.049435    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h" podUID="f67d169b-b758-4807-9d31-a8b1e26cab7c" containerName="main" containerID="cri-o://cfe4d086dcea66df2d5c408ff758625126fd06e1ac9afcb31bdb1ffe12dbf783" gracePeriod=45
Jul 02 17:26:53.305502 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.305431    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:53.396539 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.396498    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f67d169b-b758-4807-9d31-a8b1e26cab7c-tls-certs\") pod \"f67d169b-b758-4807-9d31-a8b1e26cab7c\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") "
Jul 02 17:26:53.396712 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.396561    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz9qn\" (UniqueName: \"kubernetes.io/projected/f67d169b-b758-4807-9d31-a8b1e26cab7c-kube-api-access-sz9qn\") pod \"f67d169b-b758-4807-9d31-a8b1e26cab7c\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") "
Jul 02 17:26:53.396712 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.396633    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-home\") pod \"f67d169b-b758-4807-9d31-a8b1e26cab7c\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") "
Jul 02 17:26:53.396712 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.396694    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-model-cache\") pod \"f67d169b-b758-4807-9d31-a8b1e26cab7c\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") "
Jul 02 17:26:53.396870 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.396727    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-tmp-dir\") pod \"f67d169b-b758-4807-9d31-a8b1e26cab7c\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") "
Jul 02 17:26:53.396870 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.396754    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-dshm\") pod \"f67d169b-b758-4807-9d31-a8b1e26cab7c\" (UID: \"f67d169b-b758-4807-9d31-a8b1e26cab7c\") "
Jul 02 17:26:53.396976 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.396957    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-home" (OuterVolumeSpecName: "home") pod "f67d169b-b758-4807-9d31-a8b1e26cab7c" (UID: "f67d169b-b758-4807-9d31-a8b1e26cab7c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:26:53.397042 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.396984    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-model-cache" (OuterVolumeSpecName: "model-cache") pod "f67d169b-b758-4807-9d31-a8b1e26cab7c" (UID: "f67d169b-b758-4807-9d31-a8b1e26cab7c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:26:53.397217 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.397179    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f67d169b-b758-4807-9d31-a8b1e26cab7c" (UID: "f67d169b-b758-4807-9d31-a8b1e26cab7c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:26:53.398791 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.398766    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f67d169b-b758-4807-9d31-a8b1e26cab7c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f67d169b-b758-4807-9d31-a8b1e26cab7c" (UID: "f67d169b-b758-4807-9d31-a8b1e26cab7c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:26:53.399066 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.399036    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-dshm" (OuterVolumeSpecName: "dshm") pod "f67d169b-b758-4807-9d31-a8b1e26cab7c" (UID: "f67d169b-b758-4807-9d31-a8b1e26cab7c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:26:53.399236 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.399212    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f67d169b-b758-4807-9d31-a8b1e26cab7c-kube-api-access-sz9qn" (OuterVolumeSpecName: "kube-api-access-sz9qn") pod "f67d169b-b758-4807-9d31-a8b1e26cab7c" (UID: "f67d169b-b758-4807-9d31-a8b1e26cab7c"). InnerVolumeSpecName "kube-api-access-sz9qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:26:53.497877 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.497840    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz9qn\" (UniqueName: \"kubernetes.io/projected/f67d169b-b758-4807-9d31-a8b1e26cab7c-kube-api-access-sz9qn\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:26:53.497877 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.497869    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:26:53.497877 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.497878    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:26:53.497877 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.497888    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:26:53.498178 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.497895    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f67d169b-b758-4807-9d31-a8b1e26cab7c-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:26:53.498178 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.497903    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f67d169b-b758-4807-9d31-a8b1e26cab7c-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:26:53.983802 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.983699    2579 generic.go:356] "Generic (PLEG): container finished" podID="f67d169b-b758-4807-9d31-a8b1e26cab7c" containerID="cfe4d086dcea66df2d5c408ff758625126fd06e1ac9afcb31bdb1ffe12dbf783" exitCode=0
Jul 02 17:26:53.983802 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.983763    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"
Jul 02 17:26:53.984023 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.983763    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h" event={"ID":"f67d169b-b758-4807-9d31-a8b1e26cab7c","Type":"ContainerDied","Data":"cfe4d086dcea66df2d5c408ff758625126fd06e1ac9afcb31bdb1ffe12dbf783"}
Jul 02 17:26:53.984023 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.983874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h" event={"ID":"f67d169b-b758-4807-9d31-a8b1e26cab7c","Type":"ContainerDied","Data":"3a5bad237bd02eee049d8233aac31ac3e939744e1b27a579723ad04c9c6e685e"}
Jul 02 17:26:53.984023 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.983891    2579 scope.go:117] "RemoveContainer" containerID="cfe4d086dcea66df2d5c408ff758625126fd06e1ac9afcb31bdb1ffe12dbf783"
Jul 02 17:26:53.992639 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.992621    2579 scope.go:117] "RemoveContainer" containerID="cfe4d086dcea66df2d5c408ff758625126fd06e1ac9afcb31bdb1ffe12dbf783"
Jul 02 17:26:53.992917 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:26:53.992895    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfe4d086dcea66df2d5c408ff758625126fd06e1ac9afcb31bdb1ffe12dbf783\": container with ID starting with cfe4d086dcea66df2d5c408ff758625126fd06e1ac9afcb31bdb1ffe12dbf783 not found: ID does not exist" containerID="cfe4d086dcea66df2d5c408ff758625126fd06e1ac9afcb31bdb1ffe12dbf783"
Jul 02 17:26:53.993003 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:53.992925    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe4d086dcea66df2d5c408ff758625126fd06e1ac9afcb31bdb1ffe12dbf783"} err="failed to get container status \"cfe4d086dcea66df2d5c408ff758625126fd06e1ac9afcb31bdb1ffe12dbf783\": rpc error: code = NotFound desc = could not find container \"cfe4d086dcea66df2d5c408ff758625126fd06e1ac9afcb31bdb1ffe12dbf783\": container with ID starting with cfe4d086dcea66df2d5c408ff758625126fd06e1ac9afcb31bdb1ffe12dbf783 not found: ID does not exist"
Jul 02 17:26:54.002410 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:54.002382    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"]
Jul 02 17:26:54.006483 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:54.006451    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-3245e5b9/e2e-lifecycle-model-3245e5b9-kserve-6b5b765d9f-8rv7h"]
Jul 02 17:26:55.721016 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:26:55.720966    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f67d169b-b758-4807-9d31-a8b1e26cab7c" path="/var/lib/kubelet/pods/f67d169b-b758-4807-9d31-a8b1e26cab7c/volumes"
Jul 02 17:27:14.325295 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:14.325204    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:15.417210 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:15.417165    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:18.198342 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:18.198300    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:18.299294 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:18.299248    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:20.877380 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:20.877346    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:20.978464 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:20.978426    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:21.176112 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:21.175979    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:21.445340 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:21.445241    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:22.583821 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:22.583777    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:22.682728 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:22.682685    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:22.809153 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:22.809116    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:23.629906 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:23.629862    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:23.715726 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:23.715690    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:23.823285 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:23.823243    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:25.361882 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:25.361849    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:31.046744 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:31.046707    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:31.114881 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:31.114843    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:31.724699 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:31.724666    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:37.551999 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:37.551962    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:37.663174 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:37.663135    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:37.758758 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:37.758721    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:48.295583 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:48.295542    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:48.626748 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:27:48.626714    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:09.587868 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:09.587828    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:15.215927 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:15.215881    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:15.310055 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:15.310011    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:15.564779 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:15.564669    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:15.886736 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:15.886700    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:15.975511 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:15.975477    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:18.897682 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:18.897631    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:18.981258 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:18.981229    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:19.042413 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:19.042373    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:19.142884 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:19.142847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:19.462352 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:19.462317    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:19.563877 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:19.563841    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:23.396321 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:23.396288    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:23.746001 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:23.745904    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:24.052314 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:24.052227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:24.164594 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:24.164561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:26.959141 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:26.959078    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:27.059521 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:27.059474    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:27.191203 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:27.191157    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:27.332596 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:27.332501    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:27.623332 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:27.623297    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:27.736898 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:27.736855    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:31.447606 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:31.447574    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:41.126442 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:41.126337    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:42.333546 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:42.333510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:49.177947 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:49.177861    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:49.278742 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:49.278701    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:53.165217 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.165181    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"]
Jul 02 17:28:53.165784 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.165706    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f67d169b-b758-4807-9d31-a8b1e26cab7c" containerName="main"
Jul 02 17:28:53.165784 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.165727    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f67d169b-b758-4807-9d31-a8b1e26cab7c" containerName="main"
Jul 02 17:28:53.165907 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.165817    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f67d169b-b758-4807-9d31-a8b1e26cab7c" containerName="main"
Jul 02 17:28:53.168890 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.168866    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.172231 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.172198    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-bb1d81\"/\"test-model-bb1d81-kserve-self-signed-certs\""
Jul 02 17:28:53.172365 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.172239    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-bb1d81\"/\"openshift-service-ca.crt\""
Jul 02 17:28:53.172365 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.172243    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-bb1d81\"/\"kube-root-ca.crt\""
Jul 02 17:28:53.172365 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.172253    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-bb1d81\"/\"default-dockercfg-kb6fl\""
Jul 02 17:28:53.182468 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.181233    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"]
Jul 02 17:28:53.182468 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.182476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38818744-6413-4eee-84f8-123a4f24a1b2-tls-certs\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.182825 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.182580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-home\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.182825 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.182637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-tmp-dir\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.183318 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.183291    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-dshm\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.183503 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.183483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-model-cache\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.183636 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.183622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r9c4\" (UniqueName: \"kubernetes.io/projected/38818744-6413-4eee-84f8-123a4f24a1b2-kube-api-access-9r9c4\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.191539 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.191512    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:53.284906 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.284869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-tmp-dir\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.285144 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.284917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-dshm\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.285144 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.284934    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-model-cache\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.285144 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.284956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r9c4\" (UniqueName: \"kubernetes.io/projected/38818744-6413-4eee-84f8-123a4f24a1b2-kube-api-access-9r9c4\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.285144 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.284984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38818744-6413-4eee-84f8-123a4f24a1b2-tls-certs\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.285144 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.285031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-home\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.285412 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.285376    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-tmp-dir\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.285412 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.285387    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-model-cache\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.285509 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.285439    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-home\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.287326 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.287302    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-dshm\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.287599 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.287578    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38818744-6413-4eee-84f8-123a4f24a1b2-tls-certs\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.293532 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.293510    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r9c4\" (UniqueName: \"kubernetes.io/projected/38818744-6413-4eee-84f8-123a4f24a1b2-kube-api-access-9r9c4\") pod \"test-model-bb1d81-kserve-54ccd95545-mkdq7\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") " pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.483391 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.483301    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:28:53.622417 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:53.622388    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"]
Jul 02 17:28:53.623884 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:28:53.623855    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38818744_6413_4eee_84f8_123a4f24a1b2.slice/crio-96fb2decccc1fb357623e0ea45790c3e0bab5e4bbace2871581d592cad2ed082 WatchSource:0}: Error finding container 96fb2decccc1fb357623e0ea45790c3e0bab5e4bbace2871581d592cad2ed082: Status 404 returned error can't find the container with id 96fb2decccc1fb357623e0ea45790c3e0bab5e4bbace2871581d592cad2ed082
Jul 02 17:28:54.622638 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:54.622598    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7" event={"ID":"38818744-6413-4eee-84f8-123a4f24a1b2","Type":"ContainerStarted","Data":"bc8ce0babf1f7eeb1e8f41b6b31ffbea34e533dd4499f587f1b01abe4aa82090"}
Jul 02 17:28:54.623028 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:54.622649    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7" event={"ID":"38818744-6413-4eee-84f8-123a4f24a1b2","Type":"ContainerStarted","Data":"96fb2decccc1fb357623e0ea45790c3e0bab5e4bbace2871581d592cad2ed082"}
Jul 02 17:28:54.639819 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:28:54.639765    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7" podStartSLOduration=1.639751331 podStartE2EDuration="1.639751331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:28:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:28:54.63740291 +0000 UTC m=+2074.004068872" watchObservedRunningTime="2026-07-02 17:28:54.639751331 +0000 UTC m=+2074.006417317"
Jul 02 17:29:03.483872 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:03.483832    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:29:03.483872 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:03.483879    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:29:03.497368 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:03.497339    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:29:03.682789 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:03.682753    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:29:12.154319 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:12.154280    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:13.021284 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:13.021241    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:13.072975 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:13.072945    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:21.890058 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:21.889950    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:29:21.903225 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:21.899172    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:29:45.072013 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.071957    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"]
Jul 02 17:29:45.075752 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.075727    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.078158 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.078130    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-50b097\"/\"kube-root-ca.crt\""
Jul 02 17:29:45.079056 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.079025    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-50b097\"/\"openshift-service-ca.crt\""
Jul 02 17:29:45.079201 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.079083    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-50b097\"/\"test-model-50b097-kserve-self-signed-certs\""
Jul 02 17:29:45.079201 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.079158    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-50b097\"/\"default-dockercfg-8ws8h\""
Jul 02 17:29:45.084776 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.084752    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"]
Jul 02 17:29:45.104131 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.104099    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:45.155993 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.155959    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-tmp-dir\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.155993 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.155995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s7ff\" (UniqueName: \"kubernetes.io/projected/07e08983-f43e-48a6-8008-5a9ce5c67109-kube-api-access-7s7ff\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.156239 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.156035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-model-cache\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.156239 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.156105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e08983-f43e-48a6-8008-5a9ce5c67109-tls-certs\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.156239 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.156142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-home\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.156239 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.156202    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-dshm\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.257325 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.257289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-tmp-dir\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.257325 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.257330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s7ff\" (UniqueName: \"kubernetes.io/projected/07e08983-f43e-48a6-8008-5a9ce5c67109-kube-api-access-7s7ff\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.257565 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.257372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-model-cache\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.257565 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.257388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e08983-f43e-48a6-8008-5a9ce5c67109-tls-certs\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.257565 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.257408    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-home\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.257565 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.257469    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-dshm\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.257800 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.257769    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-tmp-dir\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.257864 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.257782    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-model-cache\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.257864 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.257846    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-home\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.259735 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.259704    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-dshm\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.259862 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.259843    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e08983-f43e-48a6-8008-5a9ce5c67109-tls-certs\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.265581 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.265564    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s7ff\" (UniqueName: \"kubernetes.io/projected/07e08983-f43e-48a6-8008-5a9ce5c67109-kube-api-access-7s7ff\") pod \"test-model-50b097-kserve-55647b5f75-mwmrd\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") " pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.386813 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.386773    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:45.524009 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.523981    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"]
Jul 02 17:29:45.526514 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:29:45.526488    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07e08983_f43e_48a6_8008_5a9ce5c67109.slice/crio-39352c1061c3a0c6efcc641f331810722800769fd5bda202b68af8672d8eedc1 WatchSource:0}: Error finding container 39352c1061c3a0c6efcc641f331810722800769fd5bda202b68af8672d8eedc1: Status 404 returned error can't find the container with id 39352c1061c3a0c6efcc641f331810722800769fd5bda202b68af8672d8eedc1
Jul 02 17:29:45.884867 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.884833    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd" event={"ID":"07e08983-f43e-48a6-8008-5a9ce5c67109","Type":"ContainerStarted","Data":"82d4ad993508928d81085fe16068ca257e748cf36d023be89ea5529bbf805838"}
Jul 02 17:29:45.885068 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.884882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd" event={"ID":"07e08983-f43e-48a6-8008-5a9ce5c67109","Type":"ContainerStarted","Data":"39352c1061c3a0c6efcc641f331810722800769fd5bda202b68af8672d8eedc1"}
Jul 02 17:29:45.903500 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:45.903441    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd" podStartSLOduration=0.903427715 podStartE2EDuration="903.427715ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:29:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:29:45.901252866 +0000 UTC m=+2125.267918830" watchObservedRunningTime="2026-07-02 17:29:45.903427715 +0000 UTC m=+2125.270093676"
Jul 02 17:29:55.387733 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:55.387687    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:55.388312 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:55.387750    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:55.400328 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:55.400296    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:55.945744 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:55.945714    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:29:58.812637 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:29:58.812557    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:11.049863 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:11.049831    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"]
Jul 02 17:30:11.070661 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:11.070623    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:12.042571 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:12.042534    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"]
Jul 02 17:30:12.064251 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:12.064218    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:12.393455 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:12.393422    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:12.763198 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:12.763109    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:12.861612 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:12.861580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:12.963969 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:12.963935    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:13.042782 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:13.042700    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:17.839464 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:17.839422    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:19.044909 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:19.044858    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:26.072167 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.072080    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7" podUID="38818744-6413-4eee-84f8-123a4f24a1b2" containerName="main" containerID="cri-o://bc8ce0babf1f7eeb1e8f41b6b31ffbea34e533dd4499f587f1b01abe4aa82090" gracePeriod=45
Jul 02 17:30:26.322340 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.322269    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:30:26.435218 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.435180    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-tmp-dir\") pod \"38818744-6413-4eee-84f8-123a4f24a1b2\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") "
Jul 02 17:30:26.435411 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.435231    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-dshm\") pod \"38818744-6413-4eee-84f8-123a4f24a1b2\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") "
Jul 02 17:30:26.435411 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.435279    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-model-cache\") pod \"38818744-6413-4eee-84f8-123a4f24a1b2\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") "
Jul 02 17:30:26.435411 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.435313    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-home\") pod \"38818744-6413-4eee-84f8-123a4f24a1b2\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") "
Jul 02 17:30:26.435411 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.435346    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9r9c4\" (UniqueName: \"kubernetes.io/projected/38818744-6413-4eee-84f8-123a4f24a1b2-kube-api-access-9r9c4\") pod \"38818744-6413-4eee-84f8-123a4f24a1b2\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") "
Jul 02 17:30:26.435411 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.435397    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38818744-6413-4eee-84f8-123a4f24a1b2-tls-certs\") pod \"38818744-6413-4eee-84f8-123a4f24a1b2\" (UID: \"38818744-6413-4eee-84f8-123a4f24a1b2\") "
Jul 02 17:30:26.435698 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.435454    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "38818744-6413-4eee-84f8-123a4f24a1b2" (UID: "38818744-6413-4eee-84f8-123a4f24a1b2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:30:26.435698 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.435613    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-model-cache" (OuterVolumeSpecName: "model-cache") pod "38818744-6413-4eee-84f8-123a4f24a1b2" (UID: "38818744-6413-4eee-84f8-123a4f24a1b2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:30:26.435698 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.435619    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-home" (OuterVolumeSpecName: "home") pod "38818744-6413-4eee-84f8-123a4f24a1b2" (UID: "38818744-6413-4eee-84f8-123a4f24a1b2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:30:26.435698 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.435673    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:30:26.437744 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.437719    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38818744-6413-4eee-84f8-123a4f24a1b2-kube-api-access-9r9c4" (OuterVolumeSpecName: "kube-api-access-9r9c4") pod "38818744-6413-4eee-84f8-123a4f24a1b2" (UID: "38818744-6413-4eee-84f8-123a4f24a1b2"). InnerVolumeSpecName "kube-api-access-9r9c4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:30:26.437822 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.437742    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38818744-6413-4eee-84f8-123a4f24a1b2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "38818744-6413-4eee-84f8-123a4f24a1b2" (UID: "38818744-6413-4eee-84f8-123a4f24a1b2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:30:26.437822 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.437786    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-dshm" (OuterVolumeSpecName: "dshm") pod "38818744-6413-4eee-84f8-123a4f24a1b2" (UID: "38818744-6413-4eee-84f8-123a4f24a1b2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:30:26.536311 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.536272    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38818744-6413-4eee-84f8-123a4f24a1b2-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:30:26.536311 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.536304    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:30:26.536311 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.536312    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:30:26.536311 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.536321    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38818744-6413-4eee-84f8-123a4f24a1b2-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:30:26.536576 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:26.536330    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r9c4\" (UniqueName: \"kubernetes.io/projected/38818744-6413-4eee-84f8-123a4f24a1b2-kube-api-access-9r9c4\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:30:27.063635 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.063571    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd" podUID="07e08983-f43e-48a6-8008-5a9ce5c67109" containerName="main" containerID="cri-o://82d4ad993508928d81085fe16068ca257e748cf36d023be89ea5529bbf805838" gracePeriod=45
Jul 02 17:30:27.104714 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.104683    2579 generic.go:356] "Generic (PLEG): container finished" podID="38818744-6413-4eee-84f8-123a4f24a1b2" containerID="bc8ce0babf1f7eeb1e8f41b6b31ffbea34e533dd4499f587f1b01abe4aa82090" exitCode=0
Jul 02 17:30:27.105099 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.104744    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"
Jul 02 17:30:27.105099 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.104787    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7" event={"ID":"38818744-6413-4eee-84f8-123a4f24a1b2","Type":"ContainerDied","Data":"bc8ce0babf1f7eeb1e8f41b6b31ffbea34e533dd4499f587f1b01abe4aa82090"}
Jul 02 17:30:27.105099 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.104834    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7" event={"ID":"38818744-6413-4eee-84f8-123a4f24a1b2","Type":"ContainerDied","Data":"96fb2decccc1fb357623e0ea45790c3e0bab5e4bbace2871581d592cad2ed082"}
Jul 02 17:30:27.105099 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.104852    2579 scope.go:117] "RemoveContainer" containerID="bc8ce0babf1f7eeb1e8f41b6b31ffbea34e533dd4499f587f1b01abe4aa82090"
Jul 02 17:30:27.155265 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.155238    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"]
Jul 02 17:30:27.161974 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.161948    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-bb1d81/test-model-bb1d81-kserve-54ccd95545-mkdq7"]
Jul 02 17:30:27.175188 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.175162    2579 scope.go:117] "RemoveContainer" containerID="bc8ce0babf1f7eeb1e8f41b6b31ffbea34e533dd4499f587f1b01abe4aa82090"
Jul 02 17:30:27.175553 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:30:27.175526    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc8ce0babf1f7eeb1e8f41b6b31ffbea34e533dd4499f587f1b01abe4aa82090\": container with ID starting with bc8ce0babf1f7eeb1e8f41b6b31ffbea34e533dd4499f587f1b01abe4aa82090 not found: ID does not exist" containerID="bc8ce0babf1f7eeb1e8f41b6b31ffbea34e533dd4499f587f1b01abe4aa82090"
Jul 02 17:30:27.175637 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.175562    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8ce0babf1f7eeb1e8f41b6b31ffbea34e533dd4499f587f1b01abe4aa82090"} err="failed to get container status \"bc8ce0babf1f7eeb1e8f41b6b31ffbea34e533dd4499f587f1b01abe4aa82090\": rpc error: code = NotFound desc = could not find container \"bc8ce0babf1f7eeb1e8f41b6b31ffbea34e533dd4499f587f1b01abe4aa82090\": container with ID starting with bc8ce0babf1f7eeb1e8f41b6b31ffbea34e533dd4499f587f1b01abe4aa82090 not found: ID does not exist"
Jul 02 17:30:27.320042 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.319972    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:30:27.343318 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.343287    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-home\") pod \"07e08983-f43e-48a6-8008-5a9ce5c67109\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") "
Jul 02 17:30:27.343505 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.343330    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-model-cache\") pod \"07e08983-f43e-48a6-8008-5a9ce5c67109\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") "
Jul 02 17:30:27.343505 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.343377    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s7ff\" (UniqueName: \"kubernetes.io/projected/07e08983-f43e-48a6-8008-5a9ce5c67109-kube-api-access-7s7ff\") pod \"07e08983-f43e-48a6-8008-5a9ce5c67109\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") "
Jul 02 17:30:27.343505 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.343400    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e08983-f43e-48a6-8008-5a9ce5c67109-tls-certs\") pod \"07e08983-f43e-48a6-8008-5a9ce5c67109\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") "
Jul 02 17:30:27.343505 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.343439    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-dshm\") pod \"07e08983-f43e-48a6-8008-5a9ce5c67109\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") "
Jul 02 17:30:27.343505 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.343475    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-tmp-dir\") pod \"07e08983-f43e-48a6-8008-5a9ce5c67109\" (UID: \"07e08983-f43e-48a6-8008-5a9ce5c67109\") "
Jul 02 17:30:27.343789 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.343591    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-home" (OuterVolumeSpecName: "home") pod "07e08983-f43e-48a6-8008-5a9ce5c67109" (UID: "07e08983-f43e-48a6-8008-5a9ce5c67109"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:30:27.343789 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.343653    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-model-cache" (OuterVolumeSpecName: "model-cache") pod "07e08983-f43e-48a6-8008-5a9ce5c67109" (UID: "07e08983-f43e-48a6-8008-5a9ce5c67109"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:30:27.343898 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.343802    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "07e08983-f43e-48a6-8008-5a9ce5c67109" (UID: "07e08983-f43e-48a6-8008-5a9ce5c67109"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:30:27.343898 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.343826    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:30:27.343898 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.343845    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:30:27.345808 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.345785    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-dshm" (OuterVolumeSpecName: "dshm") pod "07e08983-f43e-48a6-8008-5a9ce5c67109" (UID: "07e08983-f43e-48a6-8008-5a9ce5c67109"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:30:27.345808 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.345792    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e08983-f43e-48a6-8008-5a9ce5c67109-kube-api-access-7s7ff" (OuterVolumeSpecName: "kube-api-access-7s7ff") pod "07e08983-f43e-48a6-8008-5a9ce5c67109" (UID: "07e08983-f43e-48a6-8008-5a9ce5c67109"). InnerVolumeSpecName "kube-api-access-7s7ff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:30:27.346193 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.346169    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e08983-f43e-48a6-8008-5a9ce5c67109-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "07e08983-f43e-48a6-8008-5a9ce5c67109" (UID: "07e08983-f43e-48a6-8008-5a9ce5c67109"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:30:27.444352 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.444301    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:30:27.444352 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.444344    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e08983-f43e-48a6-8008-5a9ce5c67109-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:30:27.444352 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.444355    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s7ff\" (UniqueName: \"kubernetes.io/projected/07e08983-f43e-48a6-8008-5a9ce5c67109-kube-api-access-7s7ff\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:30:27.444352 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.444364    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e08983-f43e-48a6-8008-5a9ce5c67109-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:30:27.721373 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:27.721339    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38818744-6413-4eee-84f8-123a4f24a1b2" path="/var/lib/kubelet/pods/38818744-6413-4eee-84f8-123a4f24a1b2/volumes"
Jul 02 17:30:28.111051 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:28.111019    2579 generic.go:356] "Generic (PLEG): container finished" podID="07e08983-f43e-48a6-8008-5a9ce5c67109" containerID="82d4ad993508928d81085fe16068ca257e748cf36d023be89ea5529bbf805838" exitCode=0
Jul 02 17:30:28.111549 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:28.111061    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"
Jul 02 17:30:28.111549 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:28.111118    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd" event={"ID":"07e08983-f43e-48a6-8008-5a9ce5c67109","Type":"ContainerDied","Data":"82d4ad993508928d81085fe16068ca257e748cf36d023be89ea5529bbf805838"}
Jul 02 17:30:28.111549 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:28.111160    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd" event={"ID":"07e08983-f43e-48a6-8008-5a9ce5c67109","Type":"ContainerDied","Data":"39352c1061c3a0c6efcc641f331810722800769fd5bda202b68af8672d8eedc1"}
Jul 02 17:30:28.111549 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:28.111179    2579 scope.go:117] "RemoveContainer" containerID="82d4ad993508928d81085fe16068ca257e748cf36d023be89ea5529bbf805838"
Jul 02 17:30:28.120235 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:28.120218    2579 scope.go:117] "RemoveContainer" containerID="82d4ad993508928d81085fe16068ca257e748cf36d023be89ea5529bbf805838"
Jul 02 17:30:28.120528 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:30:28.120508    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82d4ad993508928d81085fe16068ca257e748cf36d023be89ea5529bbf805838\": container with ID starting with 82d4ad993508928d81085fe16068ca257e748cf36d023be89ea5529bbf805838 not found: ID does not exist" containerID="82d4ad993508928d81085fe16068ca257e748cf36d023be89ea5529bbf805838"
Jul 02 17:30:28.120571 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:28.120537    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82d4ad993508928d81085fe16068ca257e748cf36d023be89ea5529bbf805838"} err="failed to get container status \"82d4ad993508928d81085fe16068ca257e748cf36d023be89ea5529bbf805838\": rpc error: code = NotFound desc = could not find container \"82d4ad993508928d81085fe16068ca257e748cf36d023be89ea5529bbf805838\": container with ID starting with 82d4ad993508928d81085fe16068ca257e748cf36d023be89ea5529bbf805838 not found: ID does not exist"
Jul 02 17:30:28.127489 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:28.127459    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"]
Jul 02 17:30:28.133432 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:28.133407    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-50b097/test-model-50b097-kserve-55647b5f75-mwmrd"]
Jul 02 17:30:29.721695 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:29.721660    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e08983-f43e-48a6-8008-5a9ce5c67109" path="/var/lib/kubelet/pods/07e08983-f43e-48a6-8008-5a9ce5c67109/volumes"
Jul 02 17:30:39.903638 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:39.903593    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:54.513866 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:54.513824    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:54.807023 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:54.806929    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:55.056137 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:55.056079    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:55.269074 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:55.269033    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:55.688157 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:55.688117    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:55.787816 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:55.787781    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:55.931158 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:30:55.931120    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:01.510728 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:01.510698    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:01.579099 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:01.579046    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:01.829982 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:01.829891    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:02.105517 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:02.105482    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:02.527956 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:02.527863    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:02.884039 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:02.883991    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:03.072582 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:03.072548    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:05.989714 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:05.989609    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:06.070899 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:06.070863    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:06.136690 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:06.136658    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:06.488123 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:06.488064    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:06.588578 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:06.588544    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:06.689532 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:06.689493    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:10.735977 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:10.735935    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:11.477162 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:11.477122    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:11.860232 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:11.860192    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:12.133761 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:12.133663    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:15.178267 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:15.178231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:15.279996 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:15.279956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:15.418172 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:15.418134    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:15.514356 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:15.514259    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:15.833606 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:15.833528    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:15.934742 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:15.934705    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:20.196947 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:20.196907    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:23.548069 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:23.548033    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:23.652732 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:23.652691    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:28.254544 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:28.254511    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:28.354676 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:28.354632    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:28.454729 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:28.454689    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:28.514602 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:28.514514    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:28.805935 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:28.805847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:34.765136 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:34.765074    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:34.866279 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:34.866242    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:35.026082 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:35.025998    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:35.242291 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:35.242252    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:35.418351 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:35.418317    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:35.822405 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:35.822318    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:35.964897 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:35.964859    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:36.067080 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:36.067040    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:36.205305 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:36.205270    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:41.580762 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:41.580724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:41.681423 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:41.681387    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:41.838825 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:41.838786    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:42.076512 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:42.076479    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:42.439777 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:42.439737    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:42.736657 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:42.736570    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:42.866300 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:42.866260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:46.041671 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:46.041584    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:46.109784 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:46.109748    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:46.177193 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:46.177156    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:46.436650 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:46.436613    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:46.605372 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:46.605341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:46.708361 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:46.708261    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:50.543571 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:50.543531    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:50.866010 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:50.865966    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:51.195979 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:51.195890    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:51.451281 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:51.451193    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:54.093672 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:54.093630    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:54.196363 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:54.196323    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:54.311352 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:54.311309    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:54.592754 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:54.592727    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:54.841592 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:54.841555    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:54.940941 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:54.940847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:58.587042 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:31:58.587007    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:32:08.120950 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:08.120909    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:32:08.196752 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:08.196714    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:32:12.768835 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.768799    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"]
Jul 02 17:32:12.769389 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.769178    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38818744-6413-4eee-84f8-123a4f24a1b2" containerName="main"
Jul 02 17:32:12.769389 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.769190    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="38818744-6413-4eee-84f8-123a4f24a1b2" containerName="main"
Jul 02 17:32:12.769389 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.769204    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e08983-f43e-48a6-8008-5a9ce5c67109" containerName="main"
Jul 02 17:32:12.769389 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.769210    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e08983-f43e-48a6-8008-5a9ce5c67109" containerName="main"
Jul 02 17:32:12.769389 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.769265    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e08983-f43e-48a6-8008-5a9ce5c67109" containerName="main"
Jul 02 17:32:12.769389 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.769276    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="38818744-6413-4eee-84f8-123a4f24a1b2" containerName="main"
Jul 02 17:32:12.772361 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.772344    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.775678 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.775653    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a0a2ac\"/\"openshift-service-ca.crt\""
Jul 02 17:32:12.775831 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.775696    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a0a2ac\"/\"kube-root-ca.crt\""
Jul 02 17:32:12.775831 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.775699    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a0a2ac\"/\"default-dockercfg-sxsf6\""
Jul 02 17:32:12.775959 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.775919    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a0a2ac\"/\"auth-test-model-a0a2ac-kserve-self-signed-certs\""
Jul 02 17:32:12.781943 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.781915    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"]
Jul 02 17:32:12.788568 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.788540    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:32:12.887532 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.887490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd76190c-8129-4b14-b9a9-626d6b9506e1-tls-certs\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.887718 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.887552    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-dshm\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.887718 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.887613    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-tmp-dir\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.887718 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.887669    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-model-cache\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.887718 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.887700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94n6f\" (UniqueName: \"kubernetes.io/projected/fd76190c-8129-4b14-b9a9-626d6b9506e1-kube-api-access-94n6f\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.887861 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.887753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-home\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.988941 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.988897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-model-cache\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.989155 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.988957    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94n6f\" (UniqueName: \"kubernetes.io/projected/fd76190c-8129-4b14-b9a9-626d6b9506e1-kube-api-access-94n6f\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.989155 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.988989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-home\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.989155 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.989054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd76190c-8129-4b14-b9a9-626d6b9506e1-tls-certs\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.989155 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.989130    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-dshm\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.989377 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.989156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-tmp-dir\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.989449 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.989427    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-model-cache\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.989514 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.989480    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-home\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.989568 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.989489    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-tmp-dir\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.991400 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.991374    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-dshm\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.991638 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.991621    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd76190c-8129-4b14-b9a9-626d6b9506e1-tls-certs\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:12.995908 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:12.995888    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94n6f\" (UniqueName: \"kubernetes.io/projected/fd76190c-8129-4b14-b9a9-626d6b9506e1-kube-api-access-94n6f\") pod \"auth-test-model-a0a2ac-kserve-68975459bc-88xst\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") " pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:13.083439 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:13.083340    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:13.217522 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:13.217494    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"]
Jul 02 17:32:13.220197 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:32:13.220159    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd76190c_8129_4b14_b9a9_626d6b9506e1.slice/crio-d051adebd5bfaad8e9cc29ac15ec92abd2ad563b1fdd9b4266dc4839ec1283e1 WatchSource:0}: Error finding container d051adebd5bfaad8e9cc29ac15ec92abd2ad563b1fdd9b4266dc4839ec1283e1: Status 404 returned error can't find the container with id d051adebd5bfaad8e9cc29ac15ec92abd2ad563b1fdd9b4266dc4839ec1283e1
Jul 02 17:32:13.645826 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:13.645791    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst" event={"ID":"fd76190c-8129-4b14-b9a9-626d6b9506e1","Type":"ContainerStarted","Data":"33d1d3e27483c63a0e3a4f5f4119e6509c55582178912f7721aab62d1cf04ff3"}
Jul 02 17:32:13.645826 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:13.645836    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst" event={"ID":"fd76190c-8129-4b14-b9a9-626d6b9506e1","Type":"ContainerStarted","Data":"d051adebd5bfaad8e9cc29ac15ec92abd2ad563b1fdd9b4266dc4839ec1283e1"}
Jul 02 17:32:13.662595 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:13.662551    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst" podStartSLOduration=1.662535717 podStartE2EDuration="1.662535717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:32:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:32:13.66161628 +0000 UTC m=+2273.028282259" watchObservedRunningTime="2026-07-02 17:32:13.662535717 +0000 UTC m=+2273.029201679"
Jul 02 17:32:16.354287 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:16.354251    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:32:16.456060 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:16.456013    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:32:23.083957 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:23.083918    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:23.084405 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:23.083975    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:23.096609 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:23.096582    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:23.710331 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:23.710302    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:32:33.661592 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.661557    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"]
Jul 02 17:32:33.665042 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.665021    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.668302 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.668274    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4421aa\"/\"kube-root-ca.crt\""
Jul 02 17:32:33.668448 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.668303    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4421aa\"/\"openshift-service-ca.crt\""
Jul 02 17:32:33.668448 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.668304    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4421aa\"/\"auth-test-model-4421aa-kserve-self-signed-certs\""
Jul 02 17:32:33.668448 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.668274    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4421aa\"/\"default-dockercfg-k49mj\""
Jul 02 17:32:33.677166 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.677137    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"]
Jul 02 17:32:33.690267 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.690241    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:32:33.781184 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.781144    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-tmp-dir\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.781378 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.781212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-dshm\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.781378 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.781230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-model-cache\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.781378 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.781266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99f09800-7a52-4db6-92f7-5c6edb7c356e-tls-certs\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.781378 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.781287    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm6j2\" (UniqueName: \"kubernetes.io/projected/99f09800-7a52-4db6-92f7-5c6edb7c356e-kube-api-access-hm6j2\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.781378 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.781349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-home\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.882444 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.882410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-dshm\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.882623 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.882450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-model-cache\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.882623 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.882491    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99f09800-7a52-4db6-92f7-5c6edb7c356e-tls-certs\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.882623 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.882512    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm6j2\" (UniqueName: \"kubernetes.io/projected/99f09800-7a52-4db6-92f7-5c6edb7c356e-kube-api-access-hm6j2\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.882623 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.882556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-home\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.882854 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.882626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-tmp-dir\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.882973 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.882943    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-model-cache\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.883286 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.883248    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-home\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.883394 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.883281    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-tmp-dir\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.885308 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.885284    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-dshm\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.885576 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.885555    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99f09800-7a52-4db6-92f7-5c6edb7c356e-tls-certs\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.890841 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.890816    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm6j2\" (UniqueName: \"kubernetes.io/projected/99f09800-7a52-4db6-92f7-5c6edb7c356e-kube-api-access-hm6j2\") pod \"auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") " pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:33.976802 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:33.976694    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:34.117511 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:34.117449    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"]
Jul 02 17:32:34.119835 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:32:34.119803    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99f09800_7a52_4db6_92f7_5c6edb7c356e.slice/crio-236184575e135e50fef9ce243a5597f6095866d11917492f1fab33dfc70179c6 WatchSource:0}: Error finding container 236184575e135e50fef9ce243a5597f6095866d11917492f1fab33dfc70179c6: Status 404 returned error can't find the container with id 236184575e135e50fef9ce243a5597f6095866d11917492f1fab33dfc70179c6
Jul 02 17:32:34.757321 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:34.757287    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq" event={"ID":"99f09800-7a52-4db6-92f7-5c6edb7c356e","Type":"ContainerStarted","Data":"32f72579f08937bcaf91c559145ea7bec08d8073e724a9b86f260db69b446abd"}
Jul 02 17:32:34.757321 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:34.757330    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq" event={"ID":"99f09800-7a52-4db6-92f7-5c6edb7c356e","Type":"ContainerStarted","Data":"236184575e135e50fef9ce243a5597f6095866d11917492f1fab33dfc70179c6"}
Jul 02 17:32:34.773917 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:34.773865    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq" podStartSLOduration=1.773848933 podStartE2EDuration="1.773848933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:32:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:32:34.771726828 +0000 UTC m=+2294.138392791" watchObservedRunningTime="2026-07-02 17:32:34.773848933 +0000 UTC m=+2294.140514895"
Jul 02 17:32:43.977701 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:43.977664    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:43.978203 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:43.977719    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:43.990305 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:43.990280    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:44.827293 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:44.827256    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:32:45.522674 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:32:45.522640    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:34:20.004353 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:20.004320    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"]
Jul 02 17:34:20.066674 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:20.066636    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:34:20.980582 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:20.980548    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"]
Jul 02 17:34:21.391309 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:21.391266    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:34:21.927283 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:21.927174    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:34:21.936775 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:21.936752    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:34:35.024767 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.024697    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst" podUID="fd76190c-8129-4b14-b9a9-626d6b9506e1" containerName="main" containerID="cri-o://33d1d3e27483c63a0e3a4f5f4119e6509c55582178912f7721aab62d1cf04ff3" gracePeriod=45
Jul 02 17:34:35.278842 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.278777    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:34:35.393993 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.393961    2579 generic.go:356] "Generic (PLEG): container finished" podID="fd76190c-8129-4b14-b9a9-626d6b9506e1" containerID="33d1d3e27483c63a0e3a4f5f4119e6509c55582178912f7721aab62d1cf04ff3" exitCode=0
Jul 02 17:34:35.394185 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.394002    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"
Jul 02 17:34:35.394185 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.394041    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst" event={"ID":"fd76190c-8129-4b14-b9a9-626d6b9506e1","Type":"ContainerDied","Data":"33d1d3e27483c63a0e3a4f5f4119e6509c55582178912f7721aab62d1cf04ff3"}
Jul 02 17:34:35.394185 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.394083    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst" event={"ID":"fd76190c-8129-4b14-b9a9-626d6b9506e1","Type":"ContainerDied","Data":"d051adebd5bfaad8e9cc29ac15ec92abd2ad563b1fdd9b4266dc4839ec1283e1"}
Jul 02 17:34:35.394185 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.394112    2579 scope.go:117] "RemoveContainer" containerID="33d1d3e27483c63a0e3a4f5f4119e6509c55582178912f7721aab62d1cf04ff3"
Jul 02 17:34:35.402934 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.402918    2579 scope.go:117] "RemoveContainer" containerID="33d1d3e27483c63a0e3a4f5f4119e6509c55582178912f7721aab62d1cf04ff3"
Jul 02 17:34:35.403235 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:34:35.403207    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33d1d3e27483c63a0e3a4f5f4119e6509c55582178912f7721aab62d1cf04ff3\": container with ID starting with 33d1d3e27483c63a0e3a4f5f4119e6509c55582178912f7721aab62d1cf04ff3 not found: ID does not exist" containerID="33d1d3e27483c63a0e3a4f5f4119e6509c55582178912f7721aab62d1cf04ff3"
Jul 02 17:34:35.403339 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.403235    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d1d3e27483c63a0e3a4f5f4119e6509c55582178912f7721aab62d1cf04ff3"} err="failed to get container status \"33d1d3e27483c63a0e3a4f5f4119e6509c55582178912f7721aab62d1cf04ff3\": rpc error: code = NotFound desc = could not find container \"33d1d3e27483c63a0e3a4f5f4119e6509c55582178912f7721aab62d1cf04ff3\": container with ID starting with 33d1d3e27483c63a0e3a4f5f4119e6509c55582178912f7721aab62d1cf04ff3 not found: ID does not exist"
Jul 02 17:34:35.411547 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.411523    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-home\") pod \"fd76190c-8129-4b14-b9a9-626d6b9506e1\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") "
Jul 02 17:34:35.411658 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.411596    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd76190c-8129-4b14-b9a9-626d6b9506e1-tls-certs\") pod \"fd76190c-8129-4b14-b9a9-626d6b9506e1\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") "
Jul 02 17:34:35.411658 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.411614    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94n6f\" (UniqueName: \"kubernetes.io/projected/fd76190c-8129-4b14-b9a9-626d6b9506e1-kube-api-access-94n6f\") pod \"fd76190c-8129-4b14-b9a9-626d6b9506e1\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") "
Jul 02 17:34:35.411658 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.411644    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-tmp-dir\") pod \"fd76190c-8129-4b14-b9a9-626d6b9506e1\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") "
Jul 02 17:34:35.411825 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.411680    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-dshm\") pod \"fd76190c-8129-4b14-b9a9-626d6b9506e1\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") "
Jul 02 17:34:35.411825 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.411722    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-model-cache\") pod \"fd76190c-8129-4b14-b9a9-626d6b9506e1\" (UID: \"fd76190c-8129-4b14-b9a9-626d6b9506e1\") "
Jul 02 17:34:35.411926 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.411822    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-home" (OuterVolumeSpecName: "home") pod "fd76190c-8129-4b14-b9a9-626d6b9506e1" (UID: "fd76190c-8129-4b14-b9a9-626d6b9506e1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:34:35.411970 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.411922    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fd76190c-8129-4b14-b9a9-626d6b9506e1" (UID: "fd76190c-8129-4b14-b9a9-626d6b9506e1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:34:35.412051 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.412033    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-model-cache" (OuterVolumeSpecName: "model-cache") pod "fd76190c-8129-4b14-b9a9-626d6b9506e1" (UID: "fd76190c-8129-4b14-b9a9-626d6b9506e1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:34:35.412142 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.412124    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:34:35.412223 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.412147    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:34:35.413896 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.413864    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-dshm" (OuterVolumeSpecName: "dshm") pod "fd76190c-8129-4b14-b9a9-626d6b9506e1" (UID: "fd76190c-8129-4b14-b9a9-626d6b9506e1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:34:35.413988 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.413904    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd76190c-8129-4b14-b9a9-626d6b9506e1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fd76190c-8129-4b14-b9a9-626d6b9506e1" (UID: "fd76190c-8129-4b14-b9a9-626d6b9506e1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:34:35.413988 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.413944    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd76190c-8129-4b14-b9a9-626d6b9506e1-kube-api-access-94n6f" (OuterVolumeSpecName: "kube-api-access-94n6f") pod "fd76190c-8129-4b14-b9a9-626d6b9506e1" (UID: "fd76190c-8129-4b14-b9a9-626d6b9506e1"). InnerVolumeSpecName "kube-api-access-94n6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:34:35.449745 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.449712    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"]
Jul 02 17:34:35.450142 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.450125    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd76190c-8129-4b14-b9a9-626d6b9506e1" containerName="main"
Jul 02 17:34:35.450241 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.450143    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd76190c-8129-4b14-b9a9-626d6b9506e1" containerName="main"
Jul 02 17:34:35.450296 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.450261    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd76190c-8129-4b14-b9a9-626d6b9506e1" containerName="main"
Jul 02 17:34:35.454574 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.454554    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.456954 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.456934    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a0a2ac\"/\"sub-test-model-a0a2ac-kserve-self-signed-certs\""
Jul 02 17:34:35.463679 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.463655    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"]
Jul 02 17:34:35.473675 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.473648    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:34:35.513276 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.513245    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd76190c-8129-4b14-b9a9-626d6b9506e1-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:34:35.513276 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.513272    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94n6f\" (UniqueName: \"kubernetes.io/projected/fd76190c-8129-4b14-b9a9-626d6b9506e1-kube-api-access-94n6f\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:34:35.513276 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.513281    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:34:35.513496 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.513290    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd76190c-8129-4b14-b9a9-626d6b9506e1-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:34:35.613880 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.613845    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-model-cache\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.614059 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.613915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b38c4250-22d2-4ef7-abec-2fd06d55df22-tls-certs\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.614059 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.613941    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbq6d\" (UniqueName: \"kubernetes.io/projected/b38c4250-22d2-4ef7-abec-2fd06d55df22-kube-api-access-wbq6d\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.614059 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.613984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-home\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.614059 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.614044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-dshm\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.614242 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.614073    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-tmp-dir\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.714616 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.714575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-dshm\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.714778 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.714628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-tmp-dir\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.714778 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.714682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-model-cache\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.714778 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.714746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b38c4250-22d2-4ef7-abec-2fd06d55df22-tls-certs\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.714778 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.714771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbq6d\" (UniqueName: \"kubernetes.io/projected/b38c4250-22d2-4ef7-abec-2fd06d55df22-kube-api-access-wbq6d\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.715008 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.714973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-home\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.715114 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.715069    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-tmp-dir\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.715252 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.715131    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-model-cache\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.715342 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.715324    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-home\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.717204 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.717168    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-dshm\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.717650 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.717625    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b38c4250-22d2-4ef7-abec-2fd06d55df22-tls-certs\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.722512 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.722490    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"]
Jul 02 17:34:35.722512 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.722521    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a0a2ac/auth-test-model-a0a2ac-kserve-68975459bc-88xst"]
Jul 02 17:34:35.722707 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.722688    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbq6d\" (UniqueName: \"kubernetes.io/projected/b38c4250-22d2-4ef7-abec-2fd06d55df22-kube-api-access-wbq6d\") pod \"sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") " pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.767771 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.767735    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:35.905295 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:35.905267    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"]
Jul 02 17:34:35.906759 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:34:35.906730    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb38c4250_22d2_4ef7_abec_2fd06d55df22.slice/crio-6872b79f110160fe8c4134fe0df0c4f8f752608a25bd06de42a943c5f3042653 WatchSource:0}: Error finding container 6872b79f110160fe8c4134fe0df0c4f8f752608a25bd06de42a943c5f3042653: Status 404 returned error can't find the container with id 6872b79f110160fe8c4134fe0df0c4f8f752608a25bd06de42a943c5f3042653
Jul 02 17:34:36.001697 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.001300    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq" podUID="99f09800-7a52-4db6-92f7-5c6edb7c356e" containerName="main" containerID="cri-o://32f72579f08937bcaf91c559145ea7bec08d8073e724a9b86f260db69b446abd" gracePeriod=45
Jul 02 17:34:36.252662 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.252637    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:34:36.401701 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.401662    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876" event={"ID":"b38c4250-22d2-4ef7-abec-2fd06d55df22","Type":"ContainerStarted","Data":"ce31ad0f28cf370f76af03b357d89d2fa8bed01082abc9d7371018fbcfc70549"}
Jul 02 17:34:36.401918 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.401714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876" event={"ID":"b38c4250-22d2-4ef7-abec-2fd06d55df22","Type":"ContainerStarted","Data":"6872b79f110160fe8c4134fe0df0c4f8f752608a25bd06de42a943c5f3042653"}
Jul 02 17:34:36.403616 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.403588    2579 generic.go:356] "Generic (PLEG): container finished" podID="99f09800-7a52-4db6-92f7-5c6edb7c356e" containerID="32f72579f08937bcaf91c559145ea7bec08d8073e724a9b86f260db69b446abd" exitCode=0
Jul 02 17:34:36.403727 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.403629    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"
Jul 02 17:34:36.403727 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.403671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq" event={"ID":"99f09800-7a52-4db6-92f7-5c6edb7c356e","Type":"ContainerDied","Data":"32f72579f08937bcaf91c559145ea7bec08d8073e724a9b86f260db69b446abd"}
Jul 02 17:34:36.403727 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.403706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq" event={"ID":"99f09800-7a52-4db6-92f7-5c6edb7c356e","Type":"ContainerDied","Data":"236184575e135e50fef9ce243a5597f6095866d11917492f1fab33dfc70179c6"}
Jul 02 17:34:36.403727 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.403724    2579 scope.go:117] "RemoveContainer" containerID="32f72579f08937bcaf91c559145ea7bec08d8073e724a9b86f260db69b446abd"
Jul 02 17:34:36.412416 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.412400    2579 scope.go:117] "RemoveContainer" containerID="32f72579f08937bcaf91c559145ea7bec08d8073e724a9b86f260db69b446abd"
Jul 02 17:34:36.412679 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:34:36.412659    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32f72579f08937bcaf91c559145ea7bec08d8073e724a9b86f260db69b446abd\": container with ID starting with 32f72579f08937bcaf91c559145ea7bec08d8073e724a9b86f260db69b446abd not found: ID does not exist" containerID="32f72579f08937bcaf91c559145ea7bec08d8073e724a9b86f260db69b446abd"
Jul 02 17:34:36.412761 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.412696    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32f72579f08937bcaf91c559145ea7bec08d8073e724a9b86f260db69b446abd"} err="failed to get container status \"32f72579f08937bcaf91c559145ea7bec08d8073e724a9b86f260db69b446abd\": rpc error: code = NotFound desc = could not find container \"32f72579f08937bcaf91c559145ea7bec08d8073e724a9b86f260db69b446abd\": container with ID starting with 32f72579f08937bcaf91c559145ea7bec08d8073e724a9b86f260db69b446abd not found: ID does not exist"
Jul 02 17:34:36.420911 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.420851    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm6j2\" (UniqueName: \"kubernetes.io/projected/99f09800-7a52-4db6-92f7-5c6edb7c356e-kube-api-access-hm6j2\") pod \"99f09800-7a52-4db6-92f7-5c6edb7c356e\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") "
Jul 02 17:34:36.420911 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.420886    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99f09800-7a52-4db6-92f7-5c6edb7c356e-tls-certs\") pod \"99f09800-7a52-4db6-92f7-5c6edb7c356e\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") "
Jul 02 17:34:36.420911 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.420901    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-home\") pod \"99f09800-7a52-4db6-92f7-5c6edb7c356e\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") "
Jul 02 17:34:36.421135 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.420943    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-model-cache\") pod \"99f09800-7a52-4db6-92f7-5c6edb7c356e\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") "
Jul 02 17:34:36.421135 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.420969    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-tmp-dir\") pod \"99f09800-7a52-4db6-92f7-5c6edb7c356e\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") "
Jul 02 17:34:36.421135 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.420992    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-dshm\") pod \"99f09800-7a52-4db6-92f7-5c6edb7c356e\" (UID: \"99f09800-7a52-4db6-92f7-5c6edb7c356e\") "
Jul 02 17:34:36.421304 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.421191    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-home" (OuterVolumeSpecName: "home") pod "99f09800-7a52-4db6-92f7-5c6edb7c356e" (UID: "99f09800-7a52-4db6-92f7-5c6edb7c356e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:34:36.421304 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.421276    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-model-cache" (OuterVolumeSpecName: "model-cache") pod "99f09800-7a52-4db6-92f7-5c6edb7c356e" (UID: "99f09800-7a52-4db6-92f7-5c6edb7c356e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:34:36.421304 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.421294    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "99f09800-7a52-4db6-92f7-5c6edb7c356e" (UID: "99f09800-7a52-4db6-92f7-5c6edb7c356e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:34:36.421650 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.421318    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:34:36.423321 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.423295    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99f09800-7a52-4db6-92f7-5c6edb7c356e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "99f09800-7a52-4db6-92f7-5c6edb7c356e" (UID: "99f09800-7a52-4db6-92f7-5c6edb7c356e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:34:36.423321 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.423296    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-dshm" (OuterVolumeSpecName: "dshm") pod "99f09800-7a52-4db6-92f7-5c6edb7c356e" (UID: "99f09800-7a52-4db6-92f7-5c6edb7c356e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:34:36.423456 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.423417    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99f09800-7a52-4db6-92f7-5c6edb7c356e-kube-api-access-hm6j2" (OuterVolumeSpecName: "kube-api-access-hm6j2") pod "99f09800-7a52-4db6-92f7-5c6edb7c356e" (UID: "99f09800-7a52-4db6-92f7-5c6edb7c356e"). InnerVolumeSpecName "kube-api-access-hm6j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:34:36.522060 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.522032    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:34:36.522060 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.522058    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:34:36.522060 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.522066    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99f09800-7a52-4db6-92f7-5c6edb7c356e-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:34:36.522302 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.522074    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm6j2\" (UniqueName: \"kubernetes.io/projected/99f09800-7a52-4db6-92f7-5c6edb7c356e-kube-api-access-hm6j2\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:34:36.522302 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.522100    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99f09800-7a52-4db6-92f7-5c6edb7c356e-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:34:36.725249 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.725199    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876" podStartSLOduration=1.7251823640000001 podStartE2EDuration="1.725182364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:34:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:34:36.416896595 +0000 UTC m=+2415.783562557" watchObservedRunningTime="2026-07-02 17:34:36.725182364 +0000 UTC m=+2416.091848347"
Jul 02 17:34:36.726099 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.726069    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"]
Jul 02 17:34:36.730647 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:36.730616    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/auth-test-model-4421aa-kserve-bdf8d7f4c-ncvxq"]
Jul 02 17:34:37.720954 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:37.720920    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99f09800-7a52-4db6-92f7-5c6edb7c356e" path="/var/lib/kubelet/pods/99f09800-7a52-4db6-92f7-5c6edb7c356e/volumes"
Jul 02 17:34:37.721352 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:37.721325    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd76190c-8129-4b14-b9a9-626d6b9506e1" path="/var/lib/kubelet/pods/fd76190c-8129-4b14-b9a9-626d6b9506e1/volumes"
Jul 02 17:34:45.768387 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:45.768301    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:45.768387 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:45.768353    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:45.780952 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:45.780920    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:34:46.468356 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:34:46.468324    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:35:04.662510 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.662475    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"]
Jul 02 17:35:04.662938 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.662888    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99f09800-7a52-4db6-92f7-5c6edb7c356e" containerName="main"
Jul 02 17:35:04.662938 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.662906    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="99f09800-7a52-4db6-92f7-5c6edb7c356e" containerName="main"
Jul 02 17:35:04.663044 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.663029    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="99f09800-7a52-4db6-92f7-5c6edb7c356e" containerName="main"
Jul 02 17:35:04.665965 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.665949    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.669298 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.669269    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4421aa\"/\"kube-root-ca.crt\""
Jul 02 17:35:04.669440 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.669276    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4421aa\"/\"default-dockercfg-k49mj\""
Jul 02 17:35:04.669440 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.669330    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4421aa\"/\"openshift-service-ca.crt\""
Jul 02 17:35:04.669440 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.669307    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4421aa\"/\"sub-test-model-4421aa-kserve-self-signed-certs\""
Jul 02 17:35:04.675902 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.675871    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"]
Jul 02 17:35:04.762562 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.762525    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-model-cache\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.762562 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.762565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63edcc34-ed76-4299-b3c1-58adc2fd93ac-tls-certs\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.762778 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.762603    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-dshm\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.762778 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.762687    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-tmp-dir\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.762778 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.762721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzqvx\" (UniqueName: \"kubernetes.io/projected/63edcc34-ed76-4299-b3c1-58adc2fd93ac-kube-api-access-xzqvx\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.762931 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.762909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-home\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.767689 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.767659    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:35:04.863632 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.863591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-home\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.863846 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.863641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-model-cache\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.863846 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.863674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63edcc34-ed76-4299-b3c1-58adc2fd93ac-tls-certs\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.863846 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.863708    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-dshm\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.863846 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.863776    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-tmp-dir\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.863846 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.863822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqvx\" (UniqueName: \"kubernetes.io/projected/63edcc34-ed76-4299-b3c1-58adc2fd93ac-kube-api-access-xzqvx\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.864147 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.864062    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-home\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.864147 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.864074    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-model-cache\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.864255 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.864196    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-tmp-dir\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.866014 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.865991    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-dshm\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.866260 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.866241    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63edcc34-ed76-4299-b3c1-58adc2fd93ac-tls-certs\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.871512 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.871484    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzqvx\" (UniqueName: \"kubernetes.io/projected/63edcc34-ed76-4299-b3c1-58adc2fd93ac-kube-api-access-xzqvx\") pod \"sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") " pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:04.975612 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:04.975512    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:05.112785 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:05.112756    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"]
Jul 02 17:35:05.115517 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:35:05.115474    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63edcc34_ed76_4299_b3c1_58adc2fd93ac.slice/crio-f52ea2766767106e1f6bf54f58c7e95d1263c5cee060c6c308c0f62b935baf49 WatchSource:0}: Error finding container f52ea2766767106e1f6bf54f58c7e95d1263c5cee060c6c308c0f62b935baf49: Status 404 returned error can't find the container with id f52ea2766767106e1f6bf54f58c7e95d1263c5cee060c6c308c0f62b935baf49
Jul 02 17:35:05.567447 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:05.567406    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w" event={"ID":"63edcc34-ed76-4299-b3c1-58adc2fd93ac","Type":"ContainerStarted","Data":"572270a4efae967539b0acf2761180aa7f259524f39685d1b66539263a79b45f"}
Jul 02 17:35:05.567640 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:05.567455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w" event={"ID":"63edcc34-ed76-4299-b3c1-58adc2fd93ac","Type":"ContainerStarted","Data":"f52ea2766767106e1f6bf54f58c7e95d1263c5cee060c6c308c0f62b935baf49"}
Jul 02 17:35:05.585030 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:05.584960    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w" podStartSLOduration=1.584943348 podStartE2EDuration="1.584943348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:35:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:35:05.583427687 +0000 UTC m=+2444.950093662" watchObservedRunningTime="2026-07-02 17:35:05.584943348 +0000 UTC m=+2444.951609340"
Jul 02 17:35:14.976282 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:14.976226    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:14.976282 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:14.976288    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:14.988769 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:14.988736    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:15.630415 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:15.630379    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:35:47.841336 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:47.841290    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"]
Jul 02 17:35:47.860455 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:47.860413    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:35:48.666206 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:48.666172    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"]
Jul 02 17:35:48.677856 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:48.677825    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:35:58.673278 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:35:58.673237    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:36:02.862137 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:02.862047    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876" podUID="b38c4250-22d2-4ef7-abec-2fd06d55df22" containerName="main" containerID="cri-o://ce31ad0f28cf370f76af03b357d89d2fa8bed01082abc9d7371018fbcfc70549" gracePeriod=45
Jul 02 17:36:03.107349 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.107321    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:36:03.184238 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.184155    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-dshm\") pod \"b38c4250-22d2-4ef7-abec-2fd06d55df22\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") "
Jul 02 17:36:03.184238 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.184191    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-model-cache\") pod \"b38c4250-22d2-4ef7-abec-2fd06d55df22\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") "
Jul 02 17:36:03.184460 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.184277    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-home\") pod \"b38c4250-22d2-4ef7-abec-2fd06d55df22\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") "
Jul 02 17:36:03.184460 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.184312    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-tmp-dir\") pod \"b38c4250-22d2-4ef7-abec-2fd06d55df22\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") "
Jul 02 17:36:03.184460 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.184362    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b38c4250-22d2-4ef7-abec-2fd06d55df22-tls-certs\") pod \"b38c4250-22d2-4ef7-abec-2fd06d55df22\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") "
Jul 02 17:36:03.184460 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.184401    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbq6d\" (UniqueName: \"kubernetes.io/projected/b38c4250-22d2-4ef7-abec-2fd06d55df22-kube-api-access-wbq6d\") pod \"b38c4250-22d2-4ef7-abec-2fd06d55df22\" (UID: \"b38c4250-22d2-4ef7-abec-2fd06d55df22\") "
Jul 02 17:36:03.184681 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.184544    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-model-cache" (OuterVolumeSpecName: "model-cache") pod "b38c4250-22d2-4ef7-abec-2fd06d55df22" (UID: "b38c4250-22d2-4ef7-abec-2fd06d55df22"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:36:03.184681 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.184528    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-home" (OuterVolumeSpecName: "home") pod "b38c4250-22d2-4ef7-abec-2fd06d55df22" (UID: "b38c4250-22d2-4ef7-abec-2fd06d55df22"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:36:03.184681 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.184625    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b38c4250-22d2-4ef7-abec-2fd06d55df22" (UID: "b38c4250-22d2-4ef7-abec-2fd06d55df22"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:36:03.184826 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.184721    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:36:03.184826 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.184739    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:36:03.184826 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.184752    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:36:03.186420 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.186392    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-dshm" (OuterVolumeSpecName: "dshm") pod "b38c4250-22d2-4ef7-abec-2fd06d55df22" (UID: "b38c4250-22d2-4ef7-abec-2fd06d55df22"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:36:03.186572 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.186552    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b38c4250-22d2-4ef7-abec-2fd06d55df22-kube-api-access-wbq6d" (OuterVolumeSpecName: "kube-api-access-wbq6d") pod "b38c4250-22d2-4ef7-abec-2fd06d55df22" (UID: "b38c4250-22d2-4ef7-abec-2fd06d55df22"). InnerVolumeSpecName "kube-api-access-wbq6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:36:03.186626 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.186555    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b38c4250-22d2-4ef7-abec-2fd06d55df22-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b38c4250-22d2-4ef7-abec-2fd06d55df22" (UID: "b38c4250-22d2-4ef7-abec-2fd06d55df22"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:36:03.285971 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.285924    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b38c4250-22d2-4ef7-abec-2fd06d55df22-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:36:03.285971 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.285959    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbq6d\" (UniqueName: \"kubernetes.io/projected/b38c4250-22d2-4ef7-abec-2fd06d55df22-kube-api-access-wbq6d\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:36:03.285971 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.285974    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b38c4250-22d2-4ef7-abec-2fd06d55df22-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:36:03.686657 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.686614    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w" podUID="63edcc34-ed76-4299-b3c1-58adc2fd93ac" containerName="main" containerID="cri-o://572270a4efae967539b0acf2761180aa7f259524f39685d1b66539263a79b45f" gracePeriod=45
Jul 02 17:36:03.866542 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.866507    2579 generic.go:356] "Generic (PLEG): container finished" podID="b38c4250-22d2-4ef7-abec-2fd06d55df22" containerID="ce31ad0f28cf370f76af03b357d89d2fa8bed01082abc9d7371018fbcfc70549" exitCode=0
Jul 02 17:36:03.867053 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.866586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876" event={"ID":"b38c4250-22d2-4ef7-abec-2fd06d55df22","Type":"ContainerDied","Data":"ce31ad0f28cf370f76af03b357d89d2fa8bed01082abc9d7371018fbcfc70549"}
Jul 02 17:36:03.867053 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.866633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876" event={"ID":"b38c4250-22d2-4ef7-abec-2fd06d55df22","Type":"ContainerDied","Data":"6872b79f110160fe8c4134fe0df0c4f8f752608a25bd06de42a943c5f3042653"}
Jul 02 17:36:03.867053 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.866641    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"
Jul 02 17:36:03.867053 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.866657    2579 scope.go:117] "RemoveContainer" containerID="ce31ad0f28cf370f76af03b357d89d2fa8bed01082abc9d7371018fbcfc70549"
Jul 02 17:36:03.872027 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.869233    2579 generic.go:356] "Generic (PLEG): container finished" podID="63edcc34-ed76-4299-b3c1-58adc2fd93ac" containerID="572270a4efae967539b0acf2761180aa7f259524f39685d1b66539263a79b45f" exitCode=0
Jul 02 17:36:03.872027 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.869410    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w" event={"ID":"63edcc34-ed76-4299-b3c1-58adc2fd93ac","Type":"ContainerDied","Data":"572270a4efae967539b0acf2761180aa7f259524f39685d1b66539263a79b45f"}
Jul 02 17:36:03.884534 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.884504    2579 scope.go:117] "RemoveContainer" containerID="ce31ad0f28cf370f76af03b357d89d2fa8bed01082abc9d7371018fbcfc70549"
Jul 02 17:36:03.884876 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:36:03.884852    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce31ad0f28cf370f76af03b357d89d2fa8bed01082abc9d7371018fbcfc70549\": container with ID starting with ce31ad0f28cf370f76af03b357d89d2fa8bed01082abc9d7371018fbcfc70549 not found: ID does not exist" containerID="ce31ad0f28cf370f76af03b357d89d2fa8bed01082abc9d7371018fbcfc70549"
Jul 02 17:36:03.884979 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.884887    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce31ad0f28cf370f76af03b357d89d2fa8bed01082abc9d7371018fbcfc70549"} err="failed to get container status \"ce31ad0f28cf370f76af03b357d89d2fa8bed01082abc9d7371018fbcfc70549\": rpc error: code = NotFound desc = could not find container \"ce31ad0f28cf370f76af03b357d89d2fa8bed01082abc9d7371018fbcfc70549\": container with ID starting with ce31ad0f28cf370f76af03b357d89d2fa8bed01082abc9d7371018fbcfc70549 not found: ID does not exist"
Jul 02 17:36:03.892500 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.892469    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"]
Jul 02 17:36:03.897634 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.897606    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a0a2ac/sub-test-model-a0a2ac-kserve-6f5c86fbc-cr876"]
Jul 02 17:36:03.940055 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.939996    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:36:03.992875 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.992838    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63edcc34-ed76-4299-b3c1-58adc2fd93ac-tls-certs\") pod \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") "
Jul 02 17:36:03.993037 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.992888    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-model-cache\") pod \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") "
Jul 02 17:36:03.993037 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.992948    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzqvx\" (UniqueName: \"kubernetes.io/projected/63edcc34-ed76-4299-b3c1-58adc2fd93ac-kube-api-access-xzqvx\") pod \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") "
Jul 02 17:36:03.993037 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.993020    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-home\") pod \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") "
Jul 02 17:36:03.993222 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.993045    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-dshm\") pod \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") "
Jul 02 17:36:03.993222 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.993075    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-tmp-dir\") pod \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\" (UID: \"63edcc34-ed76-4299-b3c1-58adc2fd93ac\") "
Jul 02 17:36:03.993222 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.993179    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "63edcc34-ed76-4299-b3c1-58adc2fd93ac" (UID: "63edcc34-ed76-4299-b3c1-58adc2fd93ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:36:03.993381 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.993317    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "63edcc34-ed76-4299-b3c1-58adc2fd93ac" (UID: "63edcc34-ed76-4299-b3c1-58adc2fd93ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:36:03.993381 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.993339    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-home" (OuterVolumeSpecName: "home") pod "63edcc34-ed76-4299-b3c1-58adc2fd93ac" (UID: "63edcc34-ed76-4299-b3c1-58adc2fd93ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:36:03.993495 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.993421    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:36:03.993495 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.993436    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:36:03.993495 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.993444    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:36:03.995062 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.995033    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-dshm" (OuterVolumeSpecName: "dshm") pod "63edcc34-ed76-4299-b3c1-58adc2fd93ac" (UID: "63edcc34-ed76-4299-b3c1-58adc2fd93ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:36:03.995211 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.995168    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63edcc34-ed76-4299-b3c1-58adc2fd93ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "63edcc34-ed76-4299-b3c1-58adc2fd93ac" (UID: "63edcc34-ed76-4299-b3c1-58adc2fd93ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:36:03.995258 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:03.995216    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63edcc34-ed76-4299-b3c1-58adc2fd93ac-kube-api-access-xzqvx" (OuterVolumeSpecName: "kube-api-access-xzqvx") pod "63edcc34-ed76-4299-b3c1-58adc2fd93ac" (UID: "63edcc34-ed76-4299-b3c1-58adc2fd93ac"). InnerVolumeSpecName "kube-api-access-xzqvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:36:04.094597 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:04.094561    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63edcc34-ed76-4299-b3c1-58adc2fd93ac-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:36:04.094597 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:04.094591    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63edcc34-ed76-4299-b3c1-58adc2fd93ac-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:36:04.094597 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:04.094602    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzqvx\" (UniqueName: \"kubernetes.io/projected/63edcc34-ed76-4299-b3c1-58adc2fd93ac-kube-api-access-xzqvx\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:36:04.877071 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:04.877039    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"
Jul 02 17:36:04.877569 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:04.877044    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w" event={"ID":"63edcc34-ed76-4299-b3c1-58adc2fd93ac","Type":"ContainerDied","Data":"f52ea2766767106e1f6bf54f58c7e95d1263c5cee060c6c308c0f62b935baf49"}
Jul 02 17:36:04.877569 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:04.877152    2579 scope.go:117] "RemoveContainer" containerID="572270a4efae967539b0acf2761180aa7f259524f39685d1b66539263a79b45f"
Jul 02 17:36:04.898789 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:04.898422    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"]
Jul 02 17:36:04.901537 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:04.901507    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/sub-test-model-4421aa-kserve-66c5d7fbdf-7q87w"]
Jul 02 17:36:05.721068 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:05.721024    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63edcc34-ed76-4299-b3c1-58adc2fd93ac" path="/var/lib/kubelet/pods/63edcc34-ed76-4299-b3c1-58adc2fd93ac/volumes"
Jul 02 17:36:05.721544 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:05.721521    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b38c4250-22d2-4ef7-abec-2fd06d55df22" path="/var/lib/kubelet/pods/b38c4250-22d2-4ef7-abec-2fd06d55df22/volumes"
Jul 02 17:36:24.233365 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:24.233321    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:36:24.334716 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:24.334684    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:36:33.164550 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.164517    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"]
Jul 02 17:36:33.165052 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.164845    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63edcc34-ed76-4299-b3c1-58adc2fd93ac" containerName="main"
Jul 02 17:36:33.165052 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.164856    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="63edcc34-ed76-4299-b3c1-58adc2fd93ac" containerName="main"
Jul 02 17:36:33.165052 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.164867    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b38c4250-22d2-4ef7-abec-2fd06d55df22" containerName="main"
Jul 02 17:36:33.165052 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.164872    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b38c4250-22d2-4ef7-abec-2fd06d55df22" containerName="main"
Jul 02 17:36:33.165052 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.164937    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="63edcc34-ed76-4299-b3c1-58adc2fd93ac" containerName="main"
Jul 02 17:36:33.165052 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.164949    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b38c4250-22d2-4ef7-abec-2fd06d55df22" containerName="main"
Jul 02 17:36:33.167834 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.167817    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.171009 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.170986    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4421aa\"/\"default-dockercfg-k49mj\""
Jul 02 17:36:33.171009 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.170999    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4421aa\"/\"openshift-service-ca.crt\""
Jul 02 17:36:33.171218 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.171004    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4421aa\"/\"rate-test-model-4421aa-kserve-self-signed-certs\""
Jul 02 17:36:33.171218 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.171018    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4421aa\"/\"kube-root-ca.crt\""
Jul 02 17:36:33.178282 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.178259    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"]
Jul 02 17:36:33.184868 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.184839    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:36:33.251883 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.251844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-dshm\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.252132 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.251903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bhmc\" (UniqueName: \"kubernetes.io/projected/7e8452fd-5ae3-433a-8b35-8079d98ea39e-kube-api-access-6bhmc\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.252132 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.251969    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8452fd-5ae3-433a-8b35-8079d98ea39e-tls-certs\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.252132 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.252008    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-home\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.252132 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.252046    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-model-cache\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.252132 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.252080    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-tmp-dir\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.352809 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.352767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-tmp-dir\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.353009 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.352823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-dshm\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.353009 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.352867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bhmc\" (UniqueName: \"kubernetes.io/projected/7e8452fd-5ae3-433a-8b35-8079d98ea39e-kube-api-access-6bhmc\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.353009 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.352887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8452fd-5ae3-433a-8b35-8079d98ea39e-tls-certs\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.353009 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.352912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-home\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.353009 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.352960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-model-cache\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.353304 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.353252    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-tmp-dir\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.353304 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.353266    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-home\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.353381 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.353366    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-model-cache\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.355194 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.355168    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-dshm\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.355467 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.355448    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8452fd-5ae3-433a-8b35-8079d98ea39e-tls-certs\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.360928 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.360904    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bhmc\" (UniqueName: \"kubernetes.io/projected/7e8452fd-5ae3-433a-8b35-8079d98ea39e-kube-api-access-6bhmc\") pod \"rate-test-model-4421aa-kserve-5f4445667-kd2k8\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") " pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.477887 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.477804    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:33.611198 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:33.611166    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"]
Jul 02 17:36:33.612967 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:36:33.612939    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e8452fd_5ae3_433a_8b35_8079d98ea39e.slice/crio-ad429189166912b6ae4692b2c3a9cb9e7e264a9abf109e2dbc59ada7826d769a WatchSource:0}: Error finding container ad429189166912b6ae4692b2c3a9cb9e7e264a9abf109e2dbc59ada7826d769a: Status 404 returned error can't find the container with id ad429189166912b6ae4692b2c3a9cb9e7e264a9abf109e2dbc59ada7826d769a
Jul 02 17:36:34.029384 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:34.029344    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8" event={"ID":"7e8452fd-5ae3-433a-8b35-8079d98ea39e","Type":"ContainerStarted","Data":"6bb315379de94d2684d605ca199f767b8ead79fcfea6ed74d2ac207fd45c6c72"}
Jul 02 17:36:34.029604 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:34.029396    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8" event={"ID":"7e8452fd-5ae3-433a-8b35-8079d98ea39e","Type":"ContainerStarted","Data":"ad429189166912b6ae4692b2c3a9cb9e7e264a9abf109e2dbc59ada7826d769a"}
Jul 02 17:36:34.044902 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:34.044847    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8" podStartSLOduration=1.044830644 podStartE2EDuration="1.044830644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:36:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:36:34.044482901 +0000 UTC m=+2533.411148868" watchObservedRunningTime="2026-07-02 17:36:34.044830644 +0000 UTC m=+2533.411496646"
Jul 02 17:36:43.478392 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:43.478355    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:43.478790 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:43.478410    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:43.490839 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:43.490814    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:36:44.093523 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:36:44.093487    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:37:02.233474 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:02.233437    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:08.811813 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:08.811774    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:08.908931 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:08.908899    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:17.166529 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:17.166486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:17.270551 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:17.270509    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:25.162992 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:25.162955    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:25.247823 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:25.247780    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:25.891965 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:25.891926    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:26.874978 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:26.874944    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"]
Jul 02 17:37:26.896788 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:26.896758    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:28.034666 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:28.034632    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:28.509997 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:28.509958    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:28.659396 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:28.659362    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:28.759672 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:28.759633    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:28.912452 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:28.912414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:33.555517 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:33.555484    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:41.895261 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:41.895215    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8" podUID="7e8452fd-5ae3-433a-8b35-8079d98ea39e" containerName="main" containerID="cri-o://6bb315379de94d2684d605ca199f767b8ead79fcfea6ed74d2ac207fd45c6c72" gracePeriod=45
Jul 02 17:37:42.144407 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.144383    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:37:42.279433 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.279337    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bhmc\" (UniqueName: \"kubernetes.io/projected/7e8452fd-5ae3-433a-8b35-8079d98ea39e-kube-api-access-6bhmc\") pod \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") "
Jul 02 17:37:42.279433 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.279379    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-dshm\") pod \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") "
Jul 02 17:37:42.279433 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.279405    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-tmp-dir\") pod \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") "
Jul 02 17:37:42.279740 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.279456    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8452fd-5ae3-433a-8b35-8079d98ea39e-tls-certs\") pod \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") "
Jul 02 17:37:42.279740 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.279474    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-model-cache\") pod \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") "
Jul 02 17:37:42.279740 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.279526    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-home\") pod \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\" (UID: \"7e8452fd-5ae3-433a-8b35-8079d98ea39e\") "
Jul 02 17:37:42.279887 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.279702    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7e8452fd-5ae3-433a-8b35-8079d98ea39e" (UID: "7e8452fd-5ae3-433a-8b35-8079d98ea39e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:37:42.279887 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.279782    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-model-cache" (OuterVolumeSpecName: "model-cache") pod "7e8452fd-5ae3-433a-8b35-8079d98ea39e" (UID: "7e8452fd-5ae3-433a-8b35-8079d98ea39e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:37:42.279887 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.279849    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-home" (OuterVolumeSpecName: "home") pod "7e8452fd-5ae3-433a-8b35-8079d98ea39e" (UID: "7e8452fd-5ae3-433a-8b35-8079d98ea39e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:37:42.281696 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.281669    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-dshm" (OuterVolumeSpecName: "dshm") pod "7e8452fd-5ae3-433a-8b35-8079d98ea39e" (UID: "7e8452fd-5ae3-433a-8b35-8079d98ea39e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:37:42.281801 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.281714    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e8452fd-5ae3-433a-8b35-8079d98ea39e-kube-api-access-6bhmc" (OuterVolumeSpecName: "kube-api-access-6bhmc") pod "7e8452fd-5ae3-433a-8b35-8079d98ea39e" (UID: "7e8452fd-5ae3-433a-8b35-8079d98ea39e"). InnerVolumeSpecName "kube-api-access-6bhmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:37:42.281853 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.281799    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e8452fd-5ae3-433a-8b35-8079d98ea39e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7e8452fd-5ae3-433a-8b35-8079d98ea39e" (UID: "7e8452fd-5ae3-433a-8b35-8079d98ea39e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:37:42.380414 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.380386    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-tmp-dir\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:37:42.380414 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.380410    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8452fd-5ae3-433a-8b35-8079d98ea39e-tls-certs\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:37:42.380414 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.380418    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-model-cache\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:37:42.380657 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.380426    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-home\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:37:42.380657 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.380435    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bhmc\" (UniqueName: \"kubernetes.io/projected/7e8452fd-5ae3-433a-8b35-8079d98ea39e-kube-api-access-6bhmc\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:37:42.380657 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.380444    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e8452fd-5ae3-433a-8b35-8079d98ea39e-dshm\") on node \"ip-10-0-130-131.ec2.internal\" DevicePath \"\""
Jul 02 17:37:42.384056 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.384032    2579 generic.go:356] "Generic (PLEG): container finished" podID="7e8452fd-5ae3-433a-8b35-8079d98ea39e" containerID="6bb315379de94d2684d605ca199f767b8ead79fcfea6ed74d2ac207fd45c6c72" exitCode=0
Jul 02 17:37:42.384162 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.384076    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8" event={"ID":"7e8452fd-5ae3-433a-8b35-8079d98ea39e","Type":"ContainerDied","Data":"6bb315379de94d2684d605ca199f767b8ead79fcfea6ed74d2ac207fd45c6c72"}
Jul 02 17:37:42.384162 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.384131    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8" event={"ID":"7e8452fd-5ae3-433a-8b35-8079d98ea39e","Type":"ContainerDied","Data":"ad429189166912b6ae4692b2c3a9cb9e7e264a9abf109e2dbc59ada7826d769a"}
Jul 02 17:37:42.384162 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.384149    2579 scope.go:117] "RemoveContainer" containerID="6bb315379de94d2684d605ca199f767b8ead79fcfea6ed74d2ac207fd45c6c72"
Jul 02 17:37:42.384277 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.384077    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"
Jul 02 17:37:42.393289 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.393270    2579 scope.go:117] "RemoveContainer" containerID="6bb315379de94d2684d605ca199f767b8ead79fcfea6ed74d2ac207fd45c6c72"
Jul 02 17:37:42.393562 ip-10-0-130-131 kubenswrapper[2579]: E0702 17:37:42.393543    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bb315379de94d2684d605ca199f767b8ead79fcfea6ed74d2ac207fd45c6c72\": container with ID starting with 6bb315379de94d2684d605ca199f767b8ead79fcfea6ed74d2ac207fd45c6c72 not found: ID does not exist" containerID="6bb315379de94d2684d605ca199f767b8ead79fcfea6ed74d2ac207fd45c6c72"
Jul 02 17:37:42.393627 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.393570    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb315379de94d2684d605ca199f767b8ead79fcfea6ed74d2ac207fd45c6c72"} err="failed to get container status \"6bb315379de94d2684d605ca199f767b8ead79fcfea6ed74d2ac207fd45c6c72\": rpc error: code = NotFound desc = could not find container \"6bb315379de94d2684d605ca199f767b8ead79fcfea6ed74d2ac207fd45c6c72\": container with ID starting with 6bb315379de94d2684d605ca199f767b8ead79fcfea6ed74d2ac207fd45c6c72 not found: ID does not exist"
Jul 02 17:37:42.406572 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.406542    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"]
Jul 02 17:37:42.412062 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:42.412040    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4421aa/rate-test-model-4421aa-kserve-5f4445667-kd2k8"]
Jul 02 17:37:43.721079 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:37:43.721003    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e8452fd-5ae3-433a-8b35-8079d98ea39e" path="/var/lib/kubelet/pods/7e8452fd-5ae3-433a-8b35-8079d98ea39e/volumes"
Jul 02 17:38:10.458267 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:10.458232    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:10.742064 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:10.741950    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:11.000021 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:10.999920    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:11.187333 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:11.187296    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:11.621429 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:11.621389    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:11.722182 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:11.722144    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:11.905305 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:11.905197    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:17.585912 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:17.585868    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:17.686775 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:17.686731    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:17.955331 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:17.955244    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:18.109051 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:18.109014    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:18.567832 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:18.567795    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c664cf6b7-76tf4_5856d8c0-7996-43a9-a621-f81ad6d9ec95/authorino/0.log"
Jul 02 17:38:24.490673 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:24.490642    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845f459c56-28hvq_7ede4f31-d5ad-4a10-ba81-9008d2ee14dc/copy-manifests/0.log"
Jul 02 17:38:24.509433 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:24.509403    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845f459c56-28hvq_7ede4f31-d5ad-4a10-ba81-9008d2ee14dc/manager/0.log"
Jul 02 17:38:25.761446 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:25.761413    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7_9a496653-903b-4ef7-9e8e-91a0900be20d/util/0.log"
Jul 02 17:38:25.768359 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:25.768331    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7_9a496653-903b-4ef7-9e8e-91a0900be20d/pull/0.log"
Jul 02 17:38:25.775113 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:25.775063    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7_9a496653-903b-4ef7-9e8e-91a0900be20d/extract/0.log"
Jul 02 17:38:25.898141 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:25.898109    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg_be8a6e93-77bd-4097-99bf-7c4def421b36/pull/0.log"
Jul 02 17:38:25.905594 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:25.905564    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg_be8a6e93-77bd-4097-99bf-7c4def421b36/extract/0.log"
Jul 02 17:38:25.914465 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:25.914435    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg_be8a6e93-77bd-4097-99bf-7c4def421b36/util/0.log"
Jul 02 17:38:26.028883 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:26.028809    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt_433bd566-3daa-4979-89b8-f2cc82c872f7/util/0.log"
Jul 02 17:38:26.035639 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:26.035610    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt_433bd566-3daa-4979-89b8-f2cc82c872f7/pull/0.log"
Jul 02 17:38:26.041725 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:26.041706    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt_433bd566-3daa-4979-89b8-f2cc82c872f7/extract/0.log"
Jul 02 17:38:26.170930 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:26.170905    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d_58ae3f4d-5a61-472d-9a6b-237d99ebcf59/extract/0.log"
Jul 02 17:38:26.177630 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:26.177608    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d_58ae3f4d-5a61-472d-9a6b-237d99ebcf59/util/0.log"
Jul 02 17:38:26.184977 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:26.184954    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d_58ae3f4d-5a61-472d-9a6b-237d99ebcf59/pull/0.log"
Jul 02 17:38:26.311568 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:26.311481    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c664cf6b7-76tf4_5856d8c0-7996-43a9-a621-f81ad6d9ec95/authorino/0.log"
Jul 02 17:38:26.692506 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:26.692479    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6kj56_74c180aa-1475-40b4-868d-a650dc2c1dde/kuadrant-console-plugin/0.log"
Jul 02 17:38:27.823502 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:27.823468    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bc8ccd95b-2lt8r_7a9a9dbf-7184-4fa5-811a-b85ec20e68ae/kube-auth-proxy/0.log"
Jul 02 17:38:28.181432 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:28.181398    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2gn7d_3fbb9ba9-4d07-4af8-8431-437d115e18eb/payload-pre-processing/0.log"
Jul 02 17:38:28.312733 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:28.312702    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-fvr4z_e09414fc-1889-44df-b8ef-96093599b96f/payload-processing/0.log"
Jul 02 17:38:28.429586 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:28.429556    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8c4776ff9-lqj2x_655210e2-330f-496d-a2c1-f8c0f6a34eff/router/0.log"
Jul 02 17:38:28.996064 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:28.996028    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-tztmk_7b935586-fe59-4cbb-9530-25cd0a535508/main/0.log"
Jul 02 17:38:29.112550 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:29.112519    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw97xm_cc2134c2-5c06-47b7-b44b-4d965fe95afa/main/0.log"
Jul 02 17:38:29.335764 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:29.335736    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-mh7gl_82d8976f-74f8-4013-a475-35986bde4453/main/0.log"
Jul 02 17:38:33.962044 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:33.962008    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:34.062298 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:34.062260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:35.541656 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:35.541612    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log" limit=1024
Jul 02 17:38:40.119891 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:40.119858    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-swtkc_d8373671-f624-4725-9b64-6db96ed0414c/global-pull-secret-syncer/0.log"
Jul 02 17:38:40.172483 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:40.172441    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-czp4h_cc4b2698-9de5-4fee-abb7-620ed1d69cba/konnectivity-agent/0.log"
Jul 02 17:38:40.316355 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:40.316321    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-131.ec2.internal_084c7305d4c2b79de5997d13e2dcbb4a/haproxy/0.log"
Jul 02 17:38:45.055193 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.055155    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7_9a496653-903b-4ef7-9e8e-91a0900be20d/extract/0.log"
Jul 02 17:38:45.077144 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.077115    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7_9a496653-903b-4ef7-9e8e-91a0900be20d/util/0.log"
Jul 02 17:38:45.099286 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.099255    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rj5m7_9a496653-903b-4ef7-9e8e-91a0900be20d/pull/0.log"
Jul 02 17:38:45.132067 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.132036    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg_be8a6e93-77bd-4097-99bf-7c4def421b36/extract/0.log"
Jul 02 17:38:45.152162 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.152139    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg_be8a6e93-77bd-4097-99bf-7c4def421b36/util/0.log"
Jul 02 17:38:45.172540 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.172518    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ppljg_be8a6e93-77bd-4097-99bf-7c4def421b36/pull/0.log"
Jul 02 17:38:45.196252 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.196224    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt_433bd566-3daa-4979-89b8-f2cc82c872f7/extract/0.log"
Jul 02 17:38:45.222258 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.222234    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt_433bd566-3daa-4979-89b8-f2cc82c872f7/util/0.log"
Jul 02 17:38:45.246940 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.246901    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wt6kt_433bd566-3daa-4979-89b8-f2cc82c872f7/pull/0.log"
Jul 02 17:38:45.275919 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.275891    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d_58ae3f4d-5a61-472d-9a6b-237d99ebcf59/extract/0.log"
Jul 02 17:38:45.299895 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.299868    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d_58ae3f4d-5a61-472d-9a6b-237d99ebcf59/util/0.log"
Jul 02 17:38:45.324691 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.324622    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b846d_58ae3f4d-5a61-472d-9a6b-237d99ebcf59/pull/0.log"
Jul 02 17:38:45.832817 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.832785    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c664cf6b7-76tf4_5856d8c0-7996-43a9-a621-f81ad6d9ec95/authorino/0.log"
Jul 02 17:38:45.921909 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:45.921880    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6kj56_74c180aa-1475-40b4-868d-a650dc2c1dde/kuadrant-console-plugin/0.log"
Jul 02 17:38:48.147141 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:48.147080    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/1.log"
Jul 02 17:38:48.313517 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:48.313473    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-5m7vl_08dfb488-85a2-4599-a684-0442227de015/cluster-monitoring-operator/0.log"
Jul 02 17:38:48.346346 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:48.346288    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-tstdl_ab5b6d7d-84bc-42de-8b74-1bb0cd717799/kube-state-metrics/0.log"
Jul 02 17:38:48.362296 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:48.362273    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-tstdl_ab5b6d7d-84bc-42de-8b74-1bb0cd717799/kube-rbac-proxy-main/0.log"
Jul 02 17:38:48.382384 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:48.382360    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-tstdl_ab5b6d7d-84bc-42de-8b74-1bb0cd717799/kube-rbac-proxy-self/0.log"
Jul 02 17:38:48.523524 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:48.523423    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l772g_b0391dec-f56f-436d-8391-5575bb04d923/node-exporter/0.log"
Jul 02 17:38:48.541984 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:48.541956    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l772g_b0391dec-f56f-436d-8391-5575bb04d923/kube-rbac-proxy/0.log"
Jul 02 17:38:48.568181 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:48.568156    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l772g_b0391dec-f56f-436d-8391-5575bb04d923/init-textfile/0.log"
Jul 02 17:38:48.660040 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:48.660011    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-hfkmc_cc1065c8-948c-4b09-9773-4df6b1625147/kube-rbac-proxy-main/0.log"
Jul 02 17:38:48.678319 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:48.678283    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-hfkmc_cc1065c8-948c-4b09-9773-4df6b1625147/kube-rbac-proxy-self/0.log"
Jul 02 17:38:48.703398 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:48.703367    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-hfkmc_cc1065c8-948c-4b09-9773-4df6b1625147/openshift-state-metrics/0.log"
Jul 02 17:38:48.924965 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:48.924930    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-xvrft_66b2a413-8337-457b-8c09-d8d3f71d1282/prometheus-operator/0.log"
Jul 02 17:38:48.940604 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:48.940552    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-xvrft_66b2a413-8337-457b-8c09-d8d3f71d1282/kube-rbac-proxy/0.log"
Jul 02 17:38:50.005737 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.005706    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"]
Jul 02 17:38:50.006147 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.006057    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8452fd-5ae3-433a-8b35-8079d98ea39e" containerName="main"
Jul 02 17:38:50.006147 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.006068    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8452fd-5ae3-433a-8b35-8079d98ea39e" containerName="main"
Jul 02 17:38:50.006147 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.006146    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e8452fd-5ae3-433a-8b35-8079d98ea39e" containerName="main"
Jul 02 17:38:50.009425 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.009403    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.011672 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.011648    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tt4vl\"/\"default-dockercfg-w8jbn\""
Jul 02 17:38:50.011793 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.011648    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tt4vl\"/\"openshift-service-ca.crt\""
Jul 02 17:38:50.012477 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.012454    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tt4vl\"/\"kube-root-ca.crt\""
Jul 02 17:38:50.021511 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.021475    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"]
Jul 02 17:38:50.172045 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.172010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-lib-modules\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.172263 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.172060    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-proc\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.172263 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.172159    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-podres\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.172263 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.172202    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8nst\" (UniqueName: \"kubernetes.io/projected/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-kube-api-access-l8nst\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.172263 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.172226    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-sys\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.273533 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.273429    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-sys\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.273709 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.273562    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-sys\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.273709 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.273581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-lib-modules\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.273709 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.273628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-proc\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.273709 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.273688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-podres\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.273908 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.273728    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-lib-modules\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.273908 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.273770    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-proc\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.273908 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.273812    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-podres\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.273908 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.273838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8nst\" (UniqueName: \"kubernetes.io/projected/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-kube-api-access-l8nst\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.282591 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.282557    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8nst\" (UniqueName: \"kubernetes.io/projected/c40497ad-f069-4de8-ab4a-1a7c0a420bd2-kube-api-access-l8nst\") pod \"perf-node-gather-daemonset-g2bk7\" (UID: \"c40497ad-f069-4de8-ab4a-1a7c0a420bd2\") " pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.306827 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.306799    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-kvwhg_a6571d87-c591-4faa-92bf-51667bd9b37a/networking-console-plugin/0.log"
Jul 02 17:38:50.319552 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.319524    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.455618 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.455592    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"]
Jul 02 17:38:50.457643 ip-10-0-130-131 kubenswrapper[2579]: W0702 17:38:50.457609    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc40497ad_f069_4de8_ab4a_1a7c0a420bd2.slice/crio-1e8abfec7f788ca8801b697fa7b998b045e082e01d20014ddc73d92ebbc5c040 WatchSource:0}: Error finding container 1e8abfec7f788ca8801b697fa7b998b045e082e01d20014ddc73d92ebbc5c040: Status 404 returned error can't find the container with id 1e8abfec7f788ca8801b697fa7b998b045e082e01d20014ddc73d92ebbc5c040
Jul 02 17:38:50.731565 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.731526    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7" event={"ID":"c40497ad-f069-4de8-ab4a-1a7c0a420bd2","Type":"ContainerStarted","Data":"309c7ee447eafd3a33ff6fb90f22507f629ab834093f0e44ec3fb85b544b41ba"}
Jul 02 17:38:50.731750 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.731582    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7" event={"ID":"c40497ad-f069-4de8-ab4a-1a7c0a420bd2","Type":"ContainerStarted","Data":"1e8abfec7f788ca8801b697fa7b998b045e082e01d20014ddc73d92ebbc5c040"}
Jul 02 17:38:50.731750 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.731644    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:50.748509 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:50.748455    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7" podStartSLOduration=1.748438607 podStartE2EDuration="1.748438607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:38:50.747486173 +0000 UTC m=+2670.114152137" watchObservedRunningTime="2026-07-02 17:38:50.748438607 +0000 UTC m=+2670.115104569"
Jul 02 17:38:51.417410 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:51.417380    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79788fcff4-bsrtz_b7727a0b-7d1a-4c97-821d-f762a9b379da/console/0.log"
Jul 02 17:38:53.123308 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:53.123273    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rpw8d_c40fbd58-95ff-4b7b-9719-f024284c62d0/dns/0.log"
Jul 02 17:38:53.152760 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:53.152730    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rpw8d_c40fbd58-95ff-4b7b-9719-f024284c62d0/kube-rbac-proxy/0.log"
Jul 02 17:38:53.210726 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:53.210699    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dx4cb_85311435-e62b-48b9-9137-6875ceb51bc4/dns-node-resolver/0.log"
Jul 02 17:38:53.884955 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:53.884917    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p5xzd_978620fb-7c70-433b-9de0-7ebbdf96f064/node-ca/0.log"
Jul 02 17:38:55.020661 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:55.020629    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bc8ccd95b-2lt8r_7a9a9dbf-7184-4fa5-811a-b85ec20e68ae/kube-auth-proxy/0.log"
Jul 02 17:38:55.171825 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:55.171795    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2gn7d_3fbb9ba9-4d07-4af8-8431-437d115e18eb/payload-pre-processing/0.log"
Jul 02 17:38:55.245671 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:55.245635    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-fvr4z_e09414fc-1889-44df-b8ef-96093599b96f/payload-processing/0.log"
Jul 02 17:38:55.267236 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:55.267202    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8c4776ff9-lqj2x_655210e2-330f-496d-a2c1-f8c0f6a34eff/router/0.log"
Jul 02 17:38:55.981638 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:55.981605    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h9cdx_06a380d9-c1c0-438b-a440-a968c83c2764/serve-healthcheck-canary/0.log"
Jul 02 17:38:56.535267 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:56.535240    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7kzsz_7e9bb8ca-29eb-4599-9830-a5dc1ebd6656/kube-rbac-proxy/0.log"
Jul 02 17:38:56.556682 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:56.556649    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7kzsz_7e9bb8ca-29eb-4599-9830-a5dc1ebd6656/exporter/0.log"
Jul 02 17:38:56.576056 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:56.576026    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7kzsz_7e9bb8ca-29eb-4599-9830-a5dc1ebd6656/extractor/0.log"
Jul 02 17:38:56.746146 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:56.746117    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tt4vl/perf-node-gather-daemonset-g2bk7"
Jul 02 17:38:59.533339 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:59.533309    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845f459c56-28hvq_7ede4f31-d5ad-4a10-ba81-9008d2ee14dc/manager/0.log"
Jul 02 17:38:59.549719 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:38:59.549694    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845f459c56-28hvq_7ede4f31-d5ad-4a10-ba81-9008d2ee14dc/copy-manifests/0.log"
Jul 02 17:39:00.503335 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:00.503308    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bc8ccd95b-2lt8r_7a9a9dbf-7184-4fa5-811a-b85ec20e68ae/kube-auth-proxy/0.log"
Jul 02 17:39:00.631184 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:00.631153    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2gn7d_3fbb9ba9-4d07-4af8-8431-437d115e18eb/payload-pre-processing/0.log"
Jul 02 17:39:00.693149 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:00.693119    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-fvr4z_e09414fc-1889-44df-b8ef-96093599b96f/payload-processing/0.log"
Jul 02 17:39:00.709514 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:00.709439    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8c4776ff9-lqj2x_655210e2-330f-496d-a2c1-f8c0f6a34eff/router/0.log"
Jul 02 17:39:01.233272 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:01.233247    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f87dff94c-xx7p5_51a22668-5d8c-42ed-ad0c-173261541d5c/manager/0.log"
Jul 02 17:39:01.259051 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:01.259018    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-qb9ck_1bbaf0ca-5b8c-4d58-a6f3-c3ccbfa2fe18/openshift-lws-operator/0.log"
Jul 02 17:39:02.120995 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:02.120969    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bc8ccd95b-2lt8r_7a9a9dbf-7184-4fa5-811a-b85ec20e68ae/kube-auth-proxy/0.log"
Jul 02 17:39:02.251797 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:02.251767    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2gn7d_3fbb9ba9-4d07-4af8-8431-437d115e18eb/payload-pre-processing/0.log"
Jul 02 17:39:02.317618 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:02.317584    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-fvr4z_e09414fc-1889-44df-b8ef-96093599b96f/payload-processing/0.log"
Jul 02 17:39:02.330779 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:02.330751    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8c4776ff9-lqj2x_655210e2-330f-496d-a2c1-f8c0f6a34eff/router/0.log"
Jul 02 17:39:07.355083 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:07.355044    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4s9sr_b8a5c633-0484-4c8b-848e-ff55b708f1f0/kube-multus-additional-cni-plugins/0.log"
Jul 02 17:39:07.377245 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:07.377214    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4s9sr_b8a5c633-0484-4c8b-848e-ff55b708f1f0/egress-router-binary-copy/0.log"
Jul 02 17:39:07.398573 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:07.398547    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4s9sr_b8a5c633-0484-4c8b-848e-ff55b708f1f0/cni-plugins/0.log"
Jul 02 17:39:07.418535 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:07.418506    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4s9sr_b8a5c633-0484-4c8b-848e-ff55b708f1f0/bond-cni-plugin/0.log"
Jul 02 17:39:07.439001 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:07.438970    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4s9sr_b8a5c633-0484-4c8b-848e-ff55b708f1f0/routeoverride-cni/0.log"
Jul 02 17:39:07.458495 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:07.458470    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4s9sr_b8a5c633-0484-4c8b-848e-ff55b708f1f0/whereabouts-cni-bincopy/0.log"
Jul 02 17:39:07.477038 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:07.477013    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4s9sr_b8a5c633-0484-4c8b-848e-ff55b708f1f0/whereabouts-cni/0.log"
Jul 02 17:39:07.895900 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:07.895857    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xlwgd_3a39e3b2-5ae8-437f-8122-d0247088e55a/kube-multus/0.log"
Jul 02 17:39:08.116616 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:08.116582    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zc26l_714f87ed-815d-48a6-a203-a5a4494ddffe/network-metrics-daemon/0.log"
Jul 02 17:39:08.140061 ip-10-0-130-131 kubenswrapper[2579]: I0702 17:39:08.140024    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zc26l_714f87ed-815d-48a6-a203-a5a4494ddffe/kube-rbac-proxy/0.log"