Jul 06 23:48:40.259107 ip-10-0-129-95 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 23:48:40.715264 ip-10-0-129-95 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:48:40.715264 ip-10-0-129-95 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 23:48:40.715264 ip-10-0-129-95 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:48:40.715264 ip-10-0-129-95 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 23:48:40.715264 ip-10-0-129-95 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:48:40.716329 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.716189    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 23:48:40.720609 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720588    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:48:40.720609 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720609    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720613    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720616    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720619    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720622    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720625    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720627    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720630    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720633    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720635    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720638    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720640    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720643    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720646    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720648    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720650    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720653    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720656    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720659    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720661    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:48:40.720691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720664    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720666    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720674    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720700    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720704    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720708    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720711    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720714    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720717    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720720    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720723    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720725    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720727    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720730    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720734    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720754    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720757    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720760    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720762    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:48:40.721222 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720765    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720767    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720770    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720772    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720776    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720778    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720781    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720783    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720785    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720788    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720790    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720793    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720795    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720798    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720801    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720804    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720807    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720810    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720812    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720816    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:48:40.721687 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720818    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720821    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720823    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720826    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720828    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720831    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720833    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720836    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720838    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720841    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720844    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720847    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720849    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720852    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720854    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720857    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720860    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720862    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720864    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720867    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:48:40.722232 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720869    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720872    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720874    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720876    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720879    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720882    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720884    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720890    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720894    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720897    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720900    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720902    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720905    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720907    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720910    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720913    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720915    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720918    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.720922    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:48:40.722721 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721657    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721664    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721667    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721670    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721673    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721676    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721679    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721682    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721684    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721687    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721690    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721693    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721695    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721698    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721701    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721703    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721706    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721708    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721712    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721715    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:48:40.723246 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721718    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721721    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721724    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721727    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721730    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721732    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721755    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721759    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721762    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721765    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721768    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721771    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721774    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721777    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721779    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721782    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721785    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721787    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721791    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:48:40.723861 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721793    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721797    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721799    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721802    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721804    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721807    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721810    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721812    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721815    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721818    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721820    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721823    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721826    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721829    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721832    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721835    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721837    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721840    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721843    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721845    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:48:40.724353 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721848    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721850    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721853    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721855    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721858    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721860    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721863    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721866    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721868    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721871    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721873    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721875    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721879    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721883    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721887    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721889    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721892    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721895    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721897    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:48:40.724864 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721900    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721903    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721905    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721908    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721910    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721913    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721916    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721919    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721921    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721924    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721926    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721929    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721931    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721933    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721936    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721938    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721941    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721944    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721946    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721949    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:48:40.725333 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.721951    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722349    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722354    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722356    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722359    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722362    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722365    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722367    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722370    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722372    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722375    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722377    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722380    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722382    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722384    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722387    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722390    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722392    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722396    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722398    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:48:40.725855 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722401    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722403    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722407    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722409    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722412    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722414    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722419    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722422    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722425    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722428    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722431    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722434    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722436    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722439    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722441    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722444    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722446    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722449    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722452    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:48:40.726344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722454    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722457    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722460    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722462    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722465    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722468    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722470    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722472    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722475    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722478    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722481    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722484    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722487    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722491    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722494    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722496    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722499    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722501    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722503    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:48:40.726822 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722506    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722508    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722511    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722513    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722515    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722518    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722520    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722523    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722525    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722527    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722530    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722532    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722535    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722537    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722542    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722545    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722548    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722551    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722553    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:48:40.727283 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722556    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722558    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722561    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722564    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722567    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722570    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722573    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722576    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722578    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722580    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722583    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722596    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722599    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722602    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722605    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722607    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722610    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722613    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722615    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722618    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:48:40.727767 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722620    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722623    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.722626    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722703    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722711    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722717    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722722    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722727    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722731    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722749    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722755    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722759    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722761    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722767    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722771    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722774    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722777    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722781    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722784    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722787    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722790    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722795    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722797    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722801    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 23:48:40.728526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722804    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722807    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722811    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722814    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722817    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722820    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722823    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722826    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722829    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722832    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722835    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722842    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722845    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722848    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722850    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722853    2582 flags.go:64] FLAG: --enable-server="true"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722857    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722861    2582 flags.go:64] FLAG: --event-burst="100"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722864    2582 flags.go:64] FLAG: --event-qps="50"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722867    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722870    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722876    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722880    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722883    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722886    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 23:48:40.729176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722890    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722894    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722896    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722899    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722903    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722906    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722908    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722911    2582 flags.go:64] FLAG: --feature-gates=""
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722915    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722918    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722921    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722924    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722927    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722930    2582 flags.go:64] FLAG: --help="false"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722932    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-129-95.ec2.internal"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722935    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722938    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722941    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722944    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722947    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722950    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722953    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722955    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 23:48:40.729830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722958    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722969    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722972    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722974    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722977    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722982    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722985    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722988    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722990    2582 flags.go:64] FLAG: --lock-file=""
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.722997    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723000    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723003    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723015    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723018    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723021    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723024    2582 flags.go:64] FLAG: --logging-format="text"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723027    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723030    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723033    2582 flags.go:64] FLAG: --manifest-url=""
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723036    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723040    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723044    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723047    2582 flags.go:64] FLAG: --max-pods="110"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723051    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723054    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 23:48:40.730411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723056    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723060    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723063    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723065    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723068    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723076    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723079    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723081    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723084    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723088    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723093    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723096    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723099    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723103    2582 flags.go:64] FLAG: --port="10250"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723106    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723109    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c4cdce9692f2dc4e"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723113    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723117    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723119    2582 flags.go:64] FLAG: --register-node="true"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723122    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723126    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723129    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723132    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723135    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723138    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 23:48:40.731074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723141    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723145    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723147    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723150    2582 flags.go:64] FLAG: --runonce="false"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723153    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723156    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723159    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723161    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723164    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723167    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723170    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723173    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723175    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723178    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723181    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723183    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723186    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723190    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723192    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723198    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723202    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723205    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723209    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723213    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723216    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 23:48:40.731668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723219    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723221    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723224    2582 flags.go:64] FLAG: --v="2"
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723228    2582 flags.go:64] FLAG: --version="false"
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723232    2582 flags.go:64] FLAG: --vmodule=""
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723236    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.723239    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723357    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723361    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723364    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723367    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723369    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723372    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723374    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723377    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723379    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723382    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723385    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723388    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723390    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723392    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:48:40.732297 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723395    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723397    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723400    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723402    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723405    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723407    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723410    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723413    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723416    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723419    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723422    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723424    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723427    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723429    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723432    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723434    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723437    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723440    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723442    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723444    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:48:40.732884 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723446    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723449    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723451    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723454    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723456    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723458    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723461    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723463    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723466    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723468    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723470    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723473    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723475    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723478    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723480    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723484    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723487    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723491    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723494    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723496    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:48:40.733385 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723499    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723505    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723509    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723511    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723514    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723517    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723519    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723521    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723524    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723527    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723530    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723533    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723535    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723537    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723540    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723542    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723545    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723547    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723550    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723552    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:48:40.733925 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723555    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723557    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723559    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723563    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723567    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723569    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723572    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723575    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723577    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723580    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723583    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723586    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723588    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723593    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723595    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723597    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723600    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723603    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723606    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:48:40.734412 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723608    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723610    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723613    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723615    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723617    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.723620    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.724249    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.731402    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.731420    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.731441    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.731447    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731507    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731513    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731516    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731519    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:48:40.734886 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731523    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731525    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731528    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731531    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731533    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731536    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731539    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731542    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731544    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731547    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731549    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731552    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731555    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731559    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731563    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731566    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731568    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731571    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731574    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:48:40.735257 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731577    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731580    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731583    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731585    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731588    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731590    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731595    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731597    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731600    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731602    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731605    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731608    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731611    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731613    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731616    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731619    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731621    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731624    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731626    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731628    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:48:40.735726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731631    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731633    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731635    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731638    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731640    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731643    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731646    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731649    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731651    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731654    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731656    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731660    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731663    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731666    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731669    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731672    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731674    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731677    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731681    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731688    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:48:40.736237 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731691    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731694    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731697    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731700    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731703    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731705    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731708    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731710    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731713    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731715    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731718    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731720    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731723    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731725    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731728    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731730    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731733    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731753    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731760    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731764    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:48:40.736726 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731767    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731770    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731773    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731776    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731779    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731782    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731784    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731787    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731789    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731792    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731795    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731798    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731801    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731804    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731807    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:48:40.737263 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731809    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.731814    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731953    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731959    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731962    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731965    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731968    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731971    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731974    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731976    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731979    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731982    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731985    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731987    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731990    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:48:40.737634 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731992    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731995    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731997    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.731999    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732002    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732004    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732007    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732010    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732012    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732015    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732017    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732020    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732023    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732026    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732029    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732032    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732035    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732038    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732040    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732043    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:48:40.738021 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732045    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732048    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732050    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732053    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732055    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732058    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732060    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732062    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732064    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732067    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732069    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732072    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732075    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732077    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732079    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732082    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732084    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732087    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732089    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732092    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:48:40.738503 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732094    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732097    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732099    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732102    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732104    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732108    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732110    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732113    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732117    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732119    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732122    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732124    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732126    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732129    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732132    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732136    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732139    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732142    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732144    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:48:40.738998 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732147    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732150    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732152    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732155    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732158    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732160    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732163    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732165    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732168    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732171    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732175    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732177    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732180    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732183    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732186    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732188    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732191    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732193    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732196    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:48:40.739459 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732200    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:48:40.739931 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732204    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:48:40.739931 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732206    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:48:40.739931 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732209    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:48:40.739931 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732212    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:48:40.739931 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732214    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:48:40.739931 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732217    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:48:40.739931 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:40.732219    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:48:40.739931 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.732223    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:48:40.739931 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.732356    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 23:48:40.739931 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.734357    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 23:48:40.739931 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.737083    2582 server.go:1019] "Starting client certificate rotation"
Jul 06 23:48:40.739931 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.737184    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:48:40.739931 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.737229    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:48:40.741197 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.741182    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:48:40.748926 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.748896    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:48:40.760646 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.760623    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 06 23:48:40.762936 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.762922    2582 log.go:25] "Validated CRI v1 image API"
Jul 06 23:48:40.763754 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.763722    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 23:48:40.766080 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.766051    2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bec6194b-49e6-4946-8595-b1b043fa305e:/dev/nvme0n1p4 f9fb4d5c-ce71-4519-8165-f36362471546:/dev/nvme0n1p3]
Jul 06 23:48:40.766152 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.766080    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 23:48:40.772086 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.771950    2582 manager.go:216] Machine: {Timestamp:2026-07-06 23:48:40.770476257 +0000 UTC m=+0.377904260 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098879 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2573bda41fe5d68addac2d599b2208 SystemUUID:ec2573bd-a41f-e5d6-8add-ac2d599b2208 BootID:420bd493-dcc5-462f-89d7-f2ea85c0aa37 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:85:e3:d7:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:85:e3:d7:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:e4:58:7e:b2:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 23:48:40.772086 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.772068    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 23:48:40.772219 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.772162    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 23:48:40.772421 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.772405    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:48:40.775499 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.775467    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 23:48:40.775656 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.775503    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 23:48:40.776246 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.776235    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 23:48:40.776283 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.776249    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 23:48:40.776283 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.776256    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:48:40.776283 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.776270    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:48:40.777938 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.777927    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 23:48:40.781396 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.781381    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:48:40.781522 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.781512    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 23:48:40.781561 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.781543    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 23:48:40.781595 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.781562    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 23:48:40.781595 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.781583    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 23:48:40.781648 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.781597    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 06 23:48:40.781648 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.781609    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 23:48:40.782036 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.782025    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:48:40.782075 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.782043    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:48:40.786035 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.786013    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 23:48:40.788009 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.787995    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 23:48:40.788064 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.788026    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 23:48:40.791073 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.791048    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 23:48:40.791073 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.791077    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 23:48:40.791245 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.791089    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 23:48:40.791245 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.791100    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 23:48:40.791245 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.791114    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 23:48:40.791245 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.791124    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 23:48:40.791245 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.791144    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 23:48:40.791245 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.791153    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 23:48:40.791245 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.791164    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 23:48:40.791245 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.791173    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 23:48:40.791245 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.791207    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 23:48:40.791245 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.791216    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 23:48:40.792241 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.792220    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 23:48:40.792339 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.792249    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 23:48:40.793350 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.793323    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 23:48:40.793482 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.793326    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 23:48:40.795783 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.795768    2582 server.go:1268] "Started kubelet"
Jul 06 23:48:40.795897 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.795863    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 23:48:40.795987 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.795917    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 23:48:40.796042 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.796017    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 23:48:40.796802 ip-10-0-129-95 systemd[1]: Started Kubernetes Kubelet.
Jul 06 23:48:40.797148 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.797130    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 23:48:40.798142 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.798129    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 23:48:40.803038 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.803018    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 23:48:40.805396 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.805378    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 23:48:40.805474 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.805401    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 23:48:40.805520 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.805503    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found"
Jul 06 23:48:40.806141 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.806122    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 23:48:40.806230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.806165    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 23:48:40.806230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.806181    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 23:48:40.806322 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.806310    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 23:48:40.806322 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.806318    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 23:48:40.806427 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.806332    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 23:48:40.806427 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.806362    2582 factory.go:55] Registering systemd factory
Jul 06 23:48:40.806427 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.806371    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 06 23:48:40.806711 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.806625    2582 factory.go:153] Registering CRI-O factory
Jul 06 23:48:40.806711 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.806637    2582 factory.go:223] Registration of the crio container factory successfully
Jul 06 23:48:40.806711 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.806662    2582 factory.go:103] Registering Raw factory
Jul 06 23:48:40.806711 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.806677    2582 manager.go:1196] Started watching for new ooms in manager
Jul 06 23:48:40.807219 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.807204    2582 manager.go:349] Starting recovery of all containers
Jul 06 23:48:40.810643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.810617    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 23:48:40.810770 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.810674    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 23:48:40.811508 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.811465    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 23:48:40.811894 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.810672    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-95.ec2.internal.18bfd839eef40b3e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-95.ec2.internal,UID:ip-10-0-129-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-95.ec2.internal,},FirstTimestamp:2026-07-06 23:48:40.795712318 +0000 UTC m=+0.403140321,LastTimestamp:2026-07-06 23:48:40.795712318 +0000 UTC m=+0.403140321,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-95.ec2.internal,}"
Jul 06 23:48:40.818633 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.818452    2582 manager.go:354] Recovery completed
Jul 06 23:48:40.825201 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.825184    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:48:40.827098 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.827073    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:48:40.827146 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.827110    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:48:40.827146 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.827120    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:48:40.827616 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.827602    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 23:48:40.827616 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.827613    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 23:48:40.827724 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.827619    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:48:40.827724 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.827630    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:48:40.828378 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.828363    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:48:40.828422 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.828391    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:48:40.828422 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.828401    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:48:40.828880 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.828863    2582 policy_none.go:49] "None policy: Start"
Jul 06 23:48:40.828950 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.828885    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 23:48:40.828950 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.828899    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 23:48:40.829018 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.828923    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-95.ec2.internal.18bfd839f0d2f811  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-95.ec2.internal,UID:ip-10-0-129-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-95.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-95.ec2.internal,},FirstTimestamp:2026-07-06 23:48:40.827099153 +0000 UTC m=+0.434527155,LastTimestamp:2026-07-06 23:48:40.827099153 +0000 UTC m=+0.434527155,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-95.ec2.internal,}"
Jul 06 23:48:40.829872 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.829861    2582 policy_none.go:47] "Start"
Jul 06 23:48:40.841844 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.841761    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-95.ec2.internal.18bfd839f0d33457  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-95.ec2.internal,UID:ip-10-0-129-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-95.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-95.ec2.internal,},FirstTimestamp:2026-07-06 23:48:40.827114583 +0000 UTC m=+0.434542584,LastTimestamp:2026-07-06 23:48:40.827114583 +0000 UTC m=+0.434542584,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-95.ec2.internal,}"
Jul 06 23:48:40.850275 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.850236    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-54qpz"
Jul 06 23:48:40.853255 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.853180    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-95.ec2.internal.18bfd839f0d357bb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-95.ec2.internal,UID:ip-10-0-129-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-95.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-95.ec2.internal,},FirstTimestamp:2026-07-06 23:48:40.827123643 +0000 UTC m=+0.434551645,LastTimestamp:2026-07-06 23:48:40.827123643 +0000 UTC m=+0.434551645,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-95.ec2.internal,}"
Jul 06 23:48:40.861135 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.861101    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-54qpz"
Jul 06 23:48:40.862416 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.862345    2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-95.ec2.internal.18bfd839f0d2f811\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-95.ec2.internal.18bfd839f0d2f811  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-95.ec2.internal,UID:ip-10-0-129-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-95.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-95.ec2.internal,},FirstTimestamp:2026-07-06 23:48:40.827099153 +0000 UTC m=+0.434527155,LastTimestamp:2026-07-06 23:48:40.828379562 +0000 UTC m=+0.435807563,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-95.ec2.internal,}"
Jul 06 23:48:40.870666 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.870646    2582 manager.go:337] "Starting Device Plugin manager"
Jul 06 23:48:40.870958 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.870697    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 23:48:40.870958 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.870709    2582 server.go:87] "Starting device plugin registration server"
Jul 06 23:48:40.885858 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.871017    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 23:48:40.885858 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.871031    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 23:48:40.885858 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.871207    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 23:48:40.885858 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.871288    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 23:48:40.885858 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.871296    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 23:48:40.885858 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.871953    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 23:48:40.885858 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.871994    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-95.ec2.internal\" not found"
Jul 06 23:48:40.956212 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.956168    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 23:48:40.957595 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.957575    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 23:48:40.957649 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.957626    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 23:48:40.957682 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.957657    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 23:48:40.957712 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.957701    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 23:48:40.960368 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.960334    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:48:40.971895 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.971798    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:48:40.976126 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.976103    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:48:40.976247 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.976139    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:48:40.976247 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.976155    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:48:40.976247 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.976179    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-95.ec2.internal"
Jul 06 23:48:40.989202 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:40.989169    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-95.ec2.internal"
Jul 06 23:48:40.989202 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:40.989202    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-95.ec2.internal\": node \"ip-10-0-129-95.ec2.internal\" not found"
Jul 06 23:48:41.015171 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:41.015133    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found"
Jul 06 23:48:41.058386 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.058354    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal"]
Jul 06 23:48:41.058524 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.058435    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:48:41.060058 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.060042    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:48:41.060127 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.060077    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:48:41.060127 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.060089    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:48:41.061380 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.061367    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:48:41.061550 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.061534    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.061603 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.061562    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:48:41.063920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.063901    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:48:41.063920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.063915    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:48:41.064068 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.063931    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:48:41.064068 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.063937    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:48:41.064068 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.063946    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:48:41.064068 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.063947    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:48:41.065445 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.065428    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.065533 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.065459    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:48:41.066276 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.066260    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:48:41.066335 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.066292    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:48:41.066335 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.066303    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:48:41.083470 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:41.083441    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-95.ec2.internal\" not found" node="ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.088319 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:41.088302    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-95.ec2.internal\" not found" node="ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.108427 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.108397    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eff5104d7452b5ed4a3bf2742a0cf695-config\") pod \"kube-apiserver-proxy-ip-10-0-129-95.ec2.internal\" (UID: \"eff5104d7452b5ed4a3bf2742a0cf695\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.108542 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.108430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09305b88f1373ed8937b4f40e869c133-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal\" (UID: \"09305b88f1373ed8937b4f40e869c133\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.108542 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.108454    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09305b88f1373ed8937b4f40e869c133-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal\" (UID: \"09305b88f1373ed8937b4f40e869c133\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.115517 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:41.115492    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found"
Jul 06 23:48:41.209508 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.209467    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09305b88f1373ed8937b4f40e869c133-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal\" (UID: \"09305b88f1373ed8937b4f40e869c133\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.209508 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.209507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09305b88f1373ed8937b4f40e869c133-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal\" (UID: \"09305b88f1373ed8937b4f40e869c133\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.209732 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.209532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eff5104d7452b5ed4a3bf2742a0cf695-config\") pod \"kube-apiserver-proxy-ip-10-0-129-95.ec2.internal\" (UID: \"eff5104d7452b5ed4a3bf2742a0cf695\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.209732 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.209581    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eff5104d7452b5ed4a3bf2742a0cf695-config\") pod \"kube-apiserver-proxy-ip-10-0-129-95.ec2.internal\" (UID: \"eff5104d7452b5ed4a3bf2742a0cf695\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.209732 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.209583    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09305b88f1373ed8937b4f40e869c133-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal\" (UID: \"09305b88f1373ed8937b4f40e869c133\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.209732 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.209583    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09305b88f1373ed8937b4f40e869c133-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal\" (UID: \"09305b88f1373ed8937b4f40e869c133\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.216621 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:41.216593    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found"
Jul 06 23:48:41.317780 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:41.317699    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found"
Jul 06 23:48:41.385935 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.385889    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.391415 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.391396    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.418463 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:41.418429    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found"
Jul 06 23:48:41.519067 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:41.519019    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found"
Jul 06 23:48:41.619630 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:41.619542    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found"
Jul 06 23:48:41.686812 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.686781    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:48:41.706288 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.706242    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.717979 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.717947    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:48:41.719889 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.719872    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal"
Jul 06 23:48:41.726568 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.726540    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:48:41.735755 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.735703    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 23:48:41.735920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.735886    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 23:48:41.735993 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.735886    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 23:48:41.782091 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.782049    2582 apiserver.go:52] "Watching apiserver"
Jul 06 23:48:41.801569 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.801537    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 23:48:41.801928 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.801906    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-sz2ws","openshift-ovn-kubernetes/ovnkube-node-fltzc","kube-system/konnectivity-agent-5xx98","kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd","openshift-image-registry/node-ca-79fgn","openshift-multus/multus-additional-cni-plugins-ms9ns","openshift-multus/multus-fmxjt","openshift-network-diagnostics/network-check-target-tqk7j","openshift-network-operator/iptables-alerter-jhw9l","kube-system/global-pull-secret-syncer-cllp6","openshift-cluster-node-tuning-operator/tuned-g8dq4","openshift-dns/node-resolver-xcw84","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal"]
Jul 06 23:48:41.803781 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.803757    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jhw9l"
Jul 06 23:48:41.804887 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.804849    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xcw84"
Jul 06 23:48:41.805998 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.805975    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 23:48:41.806175 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.806157    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5xx98"
Jul 06 23:48:41.806752 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.806715    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 23:48:41.806898 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.806834    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:48:41.806898 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.806879    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 23:48:41.807232 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.807219    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wxpdt\""
Jul 06 23:48:41.807488 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.807477    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.808700 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.808685    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 23:48:41.809328 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.809311    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:41.810046 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.809813    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-29nl9\""
Jul 06 23:48:41.810046 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.809841    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 23:48:41.810046 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.809880    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 23:48:41.810046 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.809909    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 23:48:41.810515 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.810498    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 23:48:41.810598 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.810501    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9ngsl\""
Jul 06 23:48:41.810800 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.810721    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-79fgn"
Jul 06 23:48:41.811191 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.811171    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 23:48:41.811272 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.811256    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 23:48:41.811435 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.811422    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 23:48:41.811496 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.811426    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 23:48:41.811581 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.811566    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9bl6t\""
Jul 06 23:48:41.811660 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.811648    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 23:48:41.812007 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.811994    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:41.812075 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:41.812052    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:48:41.812120 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.812100    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 23:48:41.812162 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.812105    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dwzqw\""
Jul 06 23:48:41.812923 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.812907    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-multus-conf-dir\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.812990 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.812938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-multus-daemon-config\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.812990 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.812960    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6zfr\" (UniqueName: \"kubernetes.io/projected/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-kube-api-access-h6zfr\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813098 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.812986    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-multus-cni-dir\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813098 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813012    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-cnibin\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813098 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813036    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-multus-socket-dir-parent\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813098 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813061    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-run-k8s-cni-cncf-io\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813098 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-var-lib-cni-multus\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813329 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-var-lib-kubelet\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813329 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813134    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-hostroot\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813329 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-etc-kubernetes\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813329 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813180    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28296891-3ba9-42dc-9f47-e0110ddcb960-tmp-dir\") pod \"node-resolver-xcw84\" (UID: \"28296891-3ba9-42dc-9f47-e0110ddcb960\") " pod="openshift-dns/node-resolver-xcw84"
Jul 06 23:48:41.813329 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813201    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-system-cni-dir\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813329 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813225    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-var-lib-cni-bin\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813329 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813247    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-run-multus-certs\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813329 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813274    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2fefbec-278c-47e1-aada-83160d9bcefc-host-slash\") pod \"iptables-alerter-jhw9l\" (UID: \"d2fefbec-278c-47e1-aada-83160d9bcefc\") " pod="openshift-network-operator/iptables-alerter-jhw9l"
Jul 06 23:48:41.813329 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkb9v\" (UniqueName: \"kubernetes.io/projected/28296891-3ba9-42dc-9f47-e0110ddcb960-kube-api-access-pkb9v\") pod \"node-resolver-xcw84\" (UID: \"28296891-3ba9-42dc-9f47-e0110ddcb960\") " pod="openshift-dns/node-resolver-xcw84"
Jul 06 23:48:41.813329 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813321    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969-agent-certs\") pod \"konnectivity-agent-5xx98\" (UID: \"f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969\") " pod="kube-system/konnectivity-agent-5xx98"
Jul 06 23:48:41.813780 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813342    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969-konnectivity-ca\") pod \"konnectivity-agent-5xx98\" (UID: \"f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969\") " pod="kube-system/konnectivity-agent-5xx98"
Jul 06 23:48:41.813780 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-os-release\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813780 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813402    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-cni-binary-copy\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813780 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-run-netns\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.813780 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2fefbec-278c-47e1-aada-83160d9bcefc-iptables-alerter-script\") pod \"iptables-alerter-jhw9l\" (UID: \"d2fefbec-278c-47e1-aada-83160d9bcefc\") " pod="openshift-network-operator/iptables-alerter-jhw9l"
Jul 06 23:48:41.813780 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813519    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf2kw\" (UniqueName: \"kubernetes.io/projected/d2fefbec-278c-47e1-aada-83160d9bcefc-kube-api-access-bf2kw\") pod \"iptables-alerter-jhw9l\" (UID: \"d2fefbec-278c-47e1-aada-83160d9bcefc\") " pod="openshift-network-operator/iptables-alerter-jhw9l"
Jul 06 23:48:41.813780 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813551    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/28296891-3ba9-42dc-9f47-e0110ddcb960-hosts-file\") pod \"node-resolver-xcw84\" (UID: \"28296891-3ba9-42dc-9f47-e0110ddcb960\") " pod="openshift-dns/node-resolver-xcw84"
Jul 06 23:48:41.813780 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813686    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:41.813780 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813716    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 23:48:41.814026 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.813687    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 23:48:41.814472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.814458    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zrwzl\""
Jul 06 23:48:41.814829 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.814815    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 23:48:41.815571 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.815557    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.816068 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.816051    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vn7cp\""
Jul 06 23:48:41.816189 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.816175    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 23:48:41.816232 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.816200    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 23:48:41.817366 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.817341    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:41.817456 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:41.817419    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:48:41.818507 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.818489    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:41.818580 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:41.818553    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:48:41.820181 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.820161    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.820257 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.820235    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 23:48:41.820576 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.820560    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 23:48:41.820651 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.820619    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 23:48:41.820947 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.820934    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9gc2j\""
Jul 06 23:48:41.820990 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.820950    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 23:48:41.821144 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.821131    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 23:48:41.821197 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.821147    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 23:48:41.824087 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.824069    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 23:48:41.824179 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.824099    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:48:41.824806 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.824612    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wdjr5\""
Jul 06 23:48:41.824806 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.824719    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:48:41.854009 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.853986    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4csfg"
Jul 06 23:48:41.865827 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.865761    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 23:43:41 +0000 UTC" deadline="2028-02-07 13:01:48.469900109 +0000 UTC"
Jul 06 23:48:41.865827 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.865818    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4csfg"
Jul 06 23:48:41.866026 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.865822    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13933h13m6.604082347s"
Jul 06 23:48:41.867201 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:41.867173    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09305b88f1373ed8937b4f40e869c133.slice/crio-c1b76fbfd5578687d1a0bdc836d877e9185df107c9c08352dee75aebbfbbabef WatchSource:0}: Error finding container c1b76fbfd5578687d1a0bdc836d877e9185df107c9c08352dee75aebbfbbabef: Status 404 returned error can't find the container with id c1b76fbfd5578687d1a0bdc836d877e9185df107c9c08352dee75aebbfbbabef
Jul 06 23:48:41.867448 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:41.867428    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff5104d7452b5ed4a3bf2742a0cf695.slice/crio-8379f52a454903e605e82234c9bded63f406b5c33f489e06d71abd159ba42442 WatchSource:0}: Error finding container 8379f52a454903e605e82234c9bded63f406b5c33f489e06d71abd159ba42442: Status 404 returned error can't find the container with id 8379f52a454903e605e82234c9bded63f406b5c33f489e06d71abd159ba42442
Jul 06 23:48:41.872239 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.872222    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:48:41.907125 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.907107    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 23:48:41.914591 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p2jg\" (UniqueName: \"kubernetes.io/projected/b0393c1e-c38d-42ef-84b7-8961533ec21e-kube-api-access-7p2jg\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:41.914695 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914598    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:41.914695 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2fefbec-278c-47e1-aada-83160d9bcefc-host-slash\") pod \"iptables-alerter-jhw9l\" (UID: \"d2fefbec-278c-47e1-aada-83160d9bcefc\") " pod="openshift-network-operator/iptables-alerter-jhw9l"
Jul 06 23:48:41.914695 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-cni-binary-copy\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.914695 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914652    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6zfr\" (UniqueName: \"kubernetes.io/projected/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-kube-api-access-h6zfr\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.914873 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914694    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-socket-dir\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:41.914873 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-run-ovn-kubernetes\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.914873 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914701    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2fefbec-278c-47e1-aada-83160d9bcefc-host-slash\") pod \"iptables-alerter-jhw9l\" (UID: \"d2fefbec-278c-47e1-aada-83160d9bcefc\") " pod="openshift-network-operator/iptables-alerter-jhw9l"
Jul 06 23:48:41.914873 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzzzs\" (UniqueName: \"kubernetes.io/projected/09adca1e-8a8a-4783-b288-a30f9684cad3-kube-api-access-mzzzs\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.914873 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-modprobe-d\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.914873 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-kubernetes\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.914873 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914852    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-sysctl-d\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.915109 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914887    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-system-cni-dir\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:41.915109 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914911    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-etc-openvswitch\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.915109 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-run-ovn\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.915109 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09adca1e-8a8a-4783-b288-a30f9684cad3-ovnkube-script-lib\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.915109 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914964    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-run\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.915109 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.914985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-lib-modules\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.915109 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-systemd-units\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.915109 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915030    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-log-socket\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.915109 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28296891-3ba9-42dc-9f47-e0110ddcb960-tmp-dir\") pod \"node-resolver-xcw84\" (UID: \"28296891-3ba9-42dc-9f47-e0110ddcb960\") " pod="openshift-dns/node-resolver-xcw84"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915156    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e9d8dde-b75c-4dae-a138-907264e30af5-tmp\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915191    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/757798e0-4584-4a4c-98b5-29850f23a541-serviceca\") pod \"node-ca-79fgn\" (UID: \"757798e0-4584-4a4c-98b5-29850f23a541\") " pod="openshift-image-registry/node-ca-79fgn"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915221    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-cnibin\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915249    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-cni-netd\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969-agent-certs\") pod \"konnectivity-agent-5xx98\" (UID: \"f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969\") " pod="kube-system/konnectivity-agent-5xx98"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-systemd\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915323    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhf8p\" (UniqueName: \"kubernetes.io/projected/757798e0-4584-4a4c-98b5-29850f23a541-kube-api-access-rhf8p\") pod \"node-ca-79fgn\" (UID: \"757798e0-4584-4a4c-98b5-29850f23a541\") " pod="openshift-image-registry/node-ca-79fgn"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915346    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-kubelet\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915247    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-cni-binary-copy\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915360    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28296891-3ba9-42dc-9f47-e0110ddcb960-tmp-dir\") pod \"node-resolver-xcw84\" (UID: \"28296891-3ba9-42dc-9f47-e0110ddcb960\") " pod="openshift-dns/node-resolver-xcw84"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915368    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-run-netns\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2kw\" (UniqueName: \"kubernetes.io/projected/d2fefbec-278c-47e1-aada-83160d9bcefc-kube-api-access-bf2kw\") pod \"iptables-alerter-jhw9l\" (UID: \"d2fefbec-278c-47e1-aada-83160d9bcefc\") " pod="openshift-network-operator/iptables-alerter-jhw9l"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-sysctl-conf\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.915472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915454    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/55651bcb-05d0-4904-8609-c8c57720ad7f-dbus\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09adca1e-8a8a-4783-b288-a30f9684cad3-env-overrides\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09adca1e-8a8a-4783-b288-a30f9684cad3-ovn-node-metrics-cert\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915602    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915607    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-system-cni-dir\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915659    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-system-cni-dir\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-var-lib-cni-bin\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-run-multus-certs\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-etc-selinux\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915728    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkb9v\" (UniqueName: \"kubernetes.io/projected/28296891-3ba9-42dc-9f47-e0110ddcb960-kube-api-access-pkb9v\") pod \"node-resolver-xcw84\" (UID: \"28296891-3ba9-42dc-9f47-e0110ddcb960\") " pod="openshift-dns/node-resolver-xcw84"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969-konnectivity-ca\") pod \"konnectivity-agent-5xx98\" (UID: \"f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969\") " pod="kube-system/konnectivity-agent-5xx98"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/55651bcb-05d0-4904-8609-c8c57720ad7f-kubelet-config\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915792    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-slash\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915796    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-run-multus-certs\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915797    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-var-lib-cni-bin\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915864    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/28296891-3ba9-42dc-9f47-e0110ddcb960-hosts-file\") pod \"node-resolver-xcw84\" (UID: \"28296891-3ba9-42dc-9f47-e0110ddcb960\") " pod="openshift-dns/node-resolver-xcw84"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-multus-daemon-config\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-sys\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915931    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/28296891-3ba9-42dc-9f47-e0110ddcb960-hosts-file\") pod \"node-resolver-xcw84\" (UID: \"28296891-3ba9-42dc-9f47-e0110ddcb960\") " pod="openshift-dns/node-resolver-xcw84"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-device-dir\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.915968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-sys-fs\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916027    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4x5d\" (UniqueName: \"kubernetes.io/projected/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-kube-api-access-x4x5d\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916058    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916083    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-cnibin\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-var-lib-cni-multus\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-hostroot\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916144    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-var-lib-cni-multus\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916149    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-cnibin\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-etc-kubernetes\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916170    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-hostroot\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916188    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-etc-kubernetes\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.916643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916192    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-tuned\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww4wg\" (UniqueName: \"kubernetes.io/projected/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-kube-api-access-ww4wg\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916244    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969-konnectivity-ca\") pod \"konnectivity-agent-5xx98\" (UID: \"f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969\") " pod="kube-system/konnectivity-agent-5xx98"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-run-systemd\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916279    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-var-lib-openvswitch\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916302    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-multus-daemon-config\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjh6d\" (UniqueName: \"kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d\") pod \"network-check-target-tqk7j\" (UID: \"c6e46718-e6a2-41b9-8a52-c755a8a078b3\") " pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916339    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-os-release\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-run-openvswitch\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-cni-bin\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-os-release\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-run-netns\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916540    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-os-release\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916588    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-run-netns\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916661    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-var-lib-kubelet\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916686    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qkcf\" (UniqueName: \"kubernetes.io/projected/8e9d8dde-b75c-4dae-a138-907264e30af5-kube-api-access-7qkcf\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.917222 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916705    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/757798e0-4584-4a4c-98b5-29850f23a541-host\") pod \"node-ca-79fgn\" (UID: \"757798e0-4584-4a4c-98b5-29850f23a541\") " pod="openshift-image-registry/node-ca-79fgn"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916726    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916765    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-node-log\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916794    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2fefbec-278c-47e1-aada-83160d9bcefc-iptables-alerter-script\") pod \"iptables-alerter-jhw9l\" (UID: \"d2fefbec-278c-47e1-aada-83160d9bcefc\") " pod="openshift-network-operator/iptables-alerter-jhw9l"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916819    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-multus-conf-dir\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-host\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916868    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09adca1e-8a8a-4783-b288-a30f9684cad3-ovnkube-config\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916887    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-multus-conf-dir\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-multus-cni-dir\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-multus-socket-dir-parent\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-run-k8s-cni-cncf-io\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-var-lib-kubelet\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.916997    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-sysconfig\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.917009    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-multus-socket-dir-parent\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.917021    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-run-k8s-cni-cncf-io\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.917037    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-multus-cni-dir\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.917020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:41.917686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.917058    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-host-var-lib-kubelet\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.918184 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.917094    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-registration-dir\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:41.918184 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.917250    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2fefbec-278c-47e1-aada-83160d9bcefc-iptables-alerter-script\") pod \"iptables-alerter-jhw9l\" (UID: \"d2fefbec-278c-47e1-aada-83160d9bcefc\") " pod="openshift-network-operator/iptables-alerter-jhw9l"
Jul 06 23:48:41.918959 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.918936    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969-agent-certs\") pod \"konnectivity-agent-5xx98\" (UID: \"f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969\") " pod="kube-system/konnectivity-agent-5xx98"
Jul 06 23:48:41.926468 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.926441    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6zfr\" (UniqueName: \"kubernetes.io/projected/f03b751f-f0aa-4259-b5ca-0b3dafa918ce-kube-api-access-h6zfr\") pod \"multus-fmxjt\" (UID: \"f03b751f-f0aa-4259-b5ca-0b3dafa918ce\") " pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:41.929132 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.929108    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkb9v\" (UniqueName: \"kubernetes.io/projected/28296891-3ba9-42dc-9f47-e0110ddcb960-kube-api-access-pkb9v\") pod \"node-resolver-xcw84\" (UID: \"28296891-3ba9-42dc-9f47-e0110ddcb960\") " pod="openshift-dns/node-resolver-xcw84"
Jul 06 23:48:41.929254 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.929224    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf2kw\" (UniqueName: \"kubernetes.io/projected/d2fefbec-278c-47e1-aada-83160d9bcefc-kube-api-access-bf2kw\") pod \"iptables-alerter-jhw9l\" (UID: \"d2fefbec-278c-47e1-aada-83160d9bcefc\") " pod="openshift-network-operator/iptables-alerter-jhw9l"
Jul 06 23:48:41.957679 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.957646    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:48:41.962108 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.962061    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal" event={"ID":"eff5104d7452b5ed4a3bf2742a0cf695","Type":"ContainerStarted","Data":"8379f52a454903e605e82234c9bded63f406b5c33f489e06d71abd159ba42442"}
Jul 06 23:48:41.965726 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:41.965694    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" event={"ID":"09305b88f1373ed8937b4f40e869c133","Type":"ContainerStarted","Data":"c1b76fbfd5578687d1a0bdc836d877e9185df107c9c08352dee75aebbfbbabef"}
Jul 06 23:48:42.018212 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018169    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-var-lib-kubelet\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.018212 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qkcf\" (UniqueName: \"kubernetes.io/projected/8e9d8dde-b75c-4dae-a138-907264e30af5-kube-api-access-7qkcf\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018233    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/757798e0-4584-4a4c-98b5-29850f23a541-host\") pod \"node-ca-79fgn\" (UID: \"757798e0-4584-4a4c-98b5-29850f23a541\") " pod="openshift-image-registry/node-ca-79fgn"
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-node-log\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018298    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-host\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09adca1e-8a8a-4783-b288-a30f9684cad3-ovnkube-config\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018330    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/757798e0-4584-4a4c-98b5-29850f23a541-host\") pod \"node-ca-79fgn\" (UID: \"757798e0-4584-4a4c-98b5-29850f23a541\") " pod="openshift-image-registry/node-ca-79fgn"
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018354    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-node-log\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018340    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-sysconfig\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018388    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-sysconfig\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018397    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-host\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018319    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-var-lib-kubelet\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.018404    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:48:42.018452 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018456    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018487    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-registration-dir\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-registration-dir\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.018554    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret podName:55651bcb-05d0-4904-8609-c8c57720ad7f nodeName:}" failed. No retries permitted until 2026-07-06 23:48:42.51851557 +0000 UTC m=+2.125943597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret") pod "global-pull-secret-syncer-cllp6" (UID: "55651bcb-05d0-4904-8609-c8c57720ad7f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018594    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2jg\" (UniqueName: \"kubernetes.io/projected/b0393c1e-c38d-42ef-84b7-8961533ec21e-kube-api-access-7p2jg\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-socket-dir\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018677    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-run-ovn-kubernetes\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018699    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzzzs\" (UniqueName: \"kubernetes.io/projected/09adca1e-8a8a-4783-b288-a30f9684cad3-kube-api-access-mzzzs\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018771    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-run-ovn-kubernetes\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-modprobe-d\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018851    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-socket-dir\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018859    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-kubernetes\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018883    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-sysctl-d\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-system-cni-dir\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-etc-openvswitch\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.019078 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-run-ovn\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09adca1e-8a8a-4783-b288-a30f9684cad3-ovnkube-script-lib\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.018987    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09adca1e-8a8a-4783-b288-a30f9684cad3-ovnkube-config\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-run\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019033    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-lib-modules\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019060    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-run\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-systemd-units\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019084    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-system-cni-dir\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019100    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-systemd-units\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019133    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-etc-openvswitch\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019183    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-sysctl-d\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019192    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-modprobe-d\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019202    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-run-ovn\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-log-socket\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e9d8dde-b75c-4dae-a138-907264e30af5-tmp\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019266    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-log-socket\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/757798e0-4584-4a4c-98b5-29850f23a541-serviceca\") pod \"node-ca-79fgn\" (UID: \"757798e0-4584-4a4c-98b5-29850f23a541\") " pod="openshift-image-registry/node-ca-79fgn"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019236    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.019791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019320    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-lib-modules\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019253    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-kubernetes\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-cnibin\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019360    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-cnibin\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019361    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-cni-netd\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019392    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-cni-netd\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-systemd\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhf8p\" (UniqueName: \"kubernetes.io/projected/757798e0-4584-4a4c-98b5-29850f23a541-kube-api-access-rhf8p\") pod \"node-ca-79fgn\" (UID: \"757798e0-4584-4a4c-98b5-29850f23a541\") " pod="openshift-image-registry/node-ca-79fgn"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-kubelet\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019441    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-systemd\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-run-netns\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019475    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-run-netns\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019498    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-kubelet\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019555    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09adca1e-8a8a-4783-b288-a30f9684cad3-ovnkube-script-lib\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-sysctl-conf\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019629    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.020518 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/55651bcb-05d0-4904-8609-c8c57720ad7f-dbus\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019685    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/757798e0-4584-4a4c-98b5-29850f23a541-serviceca\") pod \"node-ca-79fgn\" (UID: \"757798e0-4584-4a4c-98b5-29850f23a541\") " pod="openshift-image-registry/node-ca-79fgn"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09adca1e-8a8a-4783-b288-a30f9684cad3-env-overrides\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019770    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-sysctl-conf\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09adca1e-8a8a-4783-b288-a30f9684cad3-ovn-node-metrics-cert\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019816    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-etc-selinux\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019830    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/55651bcb-05d0-4904-8609-c8c57720ad7f-dbus\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/55651bcb-05d0-4904-8609-c8c57720ad7f-kubelet-config\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019880    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-slash\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019919    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-etc-selinux\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-sys\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019935    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/55651bcb-05d0-4904-8609-c8c57720ad7f-kubelet-config\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-device-dir\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019963    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-slash\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.019996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-sys-fs\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020017    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e9d8dde-b75c-4dae-a138-907264e30af5-sys\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.021150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4x5d\" (UniqueName: \"kubernetes.io/projected/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-kube-api-access-x4x5d\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020062    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-device-dir\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020096    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-tuned\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020120    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww4wg\" (UniqueName: \"kubernetes.io/projected/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-kube-api-access-ww4wg\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020124    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-sys-fs\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020145    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-run-systemd\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020174    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020223    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-run-systemd\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020246    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.020277    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.020334    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs podName:b0393c1e-c38d-42ef-84b7-8961533ec21e nodeName:}" failed. No retries permitted until 2026-07-06 23:48:42.520315456 +0000 UTC m=+2.127743474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs") pod "network-metrics-daemon-sz2ws" (UID: "b0393c1e-c38d-42ef-84b7-8961533ec21e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020377    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09adca1e-8a8a-4783-b288-a30f9684cad3-env-overrides\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-var-lib-openvswitch\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjh6d\" (UniqueName: \"kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d\") pod \"network-check-target-tqk7j\" (UID: \"c6e46718-e6a2-41b9-8a52-c755a8a078b3\") " pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:42.021678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-os-release\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.022230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020566    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-var-lib-openvswitch\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.022230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.022230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-run-openvswitch\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.022230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-cni-bin\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.022230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020641    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-os-release\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.022230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020762    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-host-cni-bin\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.022230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020832    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.022230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.020901    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09adca1e-8a8a-4783-b288-a30f9684cad3-run-openvswitch\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.022230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.022191    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e9d8dde-b75c-4dae-a138-907264e30af5-tmp\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.022487 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.022441    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09adca1e-8a8a-4783-b288-a30f9684cad3-ovn-node-metrics-cert\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.022627 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.022593    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e9d8dde-b75c-4dae-a138-907264e30af5-etc-tuned\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.034335 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.034307    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qkcf\" (UniqueName: \"kubernetes.io/projected/8e9d8dde-b75c-4dae-a138-907264e30af5-kube-api-access-7qkcf\") pod \"tuned-g8dq4\" (UID: \"8e9d8dde-b75c-4dae-a138-907264e30af5\") " pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.042430 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.042402    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:48:42.042430 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.042431    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:48:42.042574 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.042444    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjh6d for pod openshift-network-diagnostics/network-check-target-tqk7j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:48:42.042574 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.042515    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d podName:c6e46718-e6a2-41b9-8a52-c755a8a078b3 nodeName:}" failed. No retries permitted until 2026-07-06 23:48:42.542496697 +0000 UTC m=+2.149924707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zjh6d" (UniqueName: "kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d") pod "network-check-target-tqk7j" (UID: "c6e46718-e6a2-41b9-8a52-c755a8a078b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:48:42.042729 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.042706    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2jg\" (UniqueName: \"kubernetes.io/projected/b0393c1e-c38d-42ef-84b7-8961533ec21e-kube-api-access-7p2jg\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:42.042799 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.042783    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzzzs\" (UniqueName: \"kubernetes.io/projected/09adca1e-8a8a-4783-b288-a30f9684cad3-kube-api-access-mzzzs\") pod \"ovnkube-node-fltzc\" (UID: \"09adca1e-8a8a-4783-b288-a30f9684cad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.043918 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.043898    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhf8p\" (UniqueName: \"kubernetes.io/projected/757798e0-4584-4a4c-98b5-29850f23a541-kube-api-access-rhf8p\") pod \"node-ca-79fgn\" (UID: \"757798e0-4584-4a4c-98b5-29850f23a541\") " pod="openshift-image-registry/node-ca-79fgn"
Jul 06 23:48:42.044548 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.044532    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4x5d\" (UniqueName: \"kubernetes.io/projected/5caebe6e-6e44-4eee-b28b-ec5a139a61c0-kube-api-access-x4x5d\") pod \"multus-additional-cni-plugins-ms9ns\" (UID: \"5caebe6e-6e44-4eee-b28b-ec5a139a61c0\") " pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.045215 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.045184    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww4wg\" (UniqueName: \"kubernetes.io/projected/200bf8da-53f0-4fa9-9e20-c0ee57203ca8-kube-api-access-ww4wg\") pod \"aws-ebs-csi-driver-node-vfbtd\" (UID: \"200bf8da-53f0-4fa9-9e20-c0ee57203ca8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.054118 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.054099    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:48:42.135728 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.135634    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jhw9l"
Jul 06 23:48:42.144836 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:42.144795    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2fefbec_278c_47e1_aada_83160d9bcefc.slice/crio-df1bed8c0b3b6a66f0f16973952f615c9fa9ad233af8f03eaf2abe3ce2b00d08 WatchSource:0}: Error finding container df1bed8c0b3b6a66f0f16973952f615c9fa9ad233af8f03eaf2abe3ce2b00d08: Status 404 returned error can't find the container with id df1bed8c0b3b6a66f0f16973952f615c9fa9ad233af8f03eaf2abe3ce2b00d08
Jul 06 23:48:42.151374 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.151352    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xcw84"
Jul 06 23:48:42.159665 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:42.159639    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28296891_3ba9_42dc_9f47_e0110ddcb960.slice/crio-5042387a193fd507c84c0a29fafdf6c2dcc2d384e88b14202f9d7dc525ecedf2 WatchSource:0}: Error finding container 5042387a193fd507c84c0a29fafdf6c2dcc2d384e88b14202f9d7dc525ecedf2: Status 404 returned error can't find the container with id 5042387a193fd507c84c0a29fafdf6c2dcc2d384e88b14202f9d7dc525ecedf2
Jul 06 23:48:42.169928 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.169897    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5xx98"
Jul 06 23:48:42.179651 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.179617    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fmxjt"
Jul 06 23:48:42.180002 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:42.179981    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6bcd6b2_9f4b_4cb0_a13b_50c0e55a4969.slice/crio-a09c05d7a38e244771b3445580bbb523bffe561e912f70107be8b593ba61482e WatchSource:0}: Error finding container a09c05d7a38e244771b3445580bbb523bffe561e912f70107be8b593ba61482e: Status 404 returned error can't find the container with id a09c05d7a38e244771b3445580bbb523bffe561e912f70107be8b593ba61482e
Jul 06 23:48:42.184791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.184766    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd"
Jul 06 23:48:42.188028 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:42.188004    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03b751f_f0aa_4259_b5ca_0b3dafa918ce.slice/crio-bcd5df511082d2ffde752d0b617e240cc8308f6c3d46270b83b77f5432138175 WatchSource:0}: Error finding container bcd5df511082d2ffde752d0b617e240cc8308f6c3d46270b83b77f5432138175: Status 404 returned error can't find the container with id bcd5df511082d2ffde752d0b617e240cc8308f6c3d46270b83b77f5432138175
Jul 06 23:48:42.189962 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.189947    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-79fgn"
Jul 06 23:48:42.193343 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:42.193317    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200bf8da_53f0_4fa9_9e20_c0ee57203ca8.slice/crio-f09db44540a4b4feb2c19ba1f687376612599e10c2a44842c65bfe3cb51f11f0 WatchSource:0}: Error finding container f09db44540a4b4feb2c19ba1f687376612599e10c2a44842c65bfe3cb51f11f0: Status 404 returned error can't find the container with id f09db44540a4b4feb2c19ba1f687376612599e10c2a44842c65bfe3cb51f11f0
Jul 06 23:48:42.196443 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.196426    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ms9ns"
Jul 06 23:48:42.198448 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:42.198428    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod757798e0_4584_4a4c_98b5_29850f23a541.slice/crio-8b51a765f48c51c24819549d4492aab82bbb88d9196da331c8ecf0fced6a466f WatchSource:0}: Error finding container 8b51a765f48c51c24819549d4492aab82bbb88d9196da331c8ecf0fced6a466f: Status 404 returned error can't find the container with id 8b51a765f48c51c24819549d4492aab82bbb88d9196da331c8ecf0fced6a466f
Jul 06 23:48:42.201270 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.201243    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:48:42.205684 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:42.205661    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5caebe6e_6e44_4eee_b28b_ec5a139a61c0.slice/crio-f5f6955b75edc25d15e62c7ad802d910b0a291c714adf36aa6ad46cf07ae5aef WatchSource:0}: Error finding container f5f6955b75edc25d15e62c7ad802d910b0a291c714adf36aa6ad46cf07ae5aef: Status 404 returned error can't find the container with id f5f6955b75edc25d15e62c7ad802d910b0a291c714adf36aa6ad46cf07ae5aef
Jul 06 23:48:42.205788 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.205743    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g8dq4"
Jul 06 23:48:42.211157 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:42.211132    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09adca1e_8a8a_4783_b288_a30f9684cad3.slice/crio-d3145bb6c4434caeca622f9f6326437f33fb6939c88b6220873d72285675a941 WatchSource:0}: Error finding container d3145bb6c4434caeca622f9f6326437f33fb6939c88b6220873d72285675a941: Status 404 returned error can't find the container with id d3145bb6c4434caeca622f9f6326437f33fb6939c88b6220873d72285675a941
Jul 06 23:48:42.215744 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:48:42.215722    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e9d8dde_b75c_4dae_a138_907264e30af5.slice/crio-ff1a54e953658284d621b580c875747c699ce37af4e7f43335ea014bdc5b9789 WatchSource:0}: Error finding container ff1a54e953658284d621b580c875747c699ce37af4e7f43335ea014bdc5b9789: Status 404 returned error can't find the container with id ff1a54e953658284d621b580c875747c699ce37af4e7f43335ea014bdc5b9789
Jul 06 23:48:42.526758 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.525879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:42.526758 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.525961    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:42.526758 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.526126    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:48:42.526758 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.526223    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret podName:55651bcb-05d0-4904-8609-c8c57720ad7f nodeName:}" failed. No retries permitted until 2026-07-06 23:48:43.526176294 +0000 UTC m=+3.133604288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret") pod "global-pull-secret-syncer-cllp6" (UID: "55651bcb-05d0-4904-8609-c8c57720ad7f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:48:42.526758 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.526633    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:48:42.526758 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.526681    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs podName:b0393c1e-c38d-42ef-84b7-8961533ec21e nodeName:}" failed. No retries permitted until 2026-07-06 23:48:43.526665457 +0000 UTC m=+3.134093450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs") pod "network-metrics-daemon-sz2ws" (UID: "b0393c1e-c38d-42ef-84b7-8961533ec21e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:48:42.626660 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.626615    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjh6d\" (UniqueName: \"kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d\") pod \"network-check-target-tqk7j\" (UID: \"c6e46718-e6a2-41b9-8a52-c755a8a078b3\") " pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:42.626906 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.626836    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:48:42.626906 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.626863    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:48:42.626906 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.626880    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjh6d for pod openshift-network-diagnostics/network-check-target-tqk7j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:48:42.627151 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:42.626946    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d podName:c6e46718-e6a2-41b9-8a52-c755a8a078b3 nodeName:}" failed. No retries permitted until 2026-07-06 23:48:43.626926426 +0000 UTC m=+3.234354456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjh6d" (UniqueName: "kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d") pod "network-check-target-tqk7j" (UID: "c6e46718-e6a2-41b9-8a52-c755a8a078b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:48:42.767473 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.767228    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:48:42.869500 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.869271    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:43:42 +0000 UTC" deadline="2028-01-07 08:23:54.510745191 +0000 UTC"
Jul 06 23:48:42.869500 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.869334    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13184h35m11.641415856s"
Jul 06 23:48:42.977119 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.977070    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc" event={"ID":"09adca1e-8a8a-4783-b288-a30f9684cad3","Type":"ContainerStarted","Data":"d3145bb6c4434caeca622f9f6326437f33fb6939c88b6220873d72285675a941"}
Jul 06 23:48:42.986892 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:42.986847    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-79fgn" event={"ID":"757798e0-4584-4a4c-98b5-29850f23a541","Type":"ContainerStarted","Data":"8b51a765f48c51c24819549d4492aab82bbb88d9196da331c8ecf0fced6a466f"}
Jul 06 23:48:43.022601 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.022086    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fmxjt" event={"ID":"f03b751f-f0aa-4259-b5ca-0b3dafa918ce","Type":"ContainerStarted","Data":"bcd5df511082d2ffde752d0b617e240cc8308f6c3d46270b83b77f5432138175"}
Jul 06 23:48:43.040945 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.040903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xcw84" event={"ID":"28296891-3ba9-42dc-9f47-e0110ddcb960","Type":"ContainerStarted","Data":"5042387a193fd507c84c0a29fafdf6c2dcc2d384e88b14202f9d7dc525ecedf2"}
Jul 06 23:48:43.063050 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.062963    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jhw9l" event={"ID":"d2fefbec-278c-47e1-aada-83160d9bcefc","Type":"ContainerStarted","Data":"df1bed8c0b3b6a66f0f16973952f615c9fa9ad233af8f03eaf2abe3ce2b00d08"}
Jul 06 23:48:43.100274 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.100228    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g8dq4" event={"ID":"8e9d8dde-b75c-4dae-a138-907264e30af5","Type":"ContainerStarted","Data":"ff1a54e953658284d621b580c875747c699ce37af4e7f43335ea014bdc5b9789"}
Jul 06 23:48:43.110188 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.110140    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms9ns" event={"ID":"5caebe6e-6e44-4eee-b28b-ec5a139a61c0","Type":"ContainerStarted","Data":"f5f6955b75edc25d15e62c7ad802d910b0a291c714adf36aa6ad46cf07ae5aef"}
Jul 06 23:48:43.123950 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.123834    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd" event={"ID":"200bf8da-53f0-4fa9-9e20-c0ee57203ca8","Type":"ContainerStarted","Data":"f09db44540a4b4feb2c19ba1f687376612599e10c2a44842c65bfe3cb51f11f0"}
Jul 06 23:48:43.155631 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.155525    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5xx98" event={"ID":"f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969","Type":"ContainerStarted","Data":"a09c05d7a38e244771b3445580bbb523bffe561e912f70107be8b593ba61482e"}
Jul 06 23:48:43.536927 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.536861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:43.537134 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.536948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:43.537134 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:43.537095    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:48:43.537254 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:43.537161    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret podName:55651bcb-05d0-4904-8609-c8c57720ad7f nodeName:}" failed. No retries permitted until 2026-07-06 23:48:45.537142366 +0000 UTC m=+5.144570374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret") pod "global-pull-secret-syncer-cllp6" (UID: "55651bcb-05d0-4904-8609-c8c57720ad7f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:48:43.537254 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:43.537232    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:48:43.537366 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:43.537264    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs podName:b0393c1e-c38d-42ef-84b7-8961533ec21e nodeName:}" failed. No retries permitted until 2026-07-06 23:48:45.537252875 +0000 UTC m=+5.144680881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs") pod "network-metrics-daemon-sz2ws" (UID: "b0393c1e-c38d-42ef-84b7-8961533ec21e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:48:43.637956 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.637909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjh6d\" (UniqueName: \"kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d\") pod \"network-check-target-tqk7j\" (UID: \"c6e46718-e6a2-41b9-8a52-c755a8a078b3\") " pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:43.638165 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:43.638138    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:48:43.638165 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:43.638165    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:48:43.638311 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:43.638178    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjh6d for pod openshift-network-diagnostics/network-check-target-tqk7j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:48:43.638311 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:43.638237    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d podName:c6e46718-e6a2-41b9-8a52-c755a8a078b3 nodeName:}" failed. No retries permitted until 2026-07-06 23:48:45.638218822 +0000 UTC m=+5.245646818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjh6d" (UniqueName: "kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d") pod "network-check-target-tqk7j" (UID: "c6e46718-e6a2-41b9-8a52-c755a8a078b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:48:43.870534 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.870419    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:43:42 +0000 UTC" deadline="2028-02-21 07:53:18.250559769 +0000 UTC"
Jul 06 23:48:43.870534 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.870479    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14264h4m34.38008603s"
Jul 06 23:48:43.958644 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.958609    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:43.958860 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:43.958719    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:48:43.959125 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.959106    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:43.959213 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:43.959188    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:48:43.959283 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:43.959269    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:43.959359 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:43.959344    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:48:44.246791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:44.246742    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:48:45.558034 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:45.557182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:45.558034 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:45.557271    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:45.558034 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:45.557424    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:48:45.558034 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:45.557494    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret podName:55651bcb-05d0-4904-8609-c8c57720ad7f nodeName:}" failed. No retries permitted until 2026-07-06 23:48:49.557471668 +0000 UTC m=+9.164899664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret") pod "global-pull-secret-syncer-cllp6" (UID: "55651bcb-05d0-4904-8609-c8c57720ad7f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:48:45.558034 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:45.557940    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:48:45.558034 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:45.557994    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs podName:b0393c1e-c38d-42ef-84b7-8961533ec21e nodeName:}" failed. No retries permitted until 2026-07-06 23:48:49.557977067 +0000 UTC m=+9.165405064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs") pod "network-metrics-daemon-sz2ws" (UID: "b0393c1e-c38d-42ef-84b7-8961533ec21e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:48:45.658014 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:45.657949    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjh6d\" (UniqueName: \"kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d\") pod \"network-check-target-tqk7j\" (UID: \"c6e46718-e6a2-41b9-8a52-c755a8a078b3\") " pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:45.658224 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:45.658143    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:48:45.658224 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:45.658168    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:48:45.658224 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:45.658182    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjh6d for pod openshift-network-diagnostics/network-check-target-tqk7j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:48:45.658409 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:45.658244    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d podName:c6e46718-e6a2-41b9-8a52-c755a8a078b3 nodeName:}" failed. No retries permitted until 2026-07-06 23:48:49.658224906 +0000 UTC m=+9.265652922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjh6d" (UniqueName: "kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d") pod "network-check-target-tqk7j" (UID: "c6e46718-e6a2-41b9-8a52-c755a8a078b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:48:45.958505 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:45.958454    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:45.958714 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:45.958602    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:48:45.958714 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:45.958666    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:45.958945 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:45.958738    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:48:45.958945 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:45.958805    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:45.958945 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:45.958893    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:48:47.959440 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:47.958886    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:47.959440 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:47.959015    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:48:47.959440 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:47.958900    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:47.959440 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:47.959104    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:48:47.959440 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:47.958894    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:47.959440 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:47.959161    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:48:49.592614 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:49.592350    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:49.593086 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:49.592690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:49.593086 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:49.592560    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:48:49.593086 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:49.592869    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret podName:55651bcb-05d0-4904-8609-c8c57720ad7f nodeName:}" failed. No retries permitted until 2026-07-06 23:48:57.592855698 +0000 UTC m=+17.200283687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret") pod "global-pull-secret-syncer-cllp6" (UID: "55651bcb-05d0-4904-8609-c8c57720ad7f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:48:49.593248 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:49.592818    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:48:49.593248 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:49.593175    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs podName:b0393c1e-c38d-42ef-84b7-8961533ec21e nodeName:}" failed. No retries permitted until 2026-07-06 23:48:57.593164938 +0000 UTC m=+17.200592927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs") pod "network-metrics-daemon-sz2ws" (UID: "b0393c1e-c38d-42ef-84b7-8961533ec21e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:48:49.693450 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:49.693415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjh6d\" (UniqueName: \"kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d\") pod \"network-check-target-tqk7j\" (UID: \"c6e46718-e6a2-41b9-8a52-c755a8a078b3\") " pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:49.693611 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:49.693567    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:48:49.693611 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:49.693591    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:48:49.693611 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:49.693603    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjh6d for pod openshift-network-diagnostics/network-check-target-tqk7j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:48:49.693774 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:49.693671    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d podName:c6e46718-e6a2-41b9-8a52-c755a8a078b3 nodeName:}" failed. No retries permitted until 2026-07-06 23:48:57.693653186 +0000 UTC m=+17.301081177 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjh6d" (UniqueName: "kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d") pod "network-check-target-tqk7j" (UID: "c6e46718-e6a2-41b9-8a52-c755a8a078b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:48:49.959406 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:49.958753    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:49.959406 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:49.958876    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:48:49.959406 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:49.959214    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:49.959406 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:49.959281    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:48:49.959406 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:49.959322    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:49.959406 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:49.959368    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:48:51.958670 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:51.957993    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:51.958670 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:51.958103    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:48:51.958670 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:51.958453    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:51.958670 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:51.958527    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:48:51.958670 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:51.958579    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:51.958670 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:51.958635    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:48:53.958412 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:53.958361    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:53.958938 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:53.958475    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:53.958938 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:53.958481    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:48:53.958938 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:53.958510    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:53.958938 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:53.958596    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:48:53.958938 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:53.958655    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:48:55.958322 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:55.958279    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:55.958322 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:55.958318    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:55.958894 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:55.958326    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:55.958894 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:55.958410    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:48:55.958894 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:55.958513    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:48:55.958894 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:55.958605    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:48:57.657055 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:57.657015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:57.657543 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:57.657087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:57.657543 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:57.657197    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:48:57.657543 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:57.657195    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:48:57.657543 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:57.657244    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs podName:b0393c1e-c38d-42ef-84b7-8961533ec21e nodeName:}" failed. No retries permitted until 2026-07-06 23:49:13.657231117 +0000 UTC m=+33.264659106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs") pod "network-metrics-daemon-sz2ws" (UID: "b0393c1e-c38d-42ef-84b7-8961533ec21e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:48:57.657543 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:57.657268    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret podName:55651bcb-05d0-4904-8609-c8c57720ad7f nodeName:}" failed. No retries permitted until 2026-07-06 23:49:13.657250833 +0000 UTC m=+33.264678827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret") pod "global-pull-secret-syncer-cllp6" (UID: "55651bcb-05d0-4904-8609-c8c57720ad7f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:48:57.757546 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:57.757505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjh6d\" (UniqueName: \"kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d\") pod \"network-check-target-tqk7j\" (UID: \"c6e46718-e6a2-41b9-8a52-c755a8a078b3\") " pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:57.757754 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:57.757706    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:48:57.757754 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:57.757733    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:48:57.757876 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:57.757764    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjh6d for pod openshift-network-diagnostics/network-check-target-tqk7j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:48:57.757876 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:57.757830    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d podName:c6e46718-e6a2-41b9-8a52-c755a8a078b3 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:13.757810915 +0000 UTC m=+33.365238958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjh6d" (UniqueName: "kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d") pod "network-check-target-tqk7j" (UID: "c6e46718-e6a2-41b9-8a52-c755a8a078b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:48:57.957935 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:57.957899    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:57.958120 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:57.957945    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:57.958120 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:57.958012    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:57.958120 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:57.958025    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:48:57.958268 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:57.958136    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:48:57.958268 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:57.958210    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:48:59.958179 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:59.958141    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:48:59.958645 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:59.958193    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:48:59.958645 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:48:59.958255    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:48:59.958645 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:59.958270    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:48:59.958645 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:59.958324    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:48:59.958645 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:48:59.958411    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:49:01.958171 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:01.958132    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:49:01.958171 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:01.958170    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:01.958713 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:01.958249    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:49:01.958713 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:01.958266    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:49:01.958713 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:01.958351    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:49:01.958713 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:01.958424    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:49:03.958726 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:03.958545    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:03.958726 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:03.958579    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:49:03.959532 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:03.958627    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:49:03.959532 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:03.958826    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:49:03.959532 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:03.958922    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:49:03.959532 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:03.959019    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:49:04.215355 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.215326    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 06 23:49:04.226733 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.226676    2582 generic.go:356] "Generic (PLEG): container finished" podID="09adca1e-8a8a-4783-b288-a30f9684cad3" containerID="f1082a0c93e719a86ac794724acd4a8cc3f32dbc15cc6546b25d45b03955985e" exitCode=1
Jul 06 23:49:04.226927 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.226785    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc" event={"ID":"09adca1e-8a8a-4783-b288-a30f9684cad3","Type":"ContainerStarted","Data":"fc4c8417fdd95aa99e32269b6facb8da2430d5daf51ad805c02a1abd5b413ae9"}
Jul 06 23:49:04.226927 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.226920    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc" event={"ID":"09adca1e-8a8a-4783-b288-a30f9684cad3","Type":"ContainerStarted","Data":"aec16145c01e909054322e354d13b4855505e595074bbaa80fed609bbfe8251e"}
Jul 06 23:49:04.227031 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.226973    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc" event={"ID":"09adca1e-8a8a-4783-b288-a30f9684cad3","Type":"ContainerStarted","Data":"5bfbdf65413b1f32d4ce5fbefb26cced1e1068ef4de45ae369dc6cbab1db8d58"}
Jul 06 23:49:04.227031 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.227021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc" event={"ID":"09adca1e-8a8a-4783-b288-a30f9684cad3","Type":"ContainerStarted","Data":"412e78fd3b5bcfe9c6a3cff1c164320a73b641e8ac2d113a264d8b17f828ce45"}
Jul 06 23:49:04.227115 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.227065    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc" event={"ID":"09adca1e-8a8a-4783-b288-a30f9684cad3","Type":"ContainerDied","Data":"f1082a0c93e719a86ac794724acd4a8cc3f32dbc15cc6546b25d45b03955985e"}
Jul 06 23:49:04.227115 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.227096    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc" event={"ID":"09adca1e-8a8a-4783-b288-a30f9684cad3","Type":"ContainerStarted","Data":"49949da3bc77d2543e35b402a5c072bd959411ccf3069df59c59934101d64b6b"}
Jul 06 23:49:04.229547 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.229520    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fmxjt" event={"ID":"f03b751f-f0aa-4259-b5ca-0b3dafa918ce","Type":"ContainerStarted","Data":"097632d6b8b22975f9abbdde37a930f4055f4d2959a488fbc18c47cff874d280"}
Jul 06 23:49:04.231027 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.231004    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal" event={"ID":"eff5104d7452b5ed4a3bf2742a0cf695","Type":"ContainerStarted","Data":"6276291d90957faed208c8a527bc5368555318b23a2808e53b20ea24cd799e88"}
Jul 06 23:49:04.232426 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.232407    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g8dq4" event={"ID":"8e9d8dde-b75c-4dae-a138-907264e30af5","Type":"ContainerStarted","Data":"17913e770b9bdc6fcbb374671054888e4a3720501c7c11544adb2a1f35da7506"}
Jul 06 23:49:04.259813 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.259758    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fmxjt" podStartSLOduration=2.228944061 podStartE2EDuration="23.259723408s" totalImagesPullingTime="21.030779347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:04.259214387 +0000 UTC m=+23.866642401" watchObservedRunningTime="2026-07-06 23:49:04.259723408 +0000 UTC m=+23.867151418"
Jul 06 23:49:04.282517 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.282462    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g8dq4" podStartSLOduration=2.341549038 podStartE2EDuration="23.282444942s" totalImagesPullingTime="20.940895904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:04.282123147 +0000 UTC m=+23.889551158" watchObservedRunningTime="2026-07-06 23:49:04.282444942 +0000 UTC m=+23.889872953"
Jul 06 23:49:04.299406 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:04.299358    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal" podStartSLOduration=22.299341467 podStartE2EDuration="22.299341467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:04.299256295 +0000 UTC m=+23.906684308" watchObservedRunningTime="2026-07-06 23:49:04.299341467 +0000 UTC m=+23.906769478"
Jul 06 23:49:05.236783 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.236510    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-79fgn" event={"ID":"757798e0-4584-4a4c-98b5-29850f23a541","Type":"ContainerStarted","Data":"be381769c73320396db14c25977712f0c215de3d3ded84cdcc2133495fa301e8"}
Jul 06 23:49:05.238300 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.238274    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xcw84" event={"ID":"28296891-3ba9-42dc-9f47-e0110ddcb960","Type":"ContainerStarted","Data":"869539e76f6fcf072431f9e6e76e48455beb297586f20902e0443f6dc4fc869c"}
Jul 06 23:49:05.240141 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.240108    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jhw9l" event={"ID":"d2fefbec-278c-47e1-aada-83160d9bcefc","Type":"ContainerStarted","Data":"be39fba5fc9d1d6ed53923a1d74a7e4712f2d24b4d8afd0054eb2e0bf91cfd7c"}
Jul 06 23:49:05.241713 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.241690    2582 generic.go:356] "Generic (PLEG): container finished" podID="09305b88f1373ed8937b4f40e869c133" containerID="7c5456dc831c4dbecec6b54ca8cbd7c1bbddf9d673140cb133fdd8177795495d" exitCode=0
Jul 06 23:49:05.241846 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.241786    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" event={"ID":"09305b88f1373ed8937b4f40e869c133","Type":"ContainerDied","Data":"7c5456dc831c4dbecec6b54ca8cbd7c1bbddf9d673140cb133fdd8177795495d"}
Jul 06 23:49:05.243435 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.243380    2582 generic.go:356] "Generic (PLEG): container finished" podID="5caebe6e-6e44-4eee-b28b-ec5a139a61c0" containerID="447910438fb7c70554a699d28fcbfd093a64a04223f69dd1f4368b22cc1e7660" exitCode=0
Jul 06 23:49:05.243526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.243459    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms9ns" event={"ID":"5caebe6e-6e44-4eee-b28b-ec5a139a61c0","Type":"ContainerDied","Data":"447910438fb7c70554a699d28fcbfd093a64a04223f69dd1f4368b22cc1e7660"}
Jul 06 23:49:05.245313 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.245251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd" event={"ID":"200bf8da-53f0-4fa9-9e20-c0ee57203ca8","Type":"ContainerStarted","Data":"4498e1547cc4111efdc5cf1f98c8d4e7a78f7e194b6174e9a1fb793e3922d9ba"}
Jul 06 23:49:05.246713 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.246658    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5xx98" event={"ID":"f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969","Type":"ContainerStarted","Data":"55a351d4700431415047d60dd4b2b07fe13989774dbc35473a63d2cba4597a37"}
Jul 06 23:49:05.265155 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.265085    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-79fgn" podStartSLOduration=3.31981112 podStartE2EDuration="24.265065591s" totalImagesPullingTime="20.945254471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:05.264850442 +0000 UTC m=+24.872278454" watchObservedRunningTime="2026-07-06 23:49:05.265065591 +0000 UTC m=+24.872493633"
Jul 06 23:49:05.301107 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.301054    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jhw9l" podStartSLOduration=3.300851703 podStartE2EDuration="24.301037252s" totalImagesPullingTime="21.000185549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:05.300783158 +0000 UTC m=+24.908211171" watchObservedRunningTime="2026-07-06 23:49:05.301037252 +0000 UTC m=+24.908465263"
Jul 06 23:49:05.319829 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.319734    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5xx98" podStartSLOduration=3.348325382 podStartE2EDuration="24.319713891s" totalImagesPullingTime="20.971388509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:05.319054402 +0000 UTC m=+24.926482437" watchObservedRunningTime="2026-07-06 23:49:05.319713891 +0000 UTC m=+24.927141903"
Jul 06 23:49:05.364540 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.364482    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xcw84" podStartSLOduration=3.376177685 podStartE2EDuration="24.364464525s" totalImagesPullingTime="20.98828684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:05.337626764 +0000 UTC m=+24.945054777" watchObservedRunningTime="2026-07-06 23:49:05.364464525 +0000 UTC m=+24.971892536"
Jul 06 23:49:05.925661 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.925627    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 23:49:05.958442 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.958409    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:05.958442 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.958433    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:49:05.958770 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:05.958538    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:49:05.958770 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:05.958531    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:49:05.958770 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:05.958666    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:49:05.958884 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:05.958803    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:49:06.252580 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:06.252553    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 06 23:49:06.253017 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:06.252989    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc" event={"ID":"09adca1e-8a8a-4783-b288-a30f9684cad3","Type":"ContainerStarted","Data":"4ed6a8f9877ea94ceb53ce0d06745a7affb5b083d6e6eb7f783a3e7bc4de36e6"}
Jul 06 23:49:06.255418 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:06.255387    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" event={"ID":"09305b88f1373ed8937b4f40e869c133","Type":"ContainerStarted","Data":"522aeae8d63af97e7aee93009c21974ee028398bcca7a0703531ef2fadb5c678"}
Jul 06 23:49:06.257733 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:06.257703    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd" event={"ID":"200bf8da-53f0-4fa9-9e20-c0ee57203ca8","Type":"ContainerStarted","Data":"e0961188a3c20c13e78c4d251c8e18c9e13431cf22cb69d56cd788ebb1affa13"}
Jul 06 23:49:06.884917 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:06.884800    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T23:49:05.925651422Z","UUID":"0349f674-71e5-4a84-93c0-93c38f1341d2","Handler":null,"Name":"","Endpoint":""}
Jul 06 23:49:06.886547 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:06.886515    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 23:49:06.886698 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:06.886571    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 23:49:06.969162 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:06.968962    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5xx98"
Jul 06 23:49:06.969551 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:06.969528    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5xx98"
Jul 06 23:49:06.987624 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:06.987561    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" podStartSLOduration=24.987539581 podStartE2EDuration="24.987539581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:06.269490807 +0000 UTC m=+25.876918817" watchObservedRunningTime="2026-07-06 23:49:06.987539581 +0000 UTC m=+26.594967592"
Jul 06 23:49:07.267548 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:07.267302    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd" event={"ID":"200bf8da-53f0-4fa9-9e20-c0ee57203ca8","Type":"ContainerStarted","Data":"f7a4e3571ca35ccaa531da8556c290369fbbbddcea0b14c8b6d4dc1b52a658f2"}
Jul 06 23:49:07.268055 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:07.267871    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5xx98"
Jul 06 23:49:07.268354 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:07.268326    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5xx98"
Jul 06 23:49:07.305498 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:07.305437    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfbtd" podStartSLOduration=3.222976771 podStartE2EDuration="26.305420832s" totalImagesPullingTime="23.082444061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:48:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:07.287990009 +0000 UTC m=+26.895418019" watchObservedRunningTime="2026-07-06 23:49:07.305420832 +0000 UTC m=+26.912848883"
Jul 06 23:49:07.958260 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:07.958228    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:49:07.958441 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:07.958234    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:07.958441 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:07.958344    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:49:07.958441 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:07.958368    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:49:07.958441 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:07.958427    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:49:07.958610 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:07.958506    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:49:09.958996 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:09.958816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:49:09.959619 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:09.958820    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:09.959619 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:09.959075    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:49:09.959619 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:09.959169    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:49:09.959619 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:09.958820    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:49:09.959619 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:09.959267    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:49:10.276103 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:10.276069    2582 generic.go:356] "Generic (PLEG): container finished" podID="5caebe6e-6e44-4eee-b28b-ec5a139a61c0" containerID="2c927675421fa503b661c200c763c04af1213de5f9cfd5445320444a30793e78" exitCode=0
Jul 06 23:49:10.276286 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:10.276122    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms9ns" event={"ID":"5caebe6e-6e44-4eee-b28b-ec5a139a61c0","Type":"ContainerDied","Data":"2c927675421fa503b661c200c763c04af1213de5f9cfd5445320444a30793e78"}
Jul 06 23:49:10.279649 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:10.279630    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 06 23:49:10.280032 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:10.280009    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc" event={"ID":"09adca1e-8a8a-4783-b288-a30f9684cad3","Type":"ContainerStarted","Data":"fe3404de96f78312ba567b1b1636646b2a3e4be399cb34ad6d8332ea8ef3a7a1"}
Jul 06 23:49:10.280315 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:10.280294    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:49:10.280404 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:10.280353    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:49:10.280404 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:10.280392    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:49:10.280507 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:10.280475    2582 scope.go:117] "RemoveContainer" containerID="f1082a0c93e719a86ac794724acd4a8cc3f32dbc15cc6546b25d45b03955985e"
Jul 06 23:49:10.300468 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:10.300151    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:49:10.301328 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:10.301303    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:49:11.288278 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:11.288256    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 06 23:49:11.288704 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:11.288677    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc" event={"ID":"09adca1e-8a8a-4783-b288-a30f9684cad3","Type":"ContainerStarted","Data":"1f4968aac28696d023c840d415b261480d6204a3260a5343203202dd3e6e4a9f"}
Jul 06 23:49:11.321546 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:11.320073    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc" podStartSLOduration=9.31208163 podStartE2EDuration="30.320051031s" totalImagesPullingTime="21.007969401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:11.31907302 +0000 UTC m=+30.926501031" watchObservedRunningTime="2026-07-06 23:49:11.320051031 +0000 UTC m=+30.927479044"
Jul 06 23:49:11.578152 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:11.578064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cllp6"]
Jul 06 23:49:11.578298 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:11.578228    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:49:11.578337 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:11.578318    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:49:11.580614 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:11.580529    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tqk7j"]
Jul 06 23:49:11.580781 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:11.580654    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:11.580851 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:11.580778    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:49:11.581091 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:11.581068    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sz2ws"]
Jul 06 23:49:11.581188 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:11.581177    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:49:11.581289 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:11.581273    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:49:12.293361 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:12.293327    2582 generic.go:356] "Generic (PLEG): container finished" podID="5caebe6e-6e44-4eee-b28b-ec5a139a61c0" containerID="abfb55ee71e7e4ce6ba68d3ee6e3a1e7d9bd08c681b015c4238b06fbc2a588a3" exitCode=0
Jul 06 23:49:12.293816 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:12.293419    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms9ns" event={"ID":"5caebe6e-6e44-4eee-b28b-ec5a139a61c0","Type":"ContainerDied","Data":"abfb55ee71e7e4ce6ba68d3ee6e3a1e7d9bd08c681b015c4238b06fbc2a588a3"}
Jul 06 23:49:12.958880 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:12.958643    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:12.959056 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:12.958659    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:49:12.959056 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:12.958981    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:49:12.959056 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:12.958702    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:49:12.959224 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:12.959102    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:49:12.959224 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:12.959133    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:49:13.381459 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:13.381421    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:13.472484 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:13.472447    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:13.685395 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:13.685359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:49:13.685559 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:13.685427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:49:13.685792 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:13.685655    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:49:13.685982 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:13.685959    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:49:13.686055 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:13.685990    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret podName:55651bcb-05d0-4904-8609-c8c57720ad7f nodeName:}" failed. No retries permitted until 2026-07-06 23:49:45.685964186 +0000 UTC m=+65.293392191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret") pod "global-pull-secret-syncer-cllp6" (UID: "55651bcb-05d0-4904-8609-c8c57720ad7f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:49:13.686055 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:13.686044    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs podName:b0393c1e-c38d-42ef-84b7-8961533ec21e nodeName:}" failed. No retries permitted until 2026-07-06 23:49:45.686008107 +0000 UTC m=+65.293436119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs") pod "network-metrics-daemon-sz2ws" (UID: "b0393c1e-c38d-42ef-84b7-8961533ec21e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:49:13.787247 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:13.787209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjh6d\" (UniqueName: \"kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d\") pod \"network-check-target-tqk7j\" (UID: \"c6e46718-e6a2-41b9-8a52-c755a8a078b3\") " pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:13.787407 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:13.787378    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:49:13.787407 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:13.787400    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:49:13.787501 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:13.787411    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjh6d for pod openshift-network-diagnostics/network-check-target-tqk7j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:49:13.787501 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:13.787463    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d podName:c6e46718-e6a2-41b9-8a52-c755a8a078b3 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:45.787449262 +0000 UTC m=+65.394877251 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjh6d" (UniqueName: "kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d") pod "network-check-target-tqk7j" (UID: "c6e46718-e6a2-41b9-8a52-c755a8a078b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:49:14.300590 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:14.300552    2582 generic.go:356] "Generic (PLEG): container finished" podID="5caebe6e-6e44-4eee-b28b-ec5a139a61c0" containerID="3a705506734432c2cff11133dd5248d042d6721f5467a800e69066a45a11e5d1" exitCode=0
Jul 06 23:49:14.300730 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:14.300605    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms9ns" event={"ID":"5caebe6e-6e44-4eee-b28b-ec5a139a61c0","Type":"ContainerDied","Data":"3a705506734432c2cff11133dd5248d042d6721f5467a800e69066a45a11e5d1"}
Jul 06 23:49:14.536199 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:14.536119    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:14.597662 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:14.597632    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:14.961579 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:14.961547    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:49:14.961779 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:14.961665    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:49:14.961779 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:14.961667    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cllp6" podUID="55651bcb-05d0-4904-8609-c8c57720ad7f"
Jul 06 23:49:14.961779 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:14.961710    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:14.961942 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:14.961831    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sz2ws" podUID="b0393c1e-c38d-42ef-84b7-8961533ec21e"
Jul 06 23:49:14.961942 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:14.961902    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tqk7j" podUID="c6e46718-e6a2-41b9-8a52-c755a8a078b3"
Jul 06 23:49:15.881642 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:15.881602    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:15.980919 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:15.980884    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:16.080330 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.080301    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:16.158360 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.158335    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeReady"
Jul 06 23:49:16.158521 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.158508    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 23:49:16.200993 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.200957    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5z9g4"]
Jul 06 23:49:16.202903 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.202879    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:16.205430 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.205403    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 23:49:16.205548 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.205414    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 23:49:16.205548 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.205416    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k5jpj\""
Jul 06 23:49:16.207157 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.207136    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nn64h"]
Jul 06 23:49:16.209048 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.209032    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nn64h"
Jul 06 23:49:16.211616 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.211455    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 23:49:16.211692 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.211636    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 23:49:16.211839 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.211798    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w55hv\""
Jul 06 23:49:16.211934 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.211884    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 23:49:16.214141 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.214120    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5z9g4"]
Jul 06 23:49:16.220641 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.220603    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nn64h"]
Jul 06 23:49:16.307898 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.307862    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0a04b79-602d-4281-a091-df937d4bcd99-tmp-dir\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:16.307898 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.307900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k87nh\" (UniqueName: \"kubernetes.io/projected/a0a04b79-602d-4281-a091-df937d4bcd99-kube-api-access-k87nh\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:16.308138 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.307931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hldrc\" (UniqueName: \"kubernetes.io/projected/473bd5f7-c628-4b4f-ae13-9ded79dda8c2-kube-api-access-hldrc\") pod \"ingress-canary-nn64h\" (UID: \"473bd5f7-c628-4b4f-ae13-9ded79dda8c2\") " pod="openshift-ingress-canary/ingress-canary-nn64h"
Jul 06 23:49:16.308138 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.307950    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0a04b79-602d-4281-a091-df937d4bcd99-config-volume\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:16.308138 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.307965    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/473bd5f7-c628-4b4f-ae13-9ded79dda8c2-cert\") pod \"ingress-canary-nn64h\" (UID: \"473bd5f7-c628-4b4f-ae13-9ded79dda8c2\") " pod="openshift-ingress-canary/ingress-canary-nn64h"
Jul 06 23:49:16.308138 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.308037    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:16.329127 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.329099    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:16.408505 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.408415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0a04b79-602d-4281-a091-df937d4bcd99-config-volume\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:16.408505 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.408454    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/473bd5f7-c628-4b4f-ae13-9ded79dda8c2-cert\") pod \"ingress-canary-nn64h\" (UID: \"473bd5f7-c628-4b4f-ae13-9ded79dda8c2\") " pod="openshift-ingress-canary/ingress-canary-nn64h"
Jul 06 23:49:16.408505 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.408484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:16.408793 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:16.408598    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:49:16.408793 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:16.408656    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls podName:a0a04b79-602d-4281-a091-df937d4bcd99 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:16.908639554 +0000 UTC m=+36.516067557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls") pod "dns-default-5z9g4" (UID: "a0a04b79-602d-4281-a091-df937d4bcd99") : secret "dns-default-metrics-tls" not found
Jul 06 23:49:16.408793 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.408721    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0a04b79-602d-4281-a091-df937d4bcd99-tmp-dir\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:16.408793 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.408771    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k87nh\" (UniqueName: \"kubernetes.io/projected/a0a04b79-602d-4281-a091-df937d4bcd99-kube-api-access-k87nh\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:16.409004 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.408807    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hldrc\" (UniqueName: \"kubernetes.io/projected/473bd5f7-c628-4b4f-ae13-9ded79dda8c2-kube-api-access-hldrc\") pod \"ingress-canary-nn64h\" (UID: \"473bd5f7-c628-4b4f-ae13-9ded79dda8c2\") " pod="openshift-ingress-canary/ingress-canary-nn64h"
Jul 06 23:49:16.409095 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.409071    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0a04b79-602d-4281-a091-df937d4bcd99-tmp-dir\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:16.409152 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.409133    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0a04b79-602d-4281-a091-df937d4bcd99-config-volume\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:16.413858 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.413828    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/473bd5f7-c628-4b4f-ae13-9ded79dda8c2-cert\") pod \"ingress-canary-nn64h\" (UID: \"473bd5f7-c628-4b4f-ae13-9ded79dda8c2\") " pod="openshift-ingress-canary/ingress-canary-nn64h"
Jul 06 23:49:16.418612 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.418586    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k87nh\" (UniqueName: \"kubernetes.io/projected/a0a04b79-602d-4281-a091-df937d4bcd99-kube-api-access-k87nh\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:16.418842 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.418803    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hldrc\" (UniqueName: \"kubernetes.io/projected/473bd5f7-c628-4b4f-ae13-9ded79dda8c2-kube-api-access-hldrc\") pod \"ingress-canary-nn64h\" (UID: \"473bd5f7-c628-4b4f-ae13-9ded79dda8c2\") " pod="openshift-ingress-canary/ingress-canary-nn64h"
Jul 06 23:49:16.523823 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.523790    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nn64h"
Jul 06 23:49:16.684324 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.684097    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nn64h"]
Jul 06 23:49:16.689250 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:49:16.689219    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod473bd5f7_c628_4b4f_ae13_9ded79dda8c2.slice/crio-4c4428cd802d8f821aaaec39a13af487a6ec5336e84c96f2a1603ecf68da7292 WatchSource:0}: Error finding container 4c4428cd802d8f821aaaec39a13af487a6ec5336e84c96f2a1603ecf68da7292: Status 404 returned error can't find the container with id 4c4428cd802d8f821aaaec39a13af487a6ec5336e84c96f2a1603ecf68da7292
Jul 06 23:49:16.912837 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.912794    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:16.913407 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:16.912979    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:49:16.913407 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:16.913050    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls podName:a0a04b79-602d-4281-a091-df937d4bcd99 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:17.913034542 +0000 UTC m=+37.520462547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls") pod "dns-default-5z9g4" (UID: "a0a04b79-602d-4281-a091-df937d4bcd99") : secret "dns-default-metrics-tls" not found
Jul 06 23:49:16.961703 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.961599    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:49:16.961703 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.961628    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:49:16.961703 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.961629    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:16.965309 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.965281    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:49:16.965309 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.965303    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nzg9j\""
Jul 06 23:49:16.965491 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.965319    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 23:49:16.965491 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.965367    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:49:16.965646 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.965631    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dwstx\""
Jul 06 23:49:16.965715 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.965665    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 23:49:16.976903 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:16.976873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:17.077034 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:17.077001    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:17.309970 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:17.309881    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nn64h" event={"ID":"473bd5f7-c628-4b4f-ae13-9ded79dda8c2","Type":"ContainerStarted","Data":"4c4428cd802d8f821aaaec39a13af487a6ec5336e84c96f2a1603ecf68da7292"}
Jul 06 23:49:17.522834 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:17.522800    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:17.579175 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:17.579092    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:17.810953 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:17.810917    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:17.907995 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:17.907906    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:17.920008 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:17.919973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:17.920416 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:17.920146    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:49:17.920416 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:17.920218    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls podName:a0a04b79-602d-4281-a091-df937d4bcd99 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:19.920198995 +0000 UTC m=+39.527626990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls") pod "dns-default-5z9g4" (UID: "a0a04b79-602d-4281-a091-df937d4bcd99") : secret "dns-default-metrics-tls" not found
Jul 06 23:49:18.008113 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:18.008066    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:19.320676 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:19.320074    2582 generic.go:356] "Generic (PLEG): container finished" podID="5caebe6e-6e44-4eee-b28b-ec5a139a61c0" containerID="adde41fcd2b142a0739aae1bd643ab77b3259a60ab27ed891610600636a68d07" exitCode=0
Jul 06 23:49:19.320676 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:19.320147    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms9ns" event={"ID":"5caebe6e-6e44-4eee-b28b-ec5a139a61c0","Type":"ContainerDied","Data":"adde41fcd2b142a0739aae1bd643ab77b3259a60ab27ed891610600636a68d07"}
Jul 06 23:49:19.937019 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:19.936976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:19.937190 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:19.937149    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:49:19.937238 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:19.937222    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls podName:a0a04b79-602d-4281-a091-df937d4bcd99 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:23.937205665 +0000 UTC m=+43.544633682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls") pod "dns-default-5z9g4" (UID: "a0a04b79-602d-4281-a091-df937d4bcd99") : secret "dns-default-metrics-tls" not found
Jul 06 23:49:20.325255 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:20.325178    2582 generic.go:356] "Generic (PLEG): container finished" podID="5caebe6e-6e44-4eee-b28b-ec5a139a61c0" containerID="39449cbc1186fe7f978a80794aec2181cf16b27a34f12fcd15981ab78bb1cc80" exitCode=0
Jul 06 23:49:20.325255 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:20.325242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms9ns" event={"ID":"5caebe6e-6e44-4eee-b28b-ec5a139a61c0","Type":"ContainerDied","Data":"39449cbc1186fe7f978a80794aec2181cf16b27a34f12fcd15981ab78bb1cc80"}
Jul 06 23:49:21.040783 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:21.040589    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:21.091843 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:21.091805    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:21.329645 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:21.329554    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nn64h" event={"ID":"473bd5f7-c628-4b4f-ae13-9ded79dda8c2","Type":"ContainerStarted","Data":"560541cac8010785362cdc3732c5e2978a9f5c0f953b185df61773201f6febee"}
Jul 06 23:49:21.332922 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:21.332893    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ms9ns" event={"ID":"5caebe6e-6e44-4eee-b28b-ec5a139a61c0","Type":"ContainerStarted","Data":"58ace5cc101b562c5de4e5df4fe91aad92e423aee5b8297a26d415100a4983fe"}
Jul 06 23:49:21.346916 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:21.346869    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nn64h" podStartSLOduration=1.442272616 podStartE2EDuration="5.346853587s" totalImagesPullingTime="3.904580971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:21.345705152 +0000 UTC m=+40.953133164" watchObservedRunningTime="2026-07-06 23:49:21.346853587 +0000 UTC m=+40.954281597"
Jul 06 23:49:21.369659 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:21.369601    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ms9ns" podStartSLOduration=8.793998096 podStartE2EDuration="40.369585349s" totalImagesPullingTime="31.575587253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:48:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:21.368077078 +0000 UTC m=+40.975505088" watchObservedRunningTime="2026-07-06 23:49:21.369585349 +0000 UTC m=+40.977013359"
Jul 06 23:49:21.499291 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:21.499255    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:21.602128 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:21.602040    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:21.929371 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:21.929344    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:23.970356 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:23.970314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:23.970729 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:23.970469    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:49:23.970729 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:23.970545    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls podName:a0a04b79-602d-4281-a091-df937d4bcd99 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:31.970529225 +0000 UTC m=+51.577957214 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls") pod "dns-default-5z9g4" (UID: "a0a04b79-602d-4281-a091-df937d4bcd99") : secret "dns-default-metrics-tls" not found
Jul 06 23:49:28.491198 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:28.491162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:28.542759 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:28.542709    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:30.734287 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:30.734252    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"]
Jul 06 23:49:30.748027 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:30.748000    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"
Jul 06 23:49:30.749009 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:30.748978    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"]
Jul 06 23:49:30.751047 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:30.751027    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wllg7\""
Jul 06 23:49:30.751047 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:30.751038    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 23:49:30.751767 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:30.751732    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 23:49:30.751767 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:30.751757    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:49:30.815341 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:30.815303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzhwd\" (UniqueName: \"kubernetes.io/projected/949e03eb-644f-46cc-ab1c-f87d20165163-kube-api-access-hzhwd\") pod \"cluster-samples-operator-56fcf86bf-mhk2t\" (UID: \"949e03eb-644f-46cc-ab1c-f87d20165163\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"
Jul 06 23:49:30.815517 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:30.815411    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mhk2t\" (UID: \"949e03eb-644f-46cc-ab1c-f87d20165163\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"
Jul 06 23:49:30.915847 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:30.915810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mhk2t\" (UID: \"949e03eb-644f-46cc-ab1c-f87d20165163\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"
Jul 06 23:49:30.916019 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:30.915869    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzhwd\" (UniqueName: \"kubernetes.io/projected/949e03eb-644f-46cc-ab1c-f87d20165163-kube-api-access-hzhwd\") pod \"cluster-samples-operator-56fcf86bf-mhk2t\" (UID: \"949e03eb-644f-46cc-ab1c-f87d20165163\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"
Jul 06 23:49:30.916019 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:30.915986    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:49:30.916116 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:30.916068    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls podName:949e03eb-644f-46cc-ab1c-f87d20165163 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:31.416050558 +0000 UTC m=+51.023478574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mhk2t" (UID: "949e03eb-644f-46cc-ab1c-f87d20165163") : secret "samples-operator-tls" not found
Jul 06 23:49:30.927338 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:30.927297    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzhwd\" (UniqueName: \"kubernetes.io/projected/949e03eb-644f-46cc-ab1c-f87d20165163-kube-api-access-hzhwd\") pod \"cluster-samples-operator-56fcf86bf-mhk2t\" (UID: \"949e03eb-644f-46cc-ab1c-f87d20165163\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"
Jul 06 23:49:31.137398 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:31.137269    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:31.238903 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:31.238869    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:31.419021 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:31.418929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mhk2t\" (UID: \"949e03eb-644f-46cc-ab1c-f87d20165163\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"
Jul 06 23:49:31.419169 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:31.419049    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:49:31.419169 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:31.419108    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls podName:949e03eb-644f-46cc-ab1c-f87d20165163 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:32.419090528 +0000 UTC m=+52.026518517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mhk2t" (UID: "949e03eb-644f-46cc-ab1c-f87d20165163") : secret "samples-operator-tls" not found
Jul 06 23:49:32.021759 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:32.021703    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:32.022163 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:32.021887    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:49:32.022163 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:32.021949    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls podName:a0a04b79-602d-4281-a091-df937d4bcd99 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:48.02193447 +0000 UTC m=+67.629362462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls") pod "dns-default-5z9g4" (UID: "a0a04b79-602d-4281-a091-df937d4bcd99") : secret "dns-default-metrics-tls" not found
Jul 06 23:49:32.427489 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:32.427456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mhk2t\" (UID: \"949e03eb-644f-46cc-ab1c-f87d20165163\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"
Jul 06 23:49:32.427652 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:32.427627    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:49:32.427707 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:32.427696    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls podName:949e03eb-644f-46cc-ab1c-f87d20165163 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:34.427679833 +0000 UTC m=+54.035107822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mhk2t" (UID: "949e03eb-644f-46cc-ab1c-f87d20165163") : secret "samples-operator-tls" not found
Jul 06 23:49:33.537906 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:33.537874    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:33.639535 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:33.639504    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:34.442457 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:34.442422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mhk2t\" (UID: \"949e03eb-644f-46cc-ab1c-f87d20165163\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"
Jul 06 23:49:34.442652 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:34.442554    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:49:34.442652 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:34.442610    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls podName:949e03eb-644f-46cc-ab1c-f87d20165163 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:38.442595263 +0000 UTC m=+58.050023252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mhk2t" (UID: "949e03eb-644f-46cc-ab1c-f87d20165163") : secret "samples-operator-tls" not found
Jul 06 23:49:35.035062 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:35.035021    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:35.124061 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:35.124028    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:35.690067 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:35.690035    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:35.759158 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:35.759106    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:36.394318 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:36.394282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:36.450125 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:36.450098    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:37.023238 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.023206    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:37.126991 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.126953    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:37.719986 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.719924    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:37.733594 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.733564    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-gwkcq"]
Jul 06 23:49:37.736153 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.736136    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gwkcq"
Jul 06 23:49:37.738619 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.738599    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 06 23:49:37.739400 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.739377    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 06 23:49:37.739526 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.739432    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kj7gw\""
Jul 06 23:49:37.746843 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.746818    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-gwkcq"]
Jul 06 23:49:37.767938 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.767899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv8js\" (UniqueName: \"kubernetes.io/projected/e40ec2e1-7a54-4d1f-9df4-84cbc83edafa-kube-api-access-gv8js\") pod \"migrator-d57d58cc9-gwkcq\" (UID: \"e40ec2e1-7a54-4d1f-9df4-84cbc83edafa\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gwkcq"
Jul 06 23:49:37.807848 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.807792    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:37.868413 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.868369    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv8js\" (UniqueName: \"kubernetes.io/projected/e40ec2e1-7a54-4d1f-9df4-84cbc83edafa-kube-api-access-gv8js\") pod \"migrator-d57d58cc9-gwkcq\" (UID: \"e40ec2e1-7a54-4d1f-9df4-84cbc83edafa\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gwkcq"
Jul 06 23:49:37.878497 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.878460    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv8js\" (UniqueName: \"kubernetes.io/projected/e40ec2e1-7a54-4d1f-9df4-84cbc83edafa-kube-api-access-gv8js\") pod \"migrator-d57d58cc9-gwkcq\" (UID: \"e40ec2e1-7a54-4d1f-9df4-84cbc83edafa\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gwkcq"
Jul 06 23:49:37.958657 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.958620    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-skjhj"]
Jul 06 23:49:37.960830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.960808    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:37.963696 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.963675    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 23:49:37.964016 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.963988    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gbs9b\""
Jul 06 23:49:37.964110 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.964057    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 23:49:37.964167 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.964111    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 23:49:37.966260 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.966239    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 23:49:37.979017 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:37.978936    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-skjhj"]
Jul 06 23:49:38.030524 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.030481    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vnnh8"]
Jul 06 23:49:38.032457 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.032441    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-vnnh8"
Jul 06 23:49:38.034427 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.034374    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:38.034799 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.034781    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 23:49:38.034889 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.034784    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 23:49:38.035079 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.035065    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zjwqp\""
Jul 06 23:49:38.035140 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.035126    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 23:49:38.035415 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.035399    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 23:49:38.042257 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.042231    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vnnh8"]
Jul 06 23:49:38.045214 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.045191    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gwkcq"
Jul 06 23:49:38.069084 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.069047    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnmqp\" (UniqueName: \"kubernetes.io/projected/2e98eb52-5193-4be4-bca9-04c72a49353b-kube-api-access-qnmqp\") pod \"service-ca-758f599c5-vnnh8\" (UID: \"2e98eb52-5193-4be4-bca9-04c72a49353b\") " pod="openshift-service-ca/service-ca-758f599c5-vnnh8"
Jul 06 23:49:38.069084 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.069098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb232c27-86d3-42c0-83c9-cc03f13fec17-data-volume\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.069575 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.069130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb232c27-86d3-42c0-83c9-cc03f13fec17-crio-socket\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.069575 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.069157    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2e98eb52-5193-4be4-bca9-04c72a49353b-signing-cabundle\") pod \"service-ca-758f599c5-vnnh8\" (UID: \"2e98eb52-5193-4be4-bca9-04c72a49353b\") " pod="openshift-service-ca/service-ca-758f599c5-vnnh8"
Jul 06 23:49:38.069575 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.069180    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm2zf\" (UniqueName: \"kubernetes.io/projected/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-api-access-gm2zf\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.069575 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.069348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.069575 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.069424    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.069575 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.069487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2e98eb52-5193-4be4-bca9-04c72a49353b-signing-key\") pod \"service-ca-758f599c5-vnnh8\" (UID: \"2e98eb52-5193-4be4-bca9-04c72a49353b\") " pod="openshift-service-ca/service-ca-758f599c5-vnnh8"
Jul 06 23:49:38.098894 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.098859    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:38.170375 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.170330    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb232c27-86d3-42c0-83c9-cc03f13fec17-data-volume\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.170375 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.170379    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb232c27-86d3-42c0-83c9-cc03f13fec17-crio-socket\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.170639 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.170409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2e98eb52-5193-4be4-bca9-04c72a49353b-signing-cabundle\") pod \"service-ca-758f599c5-vnnh8\" (UID: \"2e98eb52-5193-4be4-bca9-04c72a49353b\") " pod="openshift-service-ca/service-ca-758f599c5-vnnh8"
Jul 06 23:49:38.170639 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.170431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm2zf\" (UniqueName: \"kubernetes.io/projected/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-api-access-gm2zf\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.170639 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.170478    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.170639 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.170481    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb232c27-86d3-42c0-83c9-cc03f13fec17-crio-socket\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.170639 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.170519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.170639 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.170547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2e98eb52-5193-4be4-bca9-04c72a49353b-signing-key\") pod \"service-ca-758f599c5-vnnh8\" (UID: \"2e98eb52-5193-4be4-bca9-04c72a49353b\") " pod="openshift-service-ca/service-ca-758f599c5-vnnh8"
Jul 06 23:49:38.170639 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:38.170603    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:49:38.170639 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:38.170615    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:49:38.170973 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.170644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnmqp\" (UniqueName: \"kubernetes.io/projected/2e98eb52-5193-4be4-bca9-04c72a49353b-kube-api-access-qnmqp\") pod \"service-ca-758f599c5-vnnh8\" (UID: \"2e98eb52-5193-4be4-bca9-04c72a49353b\") " pod="openshift-service-ca/service-ca-758f599c5-vnnh8"
Jul 06 23:49:38.170973 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:38.170692    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm podName:cb232c27-86d3-42c0-83c9-cc03f13fec17 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:38.670671676 +0000 UTC m=+58.278099666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skjhj" (UID: "cb232c27-86d3-42c0-83c9-cc03f13fec17") : configmap "kube-rbac-proxy" not found
Jul 06 23:49:38.170973 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:38.170711    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls podName:cb232c27-86d3-42c0-83c9-cc03f13fec17 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:38.67070289 +0000 UTC m=+58.278130908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skjhj" (UID: "cb232c27-86d3-42c0-83c9-cc03f13fec17") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:49:38.170973 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.170778    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb232c27-86d3-42c0-83c9-cc03f13fec17-data-volume\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.171198 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.171182    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2e98eb52-5193-4be4-bca9-04c72a49353b-signing-cabundle\") pod \"service-ca-758f599c5-vnnh8\" (UID: \"2e98eb52-5193-4be4-bca9-04c72a49353b\") " pod="openshift-service-ca/service-ca-758f599c5-vnnh8"
Jul 06 23:49:38.173213 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.173196    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2e98eb52-5193-4be4-bca9-04c72a49353b-signing-key\") pod \"service-ca-758f599c5-vnnh8\" (UID: \"2e98eb52-5193-4be4-bca9-04c72a49353b\") " pod="openshift-service-ca/service-ca-758f599c5-vnnh8"
Jul 06 23:49:38.179521 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.179485    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm2zf\" (UniqueName: \"kubernetes.io/projected/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-api-access-gm2zf\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.179650 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.179563    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnmqp\" (UniqueName: \"kubernetes.io/projected/2e98eb52-5193-4be4-bca9-04c72a49353b-kube-api-access-qnmqp\") pod \"service-ca-758f599c5-vnnh8\" (UID: \"2e98eb52-5193-4be4-bca9-04c72a49353b\") " pod="openshift-service-ca/service-ca-758f599c5-vnnh8"
Jul 06 23:49:38.182773 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.182728    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-gwkcq"]
Jul 06 23:49:38.186520 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:49:38.186486    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode40ec2e1_7a54_4d1f_9df4_84cbc83edafa.slice/crio-912a8248af28ab401fdd2cfddff8b06b0dbca9289df16379fea81343076b2763 WatchSource:0}: Error finding container 912a8248af28ab401fdd2cfddff8b06b0dbca9289df16379fea81343076b2763: Status 404 returned error can't find the container with id 912a8248af28ab401fdd2cfddff8b06b0dbca9289df16379fea81343076b2763
Jul 06 23:49:38.342322 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.342226    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-vnnh8"
Jul 06 23:49:38.376413 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.376369    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gwkcq" event={"ID":"e40ec2e1-7a54-4d1f-9df4-84cbc83edafa","Type":"ContainerStarted","Data":"912a8248af28ab401fdd2cfddff8b06b0dbca9289df16379fea81343076b2763"}
Jul 06 23:49:38.468758 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.468667    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vnnh8"]
Jul 06 23:49:38.472108 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:49:38.472082    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e98eb52_5193_4be4_bca9_04c72a49353b.slice/crio-c29ceba044bc944be75edf947645ad8021c1ffd3b31a344255a7cb1becb5ff32 WatchSource:0}: Error finding container c29ceba044bc944be75edf947645ad8021c1ffd3b31a344255a7cb1becb5ff32: Status 404 returned error can't find the container with id c29ceba044bc944be75edf947645ad8021c1ffd3b31a344255a7cb1becb5ff32
Jul 06 23:49:38.472987 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.472967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mhk2t\" (UID: \"949e03eb-644f-46cc-ab1c-f87d20165163\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"
Jul 06 23:49:38.473134 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:38.473116    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:49:38.473394 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:38.473204    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls podName:949e03eb-644f-46cc-ab1c-f87d20165163 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:46.473184577 +0000 UTC m=+66.080612566 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mhk2t" (UID: "949e03eb-644f-46cc-ab1c-f87d20165163") : secret "samples-operator-tls" not found
Jul 06 23:49:38.674336 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.674304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.674570 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:38.674345    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:38.674570 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:38.674431    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:49:38.674570 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:38.674462    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:49:38.674570 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:38.674485    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm podName:cb232c27-86d3-42c0-83c9-cc03f13fec17 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:39.674471116 +0000 UTC m=+59.281899109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skjhj" (UID: "cb232c27-86d3-42c0-83c9-cc03f13fec17") : configmap "kube-rbac-proxy" not found
Jul 06 23:49:38.674570 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:38.674523    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls podName:cb232c27-86d3-42c0-83c9-cc03f13fec17 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:39.674502633 +0000 UTC m=+59.281930622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skjhj" (UID: "cb232c27-86d3-42c0-83c9-cc03f13fec17") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:49:39.027208 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:39.027119    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:39.383416 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:39.383314    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-vnnh8" event={"ID":"2e98eb52-5193-4be4-bca9-04c72a49353b","Type":"ContainerStarted","Data":"c29ceba044bc944be75edf947645ad8021c1ffd3b31a344255a7cb1becb5ff32"}
Jul 06 23:49:39.682572 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:39.682527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:39.682799 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:39.682665    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:39.682799 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:39.682676    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:49:39.682799 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:39.682768    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm podName:cb232c27-86d3-42c0-83c9-cc03f13fec17 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:41.682727497 +0000 UTC m=+61.290155485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skjhj" (UID: "cb232c27-86d3-42c0-83c9-cc03f13fec17") : configmap "kube-rbac-proxy" not found
Jul 06 23:49:39.682982 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:39.682800    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:49:39.682982 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:39.682862    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls podName:cb232c27-86d3-42c0-83c9-cc03f13fec17 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:41.682843713 +0000 UTC m=+61.290271709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skjhj" (UID: "cb232c27-86d3-42c0-83c9-cc03f13fec17") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:49:40.387316 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:40.387205    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-vnnh8" event={"ID":"2e98eb52-5193-4be4-bca9-04c72a49353b","Type":"ContainerStarted","Data":"922cdee830b360ae6dade5cc528cf2ca66d1373296a155f713a7eae24c87235f"}
Jul 06 23:49:40.389072 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:40.389044    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gwkcq" event={"ID":"e40ec2e1-7a54-4d1f-9df4-84cbc83edafa","Type":"ContainerStarted","Data":"ff855d2462f20a52a7acf42d398e0544474952a0a9751347d1fd29a2ca9b8d65"}
Jul 06 23:49:40.389199 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:40.389100    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gwkcq" event={"ID":"e40ec2e1-7a54-4d1f-9df4-84cbc83edafa","Type":"ContainerStarted","Data":"d03da03c2b2ec89ada0662594a44f2b99f6b3f2b13f9ad908eb11d6ae36bb6aa"}
Jul 06 23:49:40.403944 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:40.403890    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-vnnh8" podStartSLOduration=0.836942921 podStartE2EDuration="2.403872441s" totalImagesPullingTime="1.56692952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:40.402876198 +0000 UTC m=+60.010304209" watchObservedRunningTime="2026-07-06 23:49:40.403872441 +0000 UTC m=+60.011300431"
Jul 06 23:49:40.420017 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:40.419939    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gwkcq" podStartSLOduration=2.184227979 podStartE2EDuration="3.419920206s" totalImagesPullingTime="1.235692227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:40.419132077 +0000 UTC m=+60.026560088" watchObservedRunningTime="2026-07-06 23:49:40.419920206 +0000 UTC m=+60.027348218"
Jul 06 23:49:40.955468 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:40.955438    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xcw84_28296891-3ba9-42dc-9f47-e0110ddcb960/dns-node-resolver/0.log"
Jul 06 23:49:41.245129 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:41.245036    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:41.354241 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:41.354207    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:41.354878 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:41.354857    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-79fgn_757798e0-4584-4a4c-98b5-29850f23a541/node-ca/0.log"
Jul 06 23:49:41.479715 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:41.479674    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:41.580803 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:41.580695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:41.638564 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:41.638508    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:41.701173 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:41.701130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:41.701446 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:41.701426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:41.701798 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:41.701781    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:49:41.701977 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:41.701968    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm podName:cb232c27-86d3-42c0-83c9-cc03f13fec17 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:45.701946834 +0000 UTC m=+65.309374825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skjhj" (UID: "cb232c27-86d3-42c0-83c9-cc03f13fec17") : configmap "kube-rbac-proxy" not found
Jul 06 23:49:41.702678 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:41.702660    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:49:41.702883 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:41.702871    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls podName:cb232c27-86d3-42c0-83c9-cc03f13fec17 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:45.702853003 +0000 UTC m=+65.310280994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skjhj" (UID: "cb232c27-86d3-42c0-83c9-cc03f13fec17") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:49:41.726019 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:41.725967    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:41.949064 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:41.949020    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:42.310389 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:42.310318    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fltzc"
Jul 06 23:49:42.357759 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:42.357711    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nn64h_473bd5f7-c628-4b4f-ae13-9ded79dda8c2/serve-healthcheck-canary/0.log"
Jul 06 23:49:42.357926 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:42.357816    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:42.755883 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:42.755858    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-gwkcq_e40ec2e1-7a54-4d1f-9df4-84cbc83edafa/migrator/0.log"
Jul 06 23:49:42.956130 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:42.956102    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-gwkcq_e40ec2e1-7a54-4d1f-9df4-84cbc83edafa/graceful-termination/0.log"
Jul 06 23:49:43.190376 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:43.190347    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:43.348800 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:43.348770    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:43.555313 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:43.555219    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:43.778600 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:43.778566    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:43.942418 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:43.942387    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:44.601411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:44.601382    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:44.937042 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:44.937015    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:45.186650 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.186616    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:45.355022 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.354939    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:45.423918 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.423884    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:45.566588 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.566554    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:45.735953 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.735912    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:49:45.736129 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.735981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:45.736129 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.736023    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:45.736129 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.736071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:49:45.736409 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:45.736127    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:49:45.736409 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:45.736149    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:49:45.736409 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:45.736217    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm podName:cb232c27-86d3-42c0-83c9-cc03f13fec17 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:53.736202 +0000 UTC m=+73.343630005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skjhj" (UID: "cb232c27-86d3-42c0-83c9-cc03f13fec17") : configmap "kube-rbac-proxy" not found
Jul 06 23:49:45.736409 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:45.736232    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls podName:cb232c27-86d3-42c0-83c9-cc03f13fec17 nodeName:}" failed. No retries permitted until 2026-07-06 23:49:53.736226294 +0000 UTC m=+73.343654283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skjhj" (UID: "cb232c27-86d3-42c0-83c9-cc03f13fec17") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:49:45.738450 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.738430    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:49:45.738662 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.738643    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:49:45.747160 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:45.747127    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 23:49:45.747288 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:45.747253    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs podName:b0393c1e-c38d-42ef-84b7-8961533ec21e nodeName:}" failed. No retries permitted until 2026-07-06 23:50:49.747235516 +0000 UTC m=+129.354663505 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs") pod "network-metrics-daemon-sz2ws" (UID: "b0393c1e-c38d-42ef-84b7-8961533ec21e") : secret "metrics-daemon-secret" not found
Jul 06 23:49:45.749442 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.749419    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55651bcb-05d0-4904-8609-c8c57720ad7f-original-pull-secret\") pod \"global-pull-secret-syncer-cllp6\" (UID: \"55651bcb-05d0-4904-8609-c8c57720ad7f\") " pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:49:45.752873 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.752840    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:45.773574 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.773523    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cllp6"
Jul 06 23:49:45.837733 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.837693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjh6d\" (UniqueName: \"kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d\") pod \"network-check-target-tqk7j\" (UID: \"c6e46718-e6a2-41b9-8a52-c755a8a078b3\") " pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:45.840383 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.840359    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 23:49:45.850981 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.850948    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 23:49:45.865097 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.865036    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjh6d\" (UniqueName: \"kubernetes.io/projected/c6e46718-e6a2-41b9-8a52-c755a8a078b3-kube-api-access-zjh6d\") pod \"network-check-target-tqk7j\" (UID: \"c6e46718-e6a2-41b9-8a52-c755a8a078b3\") " pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:45.915212 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.915182    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cllp6"]
Jul 06 23:49:45.918691 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:49:45.918659    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55651bcb_05d0_4904_8609_c8c57720ad7f.slice/crio-3ceb8c9e5af7faa5bcbc4e053c8338d9fca1f1684c6674aff78ec38916c30a33 WatchSource:0}: Error finding container 3ceb8c9e5af7faa5bcbc4e053c8338d9fca1f1684c6674aff78ec38916c30a33: Status 404 returned error can't find the container with id 3ceb8c9e5af7faa5bcbc4e053c8338d9fca1f1684c6674aff78ec38916c30a33
Jul 06 23:49:45.942024 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:45.941994    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:46.088190 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:46.088098    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dwstx\""
Jul 06 23:49:46.096237 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:46.096210    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:46.224121 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:46.224091    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tqk7j"]
Jul 06 23:49:46.228608 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:49:46.228582    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e46718_e6a2_41b9_8a52_c755a8a078b3.slice/crio-6ad45546b55941971014f7fc9d2580d80c75e745318b052d892513dbf10f2f0b WatchSource:0}: Error finding container 6ad45546b55941971014f7fc9d2580d80c75e745318b052d892513dbf10f2f0b: Status 404 returned error can't find the container with id 6ad45546b55941971014f7fc9d2580d80c75e745318b052d892513dbf10f2f0b
Jul 06 23:49:46.408838 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:46.408719    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tqk7j" event={"ID":"c6e46718-e6a2-41b9-8a52-c755a8a078b3","Type":"ContainerStarted","Data":"6ad45546b55941971014f7fc9d2580d80c75e745318b052d892513dbf10f2f0b"}
Jul 06 23:49:46.410247 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:46.410218    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cllp6" event={"ID":"55651bcb-05d0-4904-8609-c8c57720ad7f","Type":"ContainerStarted","Data":"3ceb8c9e5af7faa5bcbc4e053c8338d9fca1f1684c6674aff78ec38916c30a33"}
Jul 06 23:49:46.542960 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:46.542898    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mhk2t\" (UID: \"949e03eb-644f-46cc-ab1c-f87d20165163\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"
Jul 06 23:49:46.545802 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:46.545775    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/949e03eb-644f-46cc-ab1c-f87d20165163-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mhk2t\" (UID: \"949e03eb-644f-46cc-ab1c-f87d20165163\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"
Jul 06 23:49:46.660400 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:46.660303    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wllg7\""
Jul 06 23:49:46.667670 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:46.667629    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"
Jul 06 23:49:46.829507 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:46.829477    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t"]
Jul 06 23:49:47.155463 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:47.155379    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:47.371646 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:47.371613    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:47.414937 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:47.414812    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t" event={"ID":"949e03eb-644f-46cc-ab1c-f87d20165163","Type":"ContainerStarted","Data":"86bdd1bc1c77c84a0be7adb302e4b9d516da5d89d15c36f8cdcc43d5d92d37da"}
Jul 06 23:49:47.527726 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:47.527694    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:47.583843 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:47.583770    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:47.766261 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:47.766176    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:47.947980 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:47.947899    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:48.057013 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:48.056922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:48.069411 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:48.069342    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0a04b79-602d-4281-a091-df937d4bcd99-metrics-tls\") pod \"dns-default-5z9g4\" (UID: \"a0a04b79-602d-4281-a091-df937d4bcd99\") " pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:48.319403 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:48.319313    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k5jpj\""
Jul 06 23:49:48.327072 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:48.327035    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:48.521912 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:48.521878    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5z9g4"]
Jul 06 23:49:48.526145 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:49:48.526113    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a04b79_602d_4281_a091_df937d4bcd99.slice/crio-dd67bf694bff5df7c5bb57eee7f92fa7c93a3d8119603c2200a8d8390d9adb7c WatchSource:0}: Error finding container dd67bf694bff5df7c5bb57eee7f92fa7c93a3d8119603c2200a8d8390d9adb7c: Status 404 returned error can't find the container with id dd67bf694bff5df7c5bb57eee7f92fa7c93a3d8119603c2200a8d8390d9adb7c
Jul 06 23:49:48.761972 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:48.761940    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:48.974693 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:48.974662    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:49.180536 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:49.180500    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:49.423136 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:49.423095    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5z9g4" event={"ID":"a0a04b79-602d-4281-a091-df937d4bcd99","Type":"ContainerStarted","Data":"dd67bf694bff5df7c5bb57eee7f92fa7c93a3d8119603c2200a8d8390d9adb7c"}
Jul 06 23:49:49.599797 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:49.599718    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:49.973096 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:49.973058    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:50.149432 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:50.149389    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:50.549949 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:50.549909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:50.818007 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:50.817920    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:51.148592 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:51.148498    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:51.540417 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:51.540365    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:51.740571 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:51.740535    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:51.944948 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:51.944913    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:53.440850 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.440813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5z9g4" event={"ID":"a0a04b79-602d-4281-a091-df937d4bcd99","Type":"ContainerStarted","Data":"e89bfeb6e8c972f46beb4285d5d052198ab7f39d2894542398dbf5dd6fdc9bff"}
Jul 06 23:49:53.441265 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.440870    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5z9g4" event={"ID":"a0a04b79-602d-4281-a091-df937d4bcd99","Type":"ContainerStarted","Data":"107bb80f0d6b1f2c9c3ae5bf8e23662628bf731d6e0f87cb65ad3db29a0bad8c"}
Jul 06 23:49:53.441265 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.440907    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:49:53.442152 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.442129    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tqk7j" event={"ID":"c6e46718-e6a2-41b9-8a52-c755a8a078b3","Type":"ContainerStarted","Data":"f5a043ba5f285e7ce79969244f0097ca51a56931a700b53e88ce537b4d05c70d"}
Jul 06 23:49:53.442261 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.442182    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:49:53.443434 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.443404    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cllp6" event={"ID":"55651bcb-05d0-4904-8609-c8c57720ad7f","Type":"ContainerStarted","Data":"b8af993499535b5d6a8f47c114ad279a698fd9c8aee429faa695c42f30e1f313"}
Jul 06 23:49:53.444992 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.444970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t" event={"ID":"949e03eb-644f-46cc-ab1c-f87d20165163","Type":"ContainerStarted","Data":"116fab05fece6c82991b4eb6278663ea32fe7bda0ffd61b047a7d33b42ecdeba"}
Jul 06 23:49:53.445116 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.445006    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t" event={"ID":"949e03eb-644f-46cc-ab1c-f87d20165163","Type":"ContainerStarted","Data":"16753647baf2f3b88aa8d239d103e1b39944fcab29c75db1a16ef4f6f5ae8769"}
Jul 06 23:49:53.472207 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.472159    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5z9g4" podStartSLOduration=33.569433449 podStartE2EDuration="37.472142806s" totalImagesPullingTime="3.902709357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:53.471555595 +0000 UTC m=+73.078983607" watchObservedRunningTime="2026-07-06 23:49:53.472142806 +0000 UTC m=+73.079570816"
Jul 06 23:49:53.497273 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.497210    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tqk7j" podStartSLOduration=66.330393691 podStartE2EDuration="1m12.497192624s" totalImagesPullingTime="6.166798933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:53.496514855 +0000 UTC m=+73.103942867" watchObservedRunningTime="2026-07-06 23:49:53.497192624 +0000 UTC m=+73.104620650"
Jul 06 23:49:53.517530 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.517476    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cllp6" podStartSLOduration=66.041058095 podStartE2EDuration="1m12.517461128s" totalImagesPullingTime="6.476403033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:53.51695791 +0000 UTC m=+73.124385922" watchObservedRunningTime="2026-07-06 23:49:53.517461128 +0000 UTC m=+73.124889138"
Jul 06 23:49:53.805671 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.805574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:53.805671 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.805619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:53.806180 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.806162    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb232c27-86d3-42c0-83c9-cc03f13fec17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:53.808061 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.808044    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb232c27-86d3-42c0-83c9-cc03f13fec17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skjhj\" (UID: \"cb232c27-86d3-42c0-83c9-cc03f13fec17\") " pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:53.872799 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.872767    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gbs9b\""
Jul 06 23:49:53.881076 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:53.881045    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-skjhj"
Jul 06 23:49:54.013444 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:54.013391    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mhk2t" podStartSLOduration=18.504745662 podStartE2EDuration="24.013372505s" totalImagesPullingTime="5.508626843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:49:53.545708416 +0000 UTC m=+73.153136427" watchObservedRunningTime="2026-07-06 23:49:54.013372505 +0000 UTC m=+73.620800539"
Jul 06 23:49:54.013681 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:54.013663    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-skjhj"]
Jul 06 23:49:54.016825 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:49:54.016797    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb232c27_86d3_42c0_83c9_cc03f13fec17.slice/crio-a6cda9e7c870614865b379bbc6f053689407415964fd68010a82d7c12add508b WatchSource:0}: Error finding container a6cda9e7c870614865b379bbc6f053689407415964fd68010a82d7c12add508b: Status 404 returned error can't find the container with id a6cda9e7c870614865b379bbc6f053689407415964fd68010a82d7c12add508b
Jul 06 23:49:54.450630 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:54.450585    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skjhj" event={"ID":"cb232c27-86d3-42c0-83c9-cc03f13fec17","Type":"ContainerStarted","Data":"a6cda9e7c870614865b379bbc6f053689407415964fd68010a82d7c12add508b"}
Jul 06 23:49:57.830273 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.830235    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"]
Jul 06 23:49:57.832656 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.832635    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:57.837921 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.837889    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 23:49:57.838079 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.837890    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 23:49:57.838079 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.837971    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 23:49:57.838196 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.838108    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 23:49:57.838815 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.838792    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 23:49:57.838926 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.838873    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 23:49:57.839020 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.838950    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 23:49:57.851465 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.851436    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"]
Jul 06 23:49:57.920982 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.920944    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b4f4f8545-rhsn9"]
Jul 06 23:49:57.923060 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.923042    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:57.925996 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.925960    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 23:49:57.926219 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.926203    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 23:49:57.926298 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.926218    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 23:49:57.931994 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.931797    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-csfd5\""
Jul 06 23:49:57.935171 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.935152    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 23:49:57.939538 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.939505    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:57.941597 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.941573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c354454-c62e-462b-811e-a969e409d10a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:57.941679 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.941611    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9c354454-c62e-462b-811e-a969e409d10a-ca\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:57.941764 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.941679    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c354454-c62e-462b-811e-a969e409d10a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:57.941764 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.941711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9c354454-c62e-462b-811e-a969e409d10a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:57.941853 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.941782    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mngzg\" (UniqueName: \"kubernetes.io/projected/9c354454-c62e-462b-811e-a969e409d10a-kube-api-access-mngzg\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:57.941853 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.941808    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9c354454-c62e-462b-811e-a969e409d10a-hub\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:57.966113 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:57.966081    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b4f4f8545-rhsn9"]
Jul 06 23:49:58.007921 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.007827    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b4f4f8545-rhsn9"]
Jul 06 23:49:58.008061 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:49:58.008045    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-zf944 registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9" podUID="a829d907-8433-4a4e-b03b-a583c3371ddf"
Jul 06 23:49:58.043123 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043077    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9c354454-c62e-462b-811e-a969e409d10a-hub\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:58.043123 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043122    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a829d907-8433-4a4e-b03b-a583c3371ddf-trusted-ca\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.043338 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c354454-c62e-462b-811e-a969e409d10a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:58.043338 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043261    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a829d907-8433-4a4e-b03b-a583c3371ddf-image-registry-private-configuration\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.043338 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-registry-tls\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.043338 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c354454-c62e-462b-811e-a969e409d10a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:58.043488 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043376    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a829d907-8433-4a4e-b03b-a583c3371ddf-installation-pull-secrets\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.043488 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9c354454-c62e-462b-811e-a969e409d10a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:58.043488 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043454    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mngzg\" (UniqueName: \"kubernetes.io/projected/9c354454-c62e-462b-811e-a969e409d10a-kube-api-access-mngzg\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:58.043620 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-bound-sa-token\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.043620 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9c354454-c62e-462b-811e-a969e409d10a-ca\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:58.043620 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043601    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf944\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-kube-api-access-zf944\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.043787 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043652    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a829d907-8433-4a4e-b03b-a583c3371ddf-registry-certificates\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.043787 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.043687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a829d907-8433-4a4e-b03b-a583c3371ddf-ca-trust-extracted\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.044113 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.044051    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c354454-c62e-462b-811e-a969e409d10a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:58.045907 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.045876    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9c354454-c62e-462b-811e-a969e409d10a-hub\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:58.046018 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.046005    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9c354454-c62e-462b-811e-a969e409d10a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:58.046057 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.046044    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c354454-c62e-462b-811e-a969e409d10a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:58.046094 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.046076    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9c354454-c62e-462b-811e-a969e409d10a-ca\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:58.055161 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.055134    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:58.065544 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.065508    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mngzg\" (UniqueName: \"kubernetes.io/projected/9c354454-c62e-462b-811e-a969e409d10a-kube-api-access-mngzg\") pod \"cluster-proxy-proxy-agent-55f9bcc6fb-98hhf\" (UID: \"9c354454-c62e-462b-811e-a969e409d10a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:58.144055 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.144014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a829d907-8433-4a4e-b03b-a583c3371ddf-ca-trust-extracted\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.144055 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.144053    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a829d907-8433-4a4e-b03b-a583c3371ddf-trusted-ca\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.144312 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.144086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a829d907-8433-4a4e-b03b-a583c3371ddf-image-registry-private-configuration\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.144312 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.144111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-registry-tls\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.144312 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.144135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a829d907-8433-4a4e-b03b-a583c3371ddf-installation-pull-secrets\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.144448 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.144328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-bound-sa-token\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.144448 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.144399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf944\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-kube-api-access-zf944\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.144549 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.144454    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a829d907-8433-4a4e-b03b-a583c3371ddf-registry-certificates\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.144549 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.144458    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a829d907-8433-4a4e-b03b-a583c3371ddf-ca-trust-extracted\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.145244 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.145221    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a829d907-8433-4a4e-b03b-a583c3371ddf-registry-certificates\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.145463 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.145435    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a829d907-8433-4a4e-b03b-a583c3371ddf-trusted-ca\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.146628 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.146601    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a829d907-8433-4a4e-b03b-a583c3371ddf-image-registry-private-configuration\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.146805 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.146788    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a829d907-8433-4a4e-b03b-a583c3371ddf-installation-pull-secrets\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.146903 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.146885    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-registry-tls\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.150125 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.150110    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"
Jul 06 23:49:58.152806 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.152786    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-bound-sa-token\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.152806 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.152794    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf944\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-kube-api-access-zf944\") pod \"image-registry-6b4f4f8545-rhsn9\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") " pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.317322 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.317213    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf"]
Jul 06 23:49:58.319792 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:49:58.319758    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c354454_c62e_462b_811e_a969e409d10a.slice/crio-8fda9878772505fb1371e4d8e563988a64b769df37c2c7395a89f35794299e08 WatchSource:0}: Error finding container 8fda9878772505fb1371e4d8e563988a64b769df37c2c7395a89f35794299e08: Status 404 returned error can't find the container with id 8fda9878772505fb1371e4d8e563988a64b769df37c2c7395a89f35794299e08
Jul 06 23:49:58.467147 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.467109    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skjhj" event={"ID":"cb232c27-86d3-42c0-83c9-cc03f13fec17","Type":"ContainerStarted","Data":"1608ec98082afae53ec13a69fc40db43d90485f9b877d712d06ded2aaf020706"}
Jul 06 23:49:58.467335 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.467181    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skjhj" event={"ID":"cb232c27-86d3-42c0-83c9-cc03f13fec17","Type":"ContainerStarted","Data":"afd5e32ef4aafc8b88092fb2ed5a0c086ac6a93f30c16e2a76c7fd250d9e5b31"}
Jul 06 23:49:58.468302 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.468284    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.468408 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.468322    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf" event={"ID":"9c354454-c62e-462b-811e-a969e409d10a","Type":"ContainerStarted","Data":"8fda9878772505fb1371e4d8e563988a64b769df37c2c7395a89f35794299e08"}
Jul 06 23:49:58.474509 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.474486    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:58.548144 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.548112    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a829d907-8433-4a4e-b03b-a583c3371ddf-registry-certificates\") pod \"a829d907-8433-4a4e-b03b-a583c3371ddf\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") "
Jul 06 23:49:58.548347 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.548163    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a829d907-8433-4a4e-b03b-a583c3371ddf-ca-trust-extracted\") pod \"a829d907-8433-4a4e-b03b-a583c3371ddf\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") "
Jul 06 23:49:58.548347 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.548196    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a829d907-8433-4a4e-b03b-a583c3371ddf-image-registry-private-configuration\") pod \"a829d907-8433-4a4e-b03b-a583c3371ddf\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") "
Jul 06 23:49:58.548347 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.548219    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-registry-tls\") pod \"a829d907-8433-4a4e-b03b-a583c3371ddf\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") "
Jul 06 23:49:58.548347 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.548243    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf944\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-kube-api-access-zf944\") pod \"a829d907-8433-4a4e-b03b-a583c3371ddf\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") "
Jul 06 23:49:58.548347 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.548307    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a829d907-8433-4a4e-b03b-a583c3371ddf-installation-pull-secrets\") pod \"a829d907-8433-4a4e-b03b-a583c3371ddf\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") "
Jul 06 23:49:58.548347 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.548341    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-bound-sa-token\") pod \"a829d907-8433-4a4e-b03b-a583c3371ddf\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") "
Jul 06 23:49:58.548625 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.548372    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a829d907-8433-4a4e-b03b-a583c3371ddf-trusted-ca\") pod \"a829d907-8433-4a4e-b03b-a583c3371ddf\" (UID: \"a829d907-8433-4a4e-b03b-a583c3371ddf\") "
Jul 06 23:49:58.548625 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.548589    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a829d907-8433-4a4e-b03b-a583c3371ddf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a829d907-8433-4a4e-b03b-a583c3371ddf" (UID: "a829d907-8433-4a4e-b03b-a583c3371ddf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:49:58.548724 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.548653    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a829d907-8433-4a4e-b03b-a583c3371ddf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a829d907-8433-4a4e-b03b-a583c3371ddf" (UID: "a829d907-8433-4a4e-b03b-a583c3371ddf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:49:58.548966 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.548932    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a829d907-8433-4a4e-b03b-a583c3371ddf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a829d907-8433-4a4e-b03b-a583c3371ddf" (UID: "a829d907-8433-4a4e-b03b-a583c3371ddf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:49:58.550665 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.550635    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a829d907-8433-4a4e-b03b-a583c3371ddf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a829d907-8433-4a4e-b03b-a583c3371ddf" (UID: "a829d907-8433-4a4e-b03b-a583c3371ddf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:49:58.550795 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.550684    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a829d907-8433-4a4e-b03b-a583c3371ddf" (UID: "a829d907-8433-4a4e-b03b-a583c3371ddf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:49:58.550795 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.550685    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a829d907-8433-4a4e-b03b-a583c3371ddf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a829d907-8433-4a4e-b03b-a583c3371ddf" (UID: "a829d907-8433-4a4e-b03b-a583c3371ddf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:49:58.550936 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.550919    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a829d907-8433-4a4e-b03b-a583c3371ddf" (UID: "a829d907-8433-4a4e-b03b-a583c3371ddf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:49:58.550996 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.550941    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-kube-api-access-zf944" (OuterVolumeSpecName: "kube-api-access-zf944") pod "a829d907-8433-4a4e-b03b-a583c3371ddf" (UID: "a829d907-8433-4a4e-b03b-a583c3371ddf"). InnerVolumeSpecName "kube-api-access-zf944". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:49:58.649164 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.649057    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a829d907-8433-4a4e-b03b-a583c3371ddf-image-registry-private-configuration\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:49:58.649164 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.649094    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-registry-tls\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:49:58.649164 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.649108    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf944\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-kube-api-access-zf944\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:49:58.649164 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.649120    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a829d907-8433-4a4e-b03b-a583c3371ddf-installation-pull-secrets\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:49:58.649164 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.649131    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a829d907-8433-4a4e-b03b-a583c3371ddf-bound-sa-token\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:49:58.649164 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.649142    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a829d907-8433-4a4e-b03b-a583c3371ddf-trusted-ca\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:49:58.649164 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.649154    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a829d907-8433-4a4e-b03b-a583c3371ddf-registry-certificates\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:49:58.649164 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:58.649166    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a829d907-8433-4a4e-b03b-a583c3371ddf-ca-trust-extracted\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:49:59.472327 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:59.472290    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b4f4f8545-rhsn9"
Jul 06 23:49:59.510058 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:59.510028    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b4f4f8545-rhsn9"]
Jul 06 23:49:59.522627 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:59.522589    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b4f4f8545-rhsn9"]
Jul 06 23:49:59.630310 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:59.630275    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:59.693454 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:59.693420    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:49:59.853203 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:49:59.853112    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:00.013238 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:00.013208    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:00.073444 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:00.073410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:00.208939 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:00.208902    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:00.308980 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:00.308943    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:00.456362 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:00.456320    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:00.530003 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:00.529904    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:00.625169 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:00.625089    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:00.964284 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:00.964239    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a829d907-8433-4a4e-b03b-a583c3371ddf" path="/var/lib/kubelet/pods/a829d907-8433-4a4e-b03b-a583c3371ddf/volumes"
Jul 06 23:50:01.091206 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:01.091109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:01.207694 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:01.207625    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:01.481650 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:01.481615    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skjhj" event={"ID":"cb232c27-86d3-42c0-83c9-cc03f13fec17","Type":"ContainerStarted","Data":"0130d4192e3b513a010b2047e20023eea084ca18144142b76e8f9e629d5e193f"}
Jul 06 23:50:01.495062 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:01.495032    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:02.644558 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:02.644517    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:02.759166 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:02.759135    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:03.014108 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:03.014072    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:03.098083 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:03.098041    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:03.452582 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:03.452550    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5z9g4"
Jul 06 23:50:03.472644 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:03.472594    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-skjhj" podStartSLOduration=19.79928947 podStartE2EDuration="26.472573828s" totalImagesPullingTime="6.673284358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:49:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:01.506304834 +0000 UTC m=+81.113732845" watchObservedRunningTime="2026-07-06 23:50:03.472573828 +0000 UTC m=+83.080001842"
Jul 06 23:50:05.387026 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:05.386989    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:05.538186 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:05.538155    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:05.709355 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:05.709322    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:06.999010 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:06.998970    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:07.069300 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:07.069266    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:07.239703 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:07.239667    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:07.340810 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:07.340696    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:07.400123 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:07.400087    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:07.600973 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:07.600888    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:07.664058 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:07.664023    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:08.568184 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:08.568150    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:08.636539 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:08.636508    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:08.870965 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:08.870877    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:08.969000 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:08.968971    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:09.935429 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:09.935395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:10.034583 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:10.034547    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:11.637005 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:11.636902    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:11.702693 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:11.702655    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:12.060806 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:12.060753    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:14.528725 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:14.528692    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf" event={"ID":"9c354454-c62e-462b-811e-a969e409d10a","Type":"ContainerStarted","Data":"e9fa574abdbb370a306bd7e512bee855af185554891362edf7fe0eb10cb3f2f4"}
Jul 06 23:50:14.529129 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:14.528734    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf" event={"ID":"9c354454-c62e-462b-811e-a969e409d10a","Type":"ContainerStarted","Data":"e2cb50ae6878b0b2cae3c5a43e8d2140c2c33d81f34205307cbb725c34cbeb16"}
Jul 06 23:50:14.529129 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:14.528782    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf" event={"ID":"9c354454-c62e-462b-811e-a969e409d10a","Type":"ContainerStarted","Data":"49dcf03fc2c64049ff196c68ea2f27117392442def80a343b34936eb97269d40"}
Jul 06 23:50:14.553717 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:14.553664    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55f9bcc6fb-98hhf" podStartSLOduration=1.942330984 podStartE2EDuration="17.553647911s" totalImagesPullingTime="15.611316927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:49:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:14.551922829 +0000 UTC m=+94.159350840" watchObservedRunningTime="2026-07-06 23:50:14.553647911 +0000 UTC m=+94.161075901"
Jul 06 23:50:14.654426 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:14.654389    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:14.753941 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:14.753909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:14.857328 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:14.857243    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:14.963529 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:14.963483    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:15.017727 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.017687    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gktbg"]
Jul 06 23:50:15.021309 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.021281    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.024079 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.024053    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 23:50:15.024214 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.024090    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 23:50:15.024214 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.024141    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 23:50:15.024214 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.024091    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 23:50:15.024375 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.024359    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 23:50:15.025096 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.024979    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 23:50:15.025096 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.024989    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hhxhk\""
Jul 06 23:50:15.052037 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.051995    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:15.182908 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.182856    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-wtmp\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.182908 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.182910    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10788016-85e0-4461-9f66-a30efa4a3100-sys\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.183170 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.182973    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-textfile\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.183170 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.183015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-accelerators-collector-config\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.183170 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.183046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-tls\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.183170 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.183075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10788016-85e0-4461-9f66-a30efa4a3100-root\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.183170 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.183099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cx7s\" (UniqueName: \"kubernetes.io/projected/10788016-85e0-4461-9f66-a30efa4a3100-kube-api-access-2cx7s\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.183170 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.183155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.183464 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.183190    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10788016-85e0-4461-9f66-a30efa4a3100-metrics-client-ca\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.207230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.207195    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:15.284558 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.284513    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10788016-85e0-4461-9f66-a30efa4a3100-metrics-client-ca\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.284558 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.284555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-wtmp\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.284822 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.284573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10788016-85e0-4461-9f66-a30efa4a3100-sys\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.284822 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.284660    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10788016-85e0-4461-9f66-a30efa4a3100-sys\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.284822 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.284729    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-textfile\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.284822 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.284792    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-wtmp\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.285019 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.284795    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-accelerators-collector-config\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.285019 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.284865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-tls\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.285019 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.284905    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10788016-85e0-4461-9f66-a30efa4a3100-root\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.285019 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.284933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cx7s\" (UniqueName: \"kubernetes.io/projected/10788016-85e0-4461-9f66-a30efa4a3100-kube-api-access-2cx7s\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.285019 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.284964    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.285252 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.285075    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-textfile\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.285252 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.285135    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10788016-85e0-4461-9f66-a30efa4a3100-root\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.285252 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:50:15.285218    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 23:50:15.285384 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:50:15.285274    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-tls podName:10788016-85e0-4461-9f66-a30efa4a3100 nodeName:}" failed. No retries permitted until 2026-07-06 23:50:15.78525652 +0000 UTC m=+95.392684509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-tls") pod "node-exporter-gktbg" (UID: "10788016-85e0-4461-9f66-a30efa4a3100") : secret "node-exporter-tls" not found
Jul 06 23:50:15.285384 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.285279    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10788016-85e0-4461-9f66-a30efa4a3100-metrics-client-ca\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.285384 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.285325    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-accelerators-collector-config\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.287426 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.287398    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.293343 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.293286    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cx7s\" (UniqueName: \"kubernetes.io/projected/10788016-85e0-4461-9f66-a30efa4a3100-kube-api-access-2cx7s\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.308430 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.308392    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:15.452562 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.452480    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:15.559922 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.559886    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:15.653547 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.653514    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:15.790622 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.790528    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-tls\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.793134 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.793100    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10788016-85e0-4461-9f66-a30efa4a3100-node-exporter-tls\") pod \"node-exporter-gktbg\" (UID: \"10788016-85e0-4461-9f66-a30efa4a3100\") " pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.826475 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.826443    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:15.927852 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.927814    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:15.937800 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:15.937765    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gktbg"
Jul 06 23:50:15.950053 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:50:15.950017    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10788016_85e0_4461_9f66_a30efa4a3100.slice/crio-577b01dffa258d20ffed35193de466c3c2be0fea3e1037d3d93108bca94eac80 WatchSource:0}: Error finding container 577b01dffa258d20ffed35193de466c3c2be0fea3e1037d3d93108bca94eac80: Status 404 returned error can't find the container with id 577b01dffa258d20ffed35193de466c3c2be0fea3e1037d3d93108bca94eac80
Jul 06 23:50:16.023954 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.023925    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:16.029876 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.029846    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:50:16.034550 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.034531    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.037225 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.037191    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 23:50:16.037409 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.037319    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 23:50:16.037409 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.037344    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 23:50:16.037409 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.037374    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 23:50:16.037601 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.037407    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2jxmf\""
Jul 06 23:50:16.037601 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.037344    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 23:50:16.037791 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.037776    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 23:50:16.037878 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.037809    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 23:50:16.037878 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.037865    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 23:50:16.038068 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.038054    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 23:50:16.051257 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.051229    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:50:16.142650 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.142617    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:16.193649 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.193610    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.193649 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.193650    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.193928 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.193675    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.193928 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.193722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-config-out\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.193928 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.193807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.193928 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.193849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.193928 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.193876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-web-config\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.193928 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.193912    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-config-volume\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.194155 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.193973    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.194155 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.194003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.194155 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.194030    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.194155 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.194065    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.194155 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.194111    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9dwm\" (UniqueName: \"kubernetes.io/projected/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-kube-api-access-k9dwm\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.294577 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.294484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.294577 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.294527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-config-out\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.294920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.294694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.294920 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:50:16.294799    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-trusted-ca-bundle podName:7c67562a-6ba2-4479-8f31-7ae1a5e8345f nodeName:}" failed. No retries permitted until 2026-07-06 23:50:16.79477461 +0000 UTC m=+96.402202616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f") : configmap references non-existent config key: ca-bundle.crt
Jul 06 23:50:16.294920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.294836    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.294920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.294870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-web-config\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.294920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.294908    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-config-volume\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.295186 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.295021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.295186 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.295064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.295186 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.295107    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.295186 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.295138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.295591 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.295531    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.296642 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.295973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9dwm\" (UniqueName: \"kubernetes.io/projected/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-kube-api-access-k9dwm\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.296642 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.296022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.296642 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.296047    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.296642 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.296230    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.298293 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.298262    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-web-config\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.298471 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.298444    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.299042 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.299018    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-config-volume\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.299438 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.299390    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-config-out\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.299533 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.299503    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.299622 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.299601    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.304072 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.299842    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.304072 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.300398    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.304384 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.304365    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.306578 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.306554    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9dwm\" (UniqueName: \"kubernetes.io/projected/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-kube-api-access-k9dwm\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.537909 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.537868    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gktbg" event={"ID":"10788016-85e0-4461-9f66-a30efa4a3100","Type":"ContainerStarted","Data":"577b01dffa258d20ffed35193de466c3c2be0fea3e1037d3d93108bca94eac80"}
Jul 06 23:50:16.801455 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.801417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.802323 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.802287    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:16.944608 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:16.944561    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:50:17.117433 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:17.117346    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:50:17.120344 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:50:17.120313    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c67562a_6ba2_4479_8f31_7ae1a5e8345f.slice/crio-0d3318358052afe6f1f1559340384e62e77093e103fef457b51f3d1ba653032f WatchSource:0}: Error finding container 0d3318358052afe6f1f1559340384e62e77093e103fef457b51f3d1ba653032f: Status 404 returned error can't find the container with id 0d3318358052afe6f1f1559340384e62e77093e103fef457b51f3d1ba653032f
Jul 06 23:50:17.542116 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:17.542076    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerStarted","Data":"0d3318358052afe6f1f1559340384e62e77093e103fef457b51f3d1ba653032f"}
Jul 06 23:50:17.543553 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:17.543529    2582 generic.go:356] "Generic (PLEG): container finished" podID="10788016-85e0-4461-9f66-a30efa4a3100" containerID="fbf0ac0c302b9ddbbb6af0bd902f648bb3fa7d5a2c4c7c820214ef42848418d3" exitCode=0
Jul 06 23:50:17.543680 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:17.543591    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gktbg" event={"ID":"10788016-85e0-4461-9f66-a30efa4a3100","Type":"ContainerDied","Data":"fbf0ac0c302b9ddbbb6af0bd902f648bb3fa7d5a2c4c7c820214ef42848418d3"}
Jul 06 23:50:17.871102 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:17.871017    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:17.949321 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:17.949285    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:18.034851 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:18.034814    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:18.244730 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:18.244696    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:18.549231 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:18.549143    2582 generic.go:356] "Generic (PLEG): container finished" podID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerID="e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1" exitCode=0
Jul 06 23:50:18.549383 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:18.549235    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerDied","Data":"e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1"}
Jul 06 23:50:18.551437 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:18.551416    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gktbg" event={"ID":"10788016-85e0-4461-9f66-a30efa4a3100","Type":"ContainerStarted","Data":"7a908cb3fe3602f2cbd098403454afeb70659acc3e6e0ed9ec62eb576f21b8f8"}
Jul 06 23:50:18.551534 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:18.551457    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gktbg" event={"ID":"10788016-85e0-4461-9f66-a30efa4a3100","Type":"ContainerStarted","Data":"75f0736b300822d97a652f7f37fde0ebdde0f768be140b00ba75cfa65cd60f91"}
Jul 06 23:50:18.590751 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:18.590683    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gktbg" podStartSLOduration=3.4950809339999998 podStartE2EDuration="4.590659797s" totalImagesPullingTime="1.019316816s" totalInitContainerRuntime="76.262047ms" isStatefulPod=true podCreationTimestamp="2026-07-06 23:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:18.590001421 +0000 UTC m=+98.197429436" watchObservedRunningTime="2026-07-06 23:50:18.590659797 +0000 UTC m=+98.198087805"
Jul 06 23:50:18.890070 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:18.889973    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:18.991841 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:18.991808    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:19.727490 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:19.727461    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:19.819567 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:19.819534    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:19.920934 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:19.920897    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:20.173624 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:20.173593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:20.248014 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:20.247975    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:20.310935 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:20.310909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:20.564653 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:20.564619    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerStarted","Data":"4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0"}
Jul 06 23:50:20.564830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:20.564724    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerStarted","Data":"0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7"}
Jul 06 23:50:20.564830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:20.564781    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerStarted","Data":"70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3"}
Jul 06 23:50:20.564830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:20.564813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerStarted","Data":"62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867"}
Jul 06 23:50:20.564937 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:20.564838    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerStarted","Data":"a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9"}
Jul 06 23:50:21.191084 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:21.190923    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:21.447040 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:21.447006    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:21.548214 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:21.548184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:21.572181 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:21.572143    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerStarted","Data":"2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce"}
Jul 06 23:50:21.605048 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:21.604998    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.209976409 podStartE2EDuration="5.60498071s" totalImagesPullingTime="3.37418808s" totalInitContainerRuntime="20.816221ms" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:21.603245925 +0000 UTC m=+101.210673945" watchObservedRunningTime="2026-07-06 23:50:21.60498071 +0000 UTC m=+101.212408758"
Jul 06 23:50:24.453473 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:24.453443    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tqk7j"
Jul 06 23:50:24.902957 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:24.902879    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:24.992151 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:24.992116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:25.243543 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:25.243507    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:27.680251 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:27.680216    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:27.781646 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:27.781608    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:28.204591 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:28.204554    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:28.325830 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:28.325792    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:29.080509 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.080475    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dc66b48cd-cbl84"]
Jul 06 23:50:29.142028 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.141995    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc66b48cd-cbl84"]
Jul 06 23:50:29.142191 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.142115    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.144844 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.144814    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 23:50:29.144987 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.144919    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 23:50:29.145043 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.145001    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 23:50:29.145836 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.145765    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 23:50:29.145927 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.145864    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5bz9s\""
Jul 06 23:50:29.145927 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.145874    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 23:50:29.146027 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.145955    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 23:50:29.146163 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.146148    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 23:50:29.149940 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.149923    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 23:50:29.196689 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.196645    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdhjm\" (UniqueName: \"kubernetes.io/projected/7da06308-14bc-459b-ab63-b8199830a7cf-kube-api-access-rdhjm\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.196689 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.196682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-trusted-ca-bundle\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.196920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.196700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-console-config\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.196920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.196764    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-service-ca\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.196920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.196813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-oauth-serving-cert\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.196920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.196844    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7da06308-14bc-459b-ab63-b8199830a7cf-console-serving-cert\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.196920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.196871    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7da06308-14bc-459b-ab63-b8199830a7cf-console-oauth-config\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.298083 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.298033    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdhjm\" (UniqueName: \"kubernetes.io/projected/7da06308-14bc-459b-ab63-b8199830a7cf-kube-api-access-rdhjm\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.298083 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.298084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-trusted-ca-bundle\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.298326 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.298114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-console-config\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.298326 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.298166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-service-ca\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.298326 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.298197    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-oauth-serving-cert\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.298326 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.298232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7da06308-14bc-459b-ab63-b8199830a7cf-console-serving-cert\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.298547 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.298521    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7da06308-14bc-459b-ab63-b8199830a7cf-console-oauth-config\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.299011 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.298923    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-service-ca\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.299011 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.299043    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-oauth-serving-cert\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.299011 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.299044    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-console-config\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.299011 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.299044    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-trusted-ca-bundle\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.300847 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.300828    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7da06308-14bc-459b-ab63-b8199830a7cf-console-serving-cert\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.301043 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.301024    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7da06308-14bc-459b-ab63-b8199830a7cf-console-oauth-config\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.305721 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.305689    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdhjm\" (UniqueName: \"kubernetes.io/projected/7da06308-14bc-459b-ab63-b8199830a7cf-kube-api-access-rdhjm\") pod \"console-6dc66b48cd-cbl84\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") " pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.451520 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.451471    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:29.654349 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:29.654315    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc66b48cd-cbl84"]
Jul 06 23:50:29.657305 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:50:29.657276    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da06308_14bc_459b_ab63_b8199830a7cf.slice/crio-70cc42a00c9b99bced73ff8c033a7a8c9e5d03ba6913c1652a938faeb914c7d1 WatchSource:0}: Error finding container 70cc42a00c9b99bced73ff8c033a7a8c9e5d03ba6913c1652a938faeb914c7d1: Status 404 returned error can't find the container with id 70cc42a00c9b99bced73ff8c033a7a8c9e5d03ba6913c1652a938faeb914c7d1
Jul 06 23:50:30.008794 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:30.008761    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:30.108334 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:30.108299    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:30.164922 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:30.164883    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:30.604994 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:30.604951    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc66b48cd-cbl84" event={"ID":"7da06308-14bc-459b-ab63-b8199830a7cf","Type":"ContainerStarted","Data":"70cc42a00c9b99bced73ff8c033a7a8c9e5d03ba6913c1652a938faeb914c7d1"}
Jul 06 23:50:33.000164 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:33.000078    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:33.102065 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:33.102033    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:33.617717 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:33.617681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc66b48cd-cbl84" event={"ID":"7da06308-14bc-459b-ab63-b8199830a7cf","Type":"ContainerStarted","Data":"882d27f64dd4cafe929a4e479a4de58a2fd9453560069ce5b9d276f10118d437"}
Jul 06 23:50:33.638246 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:33.638194    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dc66b48cd-cbl84" podStartSLOduration=1.58743824 podStartE2EDuration="4.638177386s" totalImagesPullingTime="3.050739146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:33.637360467 +0000 UTC m=+113.244788477" watchObservedRunningTime="2026-07-06 23:50:33.638177386 +0000 UTC m=+113.245605398"
Jul 06 23:50:37.685696 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:37.685659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:37.743439 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:37.743373    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:38.143487 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:38.143398    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:38.243961 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:38.243916    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:39.250857 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:39.250822    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:39.312672 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:39.312632    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:39.451598 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:39.451567    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:39.451807 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:39.451631    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:39.456143 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:39.456120    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:39.642646 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:39.642571    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:50:40.102187 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:40.102128    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:40.200280 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:40.200249    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:47.999424 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:47.999374    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:48.070425 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:48.070385    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:49.772077 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:49.772034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:50:49.774484 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:49.774462    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0393c1e-c38d-42ef-84b7-8961533ec21e-metrics-certs\") pod \"network-metrics-daemon-sz2ws\" (UID: \"b0393c1e-c38d-42ef-84b7-8961533ec21e\") " pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:50:49.982831 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:49.982711    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nzg9j\""
Jul 06 23:50:49.990730 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:49.990702    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sz2ws"
Jul 06 23:50:50.130039 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:50.129994    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sz2ws"]
Jul 06 23:50:50.133004 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:50:50.132970    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0393c1e_c38d_42ef_84b7_8961533ec21e.slice/crio-606998ce7cceaa2f3bda5dea571155e7de22ee6c6b1bda90c4b3210ed853cbc8 WatchSource:0}: Error finding container 606998ce7cceaa2f3bda5dea571155e7de22ee6c6b1bda90c4b3210ed853cbc8: Status 404 returned error can't find the container with id 606998ce7cceaa2f3bda5dea571155e7de22ee6c6b1bda90c4b3210ed853cbc8
Jul 06 23:50:50.677963 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:50.677874    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sz2ws" event={"ID":"b0393c1e-c38d-42ef-84b7-8961533ec21e","Type":"ContainerStarted","Data":"606998ce7cceaa2f3bda5dea571155e7de22ee6c6b1bda90c4b3210ed853cbc8"}
Jul 06 23:50:51.172463 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:51.172425    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:51.273733 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:51.273647    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:51.374267 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:51.374233    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:51.683916 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:51.683886    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sz2ws" event={"ID":"b0393c1e-c38d-42ef-84b7-8961533ec21e","Type":"ContainerStarted","Data":"b2a59cd66a9cef0a7a818bcb13db41c8888424f77a0641908f8c2b36dc5ec79c"}
Jul 06 23:50:51.684104 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:51.683979    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sz2ws" event={"ID":"b0393c1e-c38d-42ef-84b7-8961533ec21e","Type":"ContainerStarted","Data":"9eaa7a9251ffd0fbbbb8e3c8b84d2038c0c1522cb5119b2ce45f71d8f1362a03"}
Jul 06 23:50:51.702469 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:51.702419    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sz2ws" podStartSLOduration=129.830909487 podStartE2EDuration="2m10.702403949s" totalImagesPullingTime="871.494462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:51.701646848 +0000 UTC m=+131.309074859" watchObservedRunningTime="2026-07-06 23:50:51.702403949 +0000 UTC m=+131.309832014"
Jul 06 23:50:51.798217 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:51.798170    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:50:51.914227 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:50:51.914193    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:51:03.003058 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:03.003022    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:51:03.104179 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:03.104144    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:51:24.723431 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:24.723395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:51:34.124017 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:34.123936    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:51:34.523026 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:34.522998    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:51:35.173918 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.173884    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:51:35.174317 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.174172    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="alertmanager" containerID="cri-o://a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9" gracePeriod=120
Jul 06 23:51:35.174317 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.174257    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="kube-rbac-proxy-metric" containerID="cri-o://4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0" gracePeriod=120
Jul 06 23:51:35.174437 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.174288    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="prom-label-proxy" containerID="cri-o://2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce" gracePeriod=120
Jul 06 23:51:35.174437 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.174313    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="kube-rbac-proxy-web" containerID="cri-o://70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3" gracePeriod=120
Jul 06 23:51:35.174437 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.174354    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="config-reloader" containerID="cri-o://62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867" gracePeriod=120
Jul 06 23:51:35.174437 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.174325    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="kube-rbac-proxy" containerID="cri-o://0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7" gracePeriod=120
Jul 06 23:51:35.846017 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.845983    2582 generic.go:356] "Generic (PLEG): container finished" podID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerID="2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce" exitCode=0
Jul 06 23:51:35.846017 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.846010    2582 generic.go:356] "Generic (PLEG): container finished" podID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerID="0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7" exitCode=0
Jul 06 23:51:35.846017 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.846021    2582 generic.go:356] "Generic (PLEG): container finished" podID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerID="62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867" exitCode=0
Jul 06 23:51:35.846261 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.846029    2582 generic.go:356] "Generic (PLEG): container finished" podID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerID="a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9" exitCode=0
Jul 06 23:51:35.846261 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.846051    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerDied","Data":"2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce"}
Jul 06 23:51:35.846261 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.846115    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerDied","Data":"0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7"}
Jul 06 23:51:35.846261 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.846143    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerDied","Data":"62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867"}
Jul 06 23:51:35.846261 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:35.846167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerDied","Data":"a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9"}
Jul 06 23:51:36.422940 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.422915    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.542388 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.542290    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-config-volume\") pod \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") "
Jul 06 23:51:36.542388 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.542344    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-tls-assets\") pod \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") "
Jul 06 23:51:36.542388 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.542372    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-cluster-tls-config\") pod \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") "
Jul 06 23:51:36.542678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.542402    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-config-out\") pod \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") "
Jul 06 23:51:36.542678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.542434    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-web-config\") pod \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") "
Jul 06 23:51:36.542678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.542459    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-main-db\") pod \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") "
Jul 06 23:51:36.542678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.542486    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") "
Jul 06 23:51:36.542678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.542531    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9dwm\" (UniqueName: \"kubernetes.io/projected/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-kube-api-access-k9dwm\") pod \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") "
Jul 06 23:51:36.542678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.542564    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy\") pod \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") "
Jul 06 23:51:36.542678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.542600    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-metrics-client-ca\") pod \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") "
Jul 06 23:51:36.542678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.542650    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy-web\") pod \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") "
Jul 06 23:51:36.543174 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.542687    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-trusted-ca-bundle\") pod \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") "
Jul 06 23:51:36.543174 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.542720    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-main-tls\") pod \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\" (UID: \"7c67562a-6ba2-4479-8f31-7ae1a5e8345f\") "
Jul 06 23:51:36.543360 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.543082    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7c67562a-6ba2-4479-8f31-7ae1a5e8345f" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:51:36.544305 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.544272    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7c67562a-6ba2-4479-8f31-7ae1a5e8345f" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:51:36.544692 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.544665    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7c67562a-6ba2-4479-8f31-7ae1a5e8345f" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:51:36.545663 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.545623    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-config-out" (OuterVolumeSpecName: "config-out") pod "7c67562a-6ba2-4479-8f31-7ae1a5e8345f" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:51:36.546122 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.546091    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7c67562a-6ba2-4479-8f31-7ae1a5e8345f" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:51:36.546211 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.546155    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7c67562a-6ba2-4479-8f31-7ae1a5e8345f" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:51:36.546383 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.546351    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7c67562a-6ba2-4479-8f31-7ae1a5e8345f" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:51:36.546493 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.546468    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7c67562a-6ba2-4479-8f31-7ae1a5e8345f" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:51:36.546754 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.546716    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-config-volume" (OuterVolumeSpecName: "config-volume") pod "7c67562a-6ba2-4479-8f31-7ae1a5e8345f" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:51:36.547631 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.547609    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-kube-api-access-k9dwm" (OuterVolumeSpecName: "kube-api-access-k9dwm") pod "7c67562a-6ba2-4479-8f31-7ae1a5e8345f" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f"). InnerVolumeSpecName "kube-api-access-k9dwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:51:36.547727 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.547645    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7c67562a-6ba2-4479-8f31-7ae1a5e8345f" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:51:36.549643 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.549614    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7c67562a-6ba2-4479-8f31-7ae1a5e8345f" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:51:36.556476 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.556447    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-web-config" (OuterVolumeSpecName: "web-config") pod "7c67562a-6ba2-4479-8f31-7ae1a5e8345f" (UID: "7c67562a-6ba2-4479-8f31-7ae1a5e8345f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:51:36.644275 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.644234    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-tls-assets\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:51:36.644275 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.644269    2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-cluster-tls-config\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:51:36.644275 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.644280    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-config-out\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:51:36.644559 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.644289    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-web-config\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:51:36.644559 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.644298    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-main-db\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:51:36.644559 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.644309    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:51:36.644559 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.644320    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9dwm\" (UniqueName: \"kubernetes.io/projected/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-kube-api-access-k9dwm\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:51:36.644559 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.644329    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:51:36.644559 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.644338    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-metrics-client-ca\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:51:36.644559 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.644346    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:51:36.644559 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.644356    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:51:36.644559 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.644364    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-secret-alertmanager-main-tls\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:51:36.644559 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.644372    2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c67562a-6ba2-4479-8f31-7ae1a5e8345f-config-volume\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:51:36.852802 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.852700    2582 generic.go:356] "Generic (PLEG): container finished" podID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerID="4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0" exitCode=0
Jul 06 23:51:36.852802 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.852728    2582 generic.go:356] "Generic (PLEG): container finished" podID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerID="70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3" exitCode=0
Jul 06 23:51:36.852802 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.852776    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerDied","Data":"4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0"}
Jul 06 23:51:36.852802 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.852794    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.853044 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.852849    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerDied","Data":"70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3"}
Jul 06 23:51:36.853044 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.852878    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c67562a-6ba2-4479-8f31-7ae1a5e8345f","Type":"ContainerDied","Data":"0d3318358052afe6f1f1559340384e62e77093e103fef457b51f3d1ba653032f"}
Jul 06 23:51:36.853044 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.852906    2582 scope.go:117] "RemoveContainer" containerID="2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce"
Jul 06 23:51:36.861351 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.861332    2582 scope.go:117] "RemoveContainer" containerID="4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0"
Jul 06 23:51:36.868650 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.868629    2582 scope.go:117] "RemoveContainer" containerID="0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7"
Jul 06 23:51:36.875537 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.875505    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:51:36.877255 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.877236    2582 scope.go:117] "RemoveContainer" containerID="70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3"
Jul 06 23:51:36.880232 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.880203    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:51:36.885175 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.885155    2582 scope.go:117] "RemoveContainer" containerID="62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867"
Jul 06 23:51:36.892608 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.892583    2582 scope.go:117] "RemoveContainer" containerID="a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9"
Jul 06 23:51:36.900422 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.900404    2582 scope.go:117] "RemoveContainer" containerID="e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1"
Jul 06 23:51:36.907612 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.907578    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:51:36.907900 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.907885    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="kube-rbac-proxy"
Jul 06 23:51:36.907982 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.907904    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="kube-rbac-proxy"
Jul 06 23:51:36.907982 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.907919    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="init-config-reloader"
Jul 06 23:51:36.907982 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.907927    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="init-config-reloader"
Jul 06 23:51:36.907982 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.907936    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="alertmanager"
Jul 06 23:51:36.907982 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.907945    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="alertmanager"
Jul 06 23:51:36.907982 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.907960    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="prom-label-proxy"
Jul 06 23:51:36.907982 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.907968    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="prom-label-proxy"
Jul 06 23:51:36.907982 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.907978    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="config-reloader"
Jul 06 23:51:36.908358 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.907987    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="config-reloader"
Jul 06 23:51:36.908358 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.907998    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="kube-rbac-proxy-web"
Jul 06 23:51:36.908358 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908006    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="kube-rbac-proxy-web"
Jul 06 23:51:36.908358 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908015    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="kube-rbac-proxy-metric"
Jul 06 23:51:36.908358 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908023    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="kube-rbac-proxy-metric"
Jul 06 23:51:36.908358 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908091    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="alertmanager"
Jul 06 23:51:36.908358 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908103    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="prom-label-proxy"
Jul 06 23:51:36.908358 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908114    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="kube-rbac-proxy-web"
Jul 06 23:51:36.908358 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908122    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="kube-rbac-proxy"
Jul 06 23:51:36.908358 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908131    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="kube-rbac-proxy-metric"
Jul 06 23:51:36.908358 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908140    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" containerName="config-reloader"
Jul 06 23:51:36.908358 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908195    2582 scope.go:117] "RemoveContainer" containerID="2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce"
Jul 06 23:51:36.909007 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:51:36.908543    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce\": container with ID starting with 2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce not found: ID does not exist" containerID="2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce"
Jul 06 23:51:36.909007 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908570    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce"} err="failed to get container status \"2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce\": rpc error: code = NotFound desc = could not find container \"2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce\": container with ID starting with 2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce not found: ID does not exist"
Jul 06 23:51:36.909007 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908603    2582 scope.go:117] "RemoveContainer" containerID="4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0"
Jul 06 23:51:36.909007 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:51:36.908905    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0\": container with ID starting with 4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0 not found: ID does not exist" containerID="4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0"
Jul 06 23:51:36.909007 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908926    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0"} err="failed to get container status \"4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0\": rpc error: code = NotFound desc = could not find container \"4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0\": container with ID starting with 4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0 not found: ID does not exist"
Jul 06 23:51:36.909007 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.908942    2582 scope.go:117] "RemoveContainer" containerID="0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7"
Jul 06 23:51:36.913484 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:51:36.909501    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7\": container with ID starting with 0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7 not found: ID does not exist" containerID="0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7"
Jul 06 23:51:36.913484 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.909593    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7"} err="failed to get container status \"0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7\": rpc error: code = NotFound desc = could not find container \"0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7\": container with ID starting with 0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7 not found: ID does not exist"
Jul 06 23:51:36.913484 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.909618    2582 scope.go:117] "RemoveContainer" containerID="70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3"
Jul 06 23:51:36.914068 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:51:36.914043    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3\": container with ID starting with 70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3 not found: ID does not exist" containerID="70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3"
Jul 06 23:51:36.914107 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.914079    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3"} err="failed to get container status \"70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3\": rpc error: code = NotFound desc = could not find container \"70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3\": container with ID starting with 70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3 not found: ID does not exist"
Jul 06 23:51:36.914107 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.914098    2582 scope.go:117] "RemoveContainer" containerID="62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867"
Jul 06 23:51:36.914439 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:51:36.914419    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867\": container with ID starting with 62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867 not found: ID does not exist" containerID="62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867"
Jul 06 23:51:36.914534 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.914447    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867"} err="failed to get container status \"62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867\": rpc error: code = NotFound desc = could not find container \"62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867\": container with ID starting with 62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867 not found: ID does not exist"
Jul 06 23:51:36.914534 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.914469    2582 scope.go:117] "RemoveContainer" containerID="a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9"
Jul 06 23:51:36.914789 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:51:36.914767    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9\": container with ID starting with a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9 not found: ID does not exist" containerID="a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9"
Jul 06 23:51:36.914836 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.914797    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9"} err="failed to get container status \"a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9\": rpc error: code = NotFound desc = could not find container \"a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9\": container with ID starting with a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9 not found: ID does not exist"
Jul 06 23:51:36.914836 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.914817    2582 scope.go:117] "RemoveContainer" containerID="e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1"
Jul 06 23:51:36.915076 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:51:36.915055    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1\": container with ID starting with e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1 not found: ID does not exist" containerID="e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1"
Jul 06 23:51:36.915121 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.915082    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1"} err="failed to get container status \"e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1\": rpc error: code = NotFound desc = could not find container \"e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1\": container with ID starting with e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1 not found: ID does not exist"
Jul 06 23:51:36.915121 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.915097    2582 scope.go:117] "RemoveContainer" containerID="2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce"
Jul 06 23:51:36.915308 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.915287    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce"} err="failed to get container status \"2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce\": rpc error: code = NotFound desc = could not find container \"2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce\": container with ID starting with 2f1393b3ab0a890c5f130aa31efb6cc31f2ac0a9b9efac48e5a1609d7f6f10ce not found: ID does not exist"
Jul 06 23:51:36.915376 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.915309    2582 scope.go:117] "RemoveContainer" containerID="4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0"
Jul 06 23:51:36.915532 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.915514    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0"} err="failed to get container status \"4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0\": rpc error: code = NotFound desc = could not find container \"4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0\": container with ID starting with 4d56734ded690244ca6055ca1c99b8a7a04b2d8563cf41e21c8df929da7cffb0 not found: ID does not exist"
Jul 06 23:51:36.915579 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.915533    2582 scope.go:117] "RemoveContainer" containerID="0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7"
Jul 06 23:51:36.915724 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.915706    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7"} err="failed to get container status \"0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7\": rpc error: code = NotFound desc = could not find container \"0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7\": container with ID starting with 0dd100278bfca15ee1d70722c4f810e5bdc12257f02ec233354072584c806bb7 not found: ID does not exist"
Jul 06 23:51:36.915813 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.915725    2582 scope.go:117] "RemoveContainer" containerID="70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3"
Jul 06 23:51:36.915961 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.915933    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3"} err="failed to get container status \"70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3\": rpc error: code = NotFound desc = could not find container \"70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3\": container with ID starting with 70ffaaa5ea9e2723c21750b513fdf5a80607f611997a72610879c8a4a5e79bd3 not found: ID does not exist"
Jul 06 23:51:36.916008 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.915964    2582 scope.go:117] "RemoveContainer" containerID="62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867"
Jul 06 23:51:36.916236 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.916218    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867"} err="failed to get container status \"62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867\": rpc error: code = NotFound desc = could not find container \"62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867\": container with ID starting with 62b4b29e5d000c301b0160907baa95d0a008d9bc0ef7d8afd64d03fde7d18867 not found: ID does not exist"
Jul 06 23:51:36.916306 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.916237    2582 scope.go:117] "RemoveContainer" containerID="a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9"
Jul 06 23:51:36.916468 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.916449    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9"} err="failed to get container status \"a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9\": rpc error: code = NotFound desc = could not find container \"a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9\": container with ID starting with a66504bc0d6342cd86332d9caea4fad0a46a397f5199f300a79e10bc0d20b1a9 not found: ID does not exist"
Jul 06 23:51:36.916514 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.916467    2582 scope.go:117] "RemoveContainer" containerID="e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1"
Jul 06 23:51:36.916582 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.916568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.916688 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.916670    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1"} err="failed to get container status \"e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1\": rpc error: code = NotFound desc = could not find container \"e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1\": container with ID starting with e50fe9f88c4386a092bf547a550cc24d42ca9b0a085084f3111c04b111f376b1 not found: ID does not exist"
Jul 06 23:51:36.919171 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.919149    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 23:51:36.919287 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.919150    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 23:51:36.919287 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.919150    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 23:51:36.919287 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.919269    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 23:51:36.919287 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.919278    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 23:51:36.919657 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.919636    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 23:51:36.919798 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.919702    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 23:51:36.919937 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.919920    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 23:51:36.919995 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.919977    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2jxmf\""
Jul 06 23:51:36.924638 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.924615    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 23:51:36.927522 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.927499    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:51:36.945879 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.945840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-web-config\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.945879 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.945878    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.946088 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.945905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.946088 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.945970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.946088 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.946004    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfkwx\" (UniqueName: \"kubernetes.io/projected/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-kube-api-access-lfkwx\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.946088 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.946031    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-config-volume\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.946088 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.946053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.946088 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.946077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-config-out\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.946278 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.946118    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.946278 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.946134    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.946278 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.946165    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.946278 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.946184    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.946278 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.946202    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:36.962700 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:36.962667    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c67562a-6ba2-4479-8f31-7ae1a5e8345f" path="/var/lib/kubelet/pods/7c67562a-6ba2-4479-8f31-7ae1a5e8345f/volumes"
Jul 06 23:51:37.047219 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.047186    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-config-volume\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.047219 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.047225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.047453 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.047249    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-config-out\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.047453 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.047277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.047453 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.047293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.047453 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.047315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.047453 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.047333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.047453 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.047350    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.047453 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.047385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-web-config\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.047453 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.047409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.047453 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.047443    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.047896 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.047484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.047896 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.047510    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfkwx\" (UniqueName: \"kubernetes.io/projected/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-kube-api-access-lfkwx\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.048563 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.048536    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.049113 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.049088    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.050473 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.050441    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-config-volume\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.050561 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.050545    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.050630 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.050610    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-config-out\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.050802 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.050780    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.050884 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.050796    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.050884 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.050780    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-web-config\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.050963 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.050935    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.051332 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.051310    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.052027 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.052012    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.052708 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.052691    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.056058 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.056035    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfkwx\" (UniqueName: \"kubernetes.io/projected/08cfb31e-3c39-4b15-87d1-4f1b1b9deef3-kube-api-access-lfkwx\") pod \"alertmanager-main-0\" (UID: \"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.226715 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.226673    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:51:37.401238 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.401210    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:51:37.402167 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:51:37.402145    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08cfb31e_3c39_4b15_87d1_4f1b1b9deef3.slice/crio-ba867ade7b42db7197228cbd80a7ab5fcf504dff97b96efbd5fc00076194af45 WatchSource:0}: Error finding container ba867ade7b42db7197228cbd80a7ab5fcf504dff97b96efbd5fc00076194af45: Status 404 returned error can't find the container with id ba867ade7b42db7197228cbd80a7ab5fcf504dff97b96efbd5fc00076194af45
Jul 06 23:51:37.858648 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.858542    2582 generic.go:356] "Generic (PLEG): container finished" podID="08cfb31e-3c39-4b15-87d1-4f1b1b9deef3" containerID="8b409485c999ec95007b05b0945cec253efedfc02326a7ed1a8b5cbcdeb0a27b" exitCode=0
Jul 06 23:51:37.858648 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.858632    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3","Type":"ContainerDied","Data":"8b409485c999ec95007b05b0945cec253efedfc02326a7ed1a8b5cbcdeb0a27b"}
Jul 06 23:51:37.859062 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:37.858703    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3","Type":"ContainerStarted","Data":"ba867ade7b42db7197228cbd80a7ab5fcf504dff97b96efbd5fc00076194af45"}
Jul 06 23:51:38.868496 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:38.868458    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3","Type":"ContainerStarted","Data":"e6863c7e37140a13a6af83e41709ffdef5b1de6fcfb43cf505d27d602e602ce8"}
Jul 06 23:51:38.869009 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:38.868536    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3","Type":"ContainerStarted","Data":"45c49685b5eb078cb92b9c12495b44e7647086b0b9cfa2bcb58159c0482915a9"}
Jul 06 23:51:38.869009 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:38.868575    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3","Type":"ContainerStarted","Data":"4741a35c60870f1e661bf92831eda6cd7829509faa96d36549d67f0bc3dd8852"}
Jul 06 23:51:38.869009 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:38.868613    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3","Type":"ContainerStarted","Data":"81c85beef3cc21dbfc2263e166dfa2a54a95a7f87b4dd55b818274ad58e1f820"}
Jul 06 23:51:38.869009 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:38.868656    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3","Type":"ContainerStarted","Data":"af75d33540f49e62df7341737ad68c26841575a6ebe5333eec8b3192f70b9b4e"}
Jul 06 23:51:38.869009 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:38.868692    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08cfb31e-3c39-4b15-87d1-4f1b1b9deef3","Type":"ContainerStarted","Data":"e8c161ded8f77c92546826676914137cd17cd2ad7ffd0d30d8c0d96f38e70e99"}
Jul 06 23:51:38.902722 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:38.902661    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.883110925 podStartE2EDuration="2.902644988s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.534063ms" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:38.90148314 +0000 UTC m=+178.508911150" watchObservedRunningTime="2026-07-06 23:51:38.902644988 +0000 UTC m=+178.510072998"
Jul 06 23:51:39.261639 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.261598    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56674b64fc-fr2j2"]
Jul 06 23:51:39.264981 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.264962    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.267720 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.267696    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 06 23:51:39.267868 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.267698    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 06 23:51:39.267868 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.267817    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 06 23:51:39.268432 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.268413    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 06 23:51:39.268684 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.268666    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 06 23:51:39.268921 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.268906    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-m7wg9\""
Jul 06 23:51:39.274916 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.274897    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 06 23:51:39.280325 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.280300    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56674b64fc-fr2j2"]
Jul 06 23:51:39.366184 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.366147    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-federate-client-tls\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.366333 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.366212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-secret-telemeter-client\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.366333 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.366233    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6rjm\" (UniqueName: \"kubernetes.io/projected/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-kube-api-access-c6rjm\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.366333 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.366288    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-metrics-client-ca\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.366468 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.366337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.366468 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.366390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-serving-certs-ca-bundle\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.366468 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.366409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.366468 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.366431    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-telemeter-client-tls\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.467703 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.467656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-metrics-client-ca\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.467703 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.467711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.467952 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.467802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-serving-certs-ca-bundle\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.467952 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.467845    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.467952 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.467879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-telemeter-client-tls\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.467952 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.467925    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-federate-client-tls\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.468156 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.468004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-secret-telemeter-client\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.468156 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.468029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6rjm\" (UniqueName: \"kubernetes.io/projected/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-kube-api-access-c6rjm\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.468660 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.468536    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-metrics-client-ca\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.468660 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.468560    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-serving-certs-ca-bundle\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.468920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.468796    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.470468 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.470443    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-secret-telemeter-client\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.470594 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.470561    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.470641 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.470592    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-telemeter-client-tls\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.470977 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.470955    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-federate-client-tls\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.476059 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.476031    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6rjm\" (UniqueName: \"kubernetes.io/projected/a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8-kube-api-access-c6rjm\") pod \"telemeter-client-56674b64fc-fr2j2\" (UID: \"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8\") " pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.574705 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.574617    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2"
Jul 06 23:51:39.719372 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.719337    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56674b64fc-fr2j2"]
Jul 06 23:51:39.725130 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:51:39.725090    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2caf5d9_0b77_4780_8716_c5aa4bc7c2d8.slice/crio-6cba073cf21daf25395576d16b1e4e490b70eee841b89d066a51b3c65f70dc69 WatchSource:0}: Error finding container 6cba073cf21daf25395576d16b1e4e490b70eee841b89d066a51b3c65f70dc69: Status 404 returned error can't find the container with id 6cba073cf21daf25395576d16b1e4e490b70eee841b89d066a51b3c65f70dc69
Jul 06 23:51:39.873433 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:39.873332    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2" event={"ID":"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8","Type":"ContainerStarted","Data":"6cba073cf21daf25395576d16b1e4e490b70eee841b89d066a51b3c65f70dc69"}
Jul 06 23:51:41.882678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:41.882641    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2" event={"ID":"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8","Type":"ContainerStarted","Data":"32be31c3a139afca4ed52456e44d240ee299625bb11a02c4d3ff31642d2686ad"}
Jul 06 23:51:42.888826 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:42.888790    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2" event={"ID":"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8","Type":"ContainerStarted","Data":"c4894e9bc6f761b9aef36015796a65e3ca92dd31e8f3c4f05c850c90ca4bfa3c"}
Jul 06 23:51:42.889230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:42.888854    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2" event={"ID":"a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8","Type":"ContainerStarted","Data":"427bb4a41d3d2f72a83a304f396487745c5ebc11b67fa20aad22ff44bea969c1"}
Jul 06 23:51:42.912376 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:42.912323    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56674b64fc-fr2j2" podStartSLOduration=1.8738284790000002 podStartE2EDuration="3.912305993s" totalImagesPullingTime="2.038477514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:42.91144321 +0000 UTC m=+182.518871221" watchObservedRunningTime="2026-07-06 23:51:42.912305993 +0000 UTC m=+182.519734004"
Jul 06 23:51:43.706277 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:43.706242    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:51:43.906167 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:43.906132    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:51:44.444580 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:44.444545    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:51:54.357610 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:54.357570    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc66b48cd-cbl84"]
Jul 06 23:51:54.475141 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:54.475107    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:51:54.531867 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:54.531833    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:51:54.601703 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:51:54.601672    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:52:03.763872 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:03.763839    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:52:03.830893 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:03.830855    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:52:19.382594 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.382506    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6dc66b48cd-cbl84" podUID="7da06308-14bc-459b-ab63-b8199830a7cf" containerName="console" containerID="cri-o://882d27f64dd4cafe929a4e479a4de58a2fd9453560069ce5b9d276f10118d437" gracePeriod=15
Jul 06 23:52:19.622375 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.622348    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:52:19.697055 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.697025    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdhjm\" (UniqueName: \"kubernetes.io/projected/7da06308-14bc-459b-ab63-b8199830a7cf-kube-api-access-rdhjm\") pod \"7da06308-14bc-459b-ab63-b8199830a7cf\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") "
Jul 06 23:52:19.697236 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.697082    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-oauth-serving-cert\") pod \"7da06308-14bc-459b-ab63-b8199830a7cf\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") "
Jul 06 23:52:19.697236 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.697120    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-service-ca\") pod \"7da06308-14bc-459b-ab63-b8199830a7cf\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") "
Jul 06 23:52:19.697347 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.697231    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7da06308-14bc-459b-ab63-b8199830a7cf-console-serving-cert\") pod \"7da06308-14bc-459b-ab63-b8199830a7cf\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") "
Jul 06 23:52:19.697347 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.697266    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-console-config\") pod \"7da06308-14bc-459b-ab63-b8199830a7cf\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") "
Jul 06 23:52:19.697347 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.697295    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-trusted-ca-bundle\") pod \"7da06308-14bc-459b-ab63-b8199830a7cf\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") "
Jul 06 23:52:19.697347 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.697344    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7da06308-14bc-459b-ab63-b8199830a7cf-console-oauth-config\") pod \"7da06308-14bc-459b-ab63-b8199830a7cf\" (UID: \"7da06308-14bc-459b-ab63-b8199830a7cf\") "
Jul 06 23:52:19.697623 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.697597    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-service-ca" (OuterVolumeSpecName: "service-ca") pod "7da06308-14bc-459b-ab63-b8199830a7cf" (UID: "7da06308-14bc-459b-ab63-b8199830a7cf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:52:19.697904 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.697599    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7da06308-14bc-459b-ab63-b8199830a7cf" (UID: "7da06308-14bc-459b-ab63-b8199830a7cf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:52:19.698007 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.697692    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-console-config" (OuterVolumeSpecName: "console-config") pod "7da06308-14bc-459b-ab63-b8199830a7cf" (UID: "7da06308-14bc-459b-ab63-b8199830a7cf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:52:19.698007 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.697733    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7da06308-14bc-459b-ab63-b8199830a7cf" (UID: "7da06308-14bc-459b-ab63-b8199830a7cf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:52:19.699578 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.699548    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7da06308-14bc-459b-ab63-b8199830a7cf-kube-api-access-rdhjm" (OuterVolumeSpecName: "kube-api-access-rdhjm") pod "7da06308-14bc-459b-ab63-b8199830a7cf" (UID: "7da06308-14bc-459b-ab63-b8199830a7cf"). InnerVolumeSpecName "kube-api-access-rdhjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:52:19.699674 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.699586    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7da06308-14bc-459b-ab63-b8199830a7cf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7da06308-14bc-459b-ab63-b8199830a7cf" (UID: "7da06308-14bc-459b-ab63-b8199830a7cf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:52:19.699674 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.699604    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7da06308-14bc-459b-ab63-b8199830a7cf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7da06308-14bc-459b-ab63-b8199830a7cf" (UID: "7da06308-14bc-459b-ab63-b8199830a7cf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:52:19.798320 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.798285    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-service-ca\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:52:19.798320 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.798312    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7da06308-14bc-459b-ab63-b8199830a7cf-console-serving-cert\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:52:19.798320 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.798321    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-console-config\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:52:19.798320 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.798330    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-trusted-ca-bundle\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:52:19.798591 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.798338    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7da06308-14bc-459b-ab63-b8199830a7cf-console-oauth-config\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:52:19.798591 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.798349    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdhjm\" (UniqueName: \"kubernetes.io/projected/7da06308-14bc-459b-ab63-b8199830a7cf-kube-api-access-rdhjm\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:52:19.798591 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:19.798370    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7da06308-14bc-459b-ab63-b8199830a7cf-oauth-serving-cert\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:52:20.031346 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:20.031252    2582 generic.go:356] "Generic (PLEG): container finished" podID="7da06308-14bc-459b-ab63-b8199830a7cf" containerID="882d27f64dd4cafe929a4e479a4de58a2fd9453560069ce5b9d276f10118d437" exitCode=0
Jul 06 23:52:20.031346 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:20.031303    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc66b48cd-cbl84"
Jul 06 23:52:20.031519 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:20.031346    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc66b48cd-cbl84" event={"ID":"7da06308-14bc-459b-ab63-b8199830a7cf","Type":"ContainerDied","Data":"882d27f64dd4cafe929a4e479a4de58a2fd9453560069ce5b9d276f10118d437"}
Jul 06 23:52:20.031519 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:20.031402    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc66b48cd-cbl84" event={"ID":"7da06308-14bc-459b-ab63-b8199830a7cf","Type":"ContainerDied","Data":"70cc42a00c9b99bced73ff8c033a7a8c9e5d03ba6913c1652a938faeb914c7d1"}
Jul 06 23:52:20.031519 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:20.031424    2582 scope.go:117] "RemoveContainer" containerID="882d27f64dd4cafe929a4e479a4de58a2fd9453560069ce5b9d276f10118d437"
Jul 06 23:52:20.039977 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:20.039959    2582 scope.go:117] "RemoveContainer" containerID="882d27f64dd4cafe929a4e479a4de58a2fd9453560069ce5b9d276f10118d437"
Jul 06 23:52:20.040252 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:52:20.040233    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"882d27f64dd4cafe929a4e479a4de58a2fd9453560069ce5b9d276f10118d437\": container with ID starting with 882d27f64dd4cafe929a4e479a4de58a2fd9453560069ce5b9d276f10118d437 not found: ID does not exist" containerID="882d27f64dd4cafe929a4e479a4de58a2fd9453560069ce5b9d276f10118d437"
Jul 06 23:52:20.040312 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:20.040267    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"882d27f64dd4cafe929a4e479a4de58a2fd9453560069ce5b9d276f10118d437"} err="failed to get container status \"882d27f64dd4cafe929a4e479a4de58a2fd9453560069ce5b9d276f10118d437\": rpc error: code = NotFound desc = could not find container \"882d27f64dd4cafe929a4e479a4de58a2fd9453560069ce5b9d276f10118d437\": container with ID starting with 882d27f64dd4cafe929a4e479a4de58a2fd9453560069ce5b9d276f10118d437 not found: ID does not exist"
Jul 06 23:52:20.052180 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:20.052146    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc66b48cd-cbl84"]
Jul 06 23:52:20.055698 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:20.055667    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dc66b48cd-cbl84"]
Jul 06 23:52:20.963082 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:20.963050    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7da06308-14bc-459b-ab63-b8199830a7cf" path="/var/lib/kubelet/pods/7da06308-14bc-459b-ab63-b8199830a7cf/volumes"
Jul 06 23:52:23.375310 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:23.375276    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:52:23.479145 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:23.479108    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:52:48.531440 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:48.531403    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:52:48.585954 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:48.585921    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:52:49.385668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:49.385629    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:52:49.487096 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:49.487061    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:52:59.648088 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:59.648048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:52:59.715438 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:52:59.715379    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:53:01.343307 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:53:01.343266    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:53:01.443778 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:53:01.443701    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:53:10.836733 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:53:10.836696    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:53:10.935160 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:53:10.935125    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:53:14.648184 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:53:14.648151    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:53:18.022517 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:53:18.022484    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:53:18.124649 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:53:18.124620    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:53:31.777120 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:53:31.777077    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:53:40.818608 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:53:40.818566    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 06 23:53:40.822898 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:53:40.822872    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 06 23:53:40.826085 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:53:40.826062    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 23:54:01.613513 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:01.613477    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:02.888337 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:02.888305    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:38.676037 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:38.675931    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:39.496760 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:39.496703    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:42.031480 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:42.031439    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:42.472636 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:42.472598    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:42.534123 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:42.534092    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:44.372692 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:44.372653    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:44.525824 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:44.525790    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:45.015810 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:45.015778    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:45.229235 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:45.229194    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:47.331086 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:47.331053    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:47.539969 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:47.539934    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:49.684153 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:49.684118    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:49.782874 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:49.782841    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:54.910976 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:54.910934    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:56.751935 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:56.751907    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:56.854163 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:56.854129    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:54:58.143237 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.143199    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr"]
Jul 06 23:54:58.143615 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.143471    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7da06308-14bc-459b-ab63-b8199830a7cf" containerName="console"
Jul 06 23:54:58.143615 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.143482    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da06308-14bc-459b-ab63-b8199830a7cf" containerName="console"
Jul 06 23:54:58.143615 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.143529    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7da06308-14bc-459b-ab63-b8199830a7cf" containerName="console"
Jul 06 23:54:58.146364 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.146346    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr"
Jul 06 23:54:58.149142 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.149122    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:54:58.149288 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.149159    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-g5nhf\""
Jul 06 23:54:58.150146 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.150125    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 23:54:58.158469 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.158439    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr"]
Jul 06 23:54:58.302730 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.302685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvvrp\" (UniqueName: \"kubernetes.io/projected/20d21497-7272-4da5-bb32-e78064dd2b97-kube-api-access-hvvrp\") pod \"openshift-lws-operator-fd8ccff4c-hv2hr\" (UID: \"20d21497-7272-4da5-bb32-e78064dd2b97\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr"
Jul 06 23:54:58.302934 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.302771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20d21497-7272-4da5-bb32-e78064dd2b97-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hv2hr\" (UID: \"20d21497-7272-4da5-bb32-e78064dd2b97\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr"
Jul 06 23:54:58.403591 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.403504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvvrp\" (UniqueName: \"kubernetes.io/projected/20d21497-7272-4da5-bb32-e78064dd2b97-kube-api-access-hvvrp\") pod \"openshift-lws-operator-fd8ccff4c-hv2hr\" (UID: \"20d21497-7272-4da5-bb32-e78064dd2b97\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr"
Jul 06 23:54:58.403591 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.403546    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20d21497-7272-4da5-bb32-e78064dd2b97-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hv2hr\" (UID: \"20d21497-7272-4da5-bb32-e78064dd2b97\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr"
Jul 06 23:54:58.403909 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.403892    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20d21497-7272-4da5-bb32-e78064dd2b97-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hv2hr\" (UID: \"20d21497-7272-4da5-bb32-e78064dd2b97\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr"
Jul 06 23:54:58.412520 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.412486    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvvrp\" (UniqueName: \"kubernetes.io/projected/20d21497-7272-4da5-bb32-e78064dd2b97-kube-api-access-hvvrp\") pod \"openshift-lws-operator-fd8ccff4c-hv2hr\" (UID: \"20d21497-7272-4da5-bb32-e78064dd2b97\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr"
Jul 06 23:54:58.455392 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.455352    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr"
Jul 06 23:54:58.592645 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.592612    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr"]
Jul 06 23:54:58.595971 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:54:58.595936    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20d21497_7272_4da5_bb32_e78064dd2b97.slice/crio-bc1911682c401a1307e0d654459c28e6cd276dcffbd43d80cd86215efe20beb9 WatchSource:0}: Error finding container bc1911682c401a1307e0d654459c28e6cd276dcffbd43d80cd86215efe20beb9: Status 404 returned error can't find the container with id bc1911682c401a1307e0d654459c28e6cd276dcffbd43d80cd86215efe20beb9
Jul 06 23:54:58.597472 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:58.597452    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:54:59.599305 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:54:59.599245    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr" event={"ID":"20d21497-7272-4da5-bb32-e78064dd2b97","Type":"ContainerStarted","Data":"bc1911682c401a1307e0d654459c28e6cd276dcffbd43d80cd86215efe20beb9"}
Jul 06 23:55:01.608994 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:01.608892    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr" event={"ID":"20d21497-7272-4da5-bb32-e78064dd2b97","Type":"ContainerStarted","Data":"e22dbef4a821dcc6c4ee88ca9ea5d95bf0f3587af7d511335858c77230f85566"}
Jul 06 23:55:01.625793 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:01.625714    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hv2hr" podStartSLOduration=0.869542309 podStartE2EDuration="3.625697965s" totalImagesPullingTime="2.756155656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:01.625101298 +0000 UTC m=+381.232529310" watchObservedRunningTime="2026-07-06 23:55:01.625697965 +0000 UTC m=+381.233125976"
Jul 06 23:55:02.372408 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:02.372374    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:02.471885 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:02.471848    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:04.512042 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:04.512005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:19.701441 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:19.701398    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:19.802251 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:19.802212    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:20.335192 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.335153    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:20.574620 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.574581    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:20.679345 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.679306    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:20.712587 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.712549    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"]
Jul 06 23:55:20.716097 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.716074    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.718692 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.718666    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 23:55:20.719161 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.719139    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 23:55:20.719299 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.719279    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 23:55:20.719376 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.719323    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 23:55:20.719666 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.719649    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cs9gm\""
Jul 06 23:55:20.737279 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.737246    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"]
Jul 06 23:55:20.774391 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.774356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ca7948f-f124-4497-9ffe-05d83f0800da-manifests\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.774391 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.774405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ca7948f-f124-4497-9ffe-05d83f0800da-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.774626 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.774426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ca7948f-f124-4497-9ffe-05d83f0800da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.774626 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.774545    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzhwx\" (UniqueName: \"kubernetes.io/projected/7ca7948f-f124-4497-9ffe-05d83f0800da-kube-api-access-mzhwx\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.774626 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.774599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ca7948f-f124-4497-9ffe-05d83f0800da-tmp\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.847391 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.847356    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:20.875675 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.875636    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzhwx\" (UniqueName: \"kubernetes.io/projected/7ca7948f-f124-4497-9ffe-05d83f0800da-kube-api-access-mzhwx\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.875863 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.875693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ca7948f-f124-4497-9ffe-05d83f0800da-tmp\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.875863 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.875725    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ca7948f-f124-4497-9ffe-05d83f0800da-manifests\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.875863 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.875798    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ca7948f-f124-4497-9ffe-05d83f0800da-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.875863 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.875825    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ca7948f-f124-4497-9ffe-05d83f0800da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.876193 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.876169    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ca7948f-f124-4497-9ffe-05d83f0800da-manifests\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.878413 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.878385    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ca7948f-f124-4497-9ffe-05d83f0800da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.878512 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.878389    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ca7948f-f124-4497-9ffe-05d83f0800da-tmp\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.878565 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.878544    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ca7948f-f124-4497-9ffe-05d83f0800da-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.883721 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.883698    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzhwx\" (UniqueName: \"kubernetes.io/projected/7ca7948f-f124-4497-9ffe-05d83f0800da-kube-api-access-mzhwx\") pod \"opendatahub-operator-controller-manager-5bcdcfc745-sn6g6\" (UID: \"7ca7948f-f124-4497-9ffe-05d83f0800da\") " pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:20.965657 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:20.965564    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:21.025879 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:21.025835    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:21.119651 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:21.119622    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:21.221379 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:21.221274    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"]
Jul 06 23:55:21.223813 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:55:21.223783    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca7948f_f124_4497_9ffe_05d83f0800da.slice/crio-a3dfb6f835b1acef13612253059ab60afe3db3ca6613a748b2fd500137440543 WatchSource:0}: Error finding container a3dfb6f835b1acef13612253059ab60afe3db3ca6613a748b2fd500137440543: Status 404 returned error can't find the container with id a3dfb6f835b1acef13612253059ab60afe3db3ca6613a748b2fd500137440543
Jul 06 23:55:21.289328 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:21.289292    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:21.385061 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:21.385030    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:21.686612 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:21.686573    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6" event={"ID":"7ca7948f-f124-4497-9ffe-05d83f0800da","Type":"ContainerStarted","Data":"a3dfb6f835b1acef13612253059ab60afe3db3ca6613a748b2fd500137440543"}
Jul 06 23:55:24.700715 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:24.700678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6" event={"ID":"7ca7948f-f124-4497-9ffe-05d83f0800da","Type":"ContainerStarted","Data":"87831504b240edd9c7047ab03920c1288d6a9da4db7ff66143de7c10f8a52a20"}
Jul 06 23:55:24.830837 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:24.830792    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:24.932880 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:24.932843    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:25.706221 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:25.706190    2582 generic.go:356] "Generic (PLEG): container finished" podID="7ca7948f-f124-4497-9ffe-05d83f0800da" containerID="87831504b240edd9c7047ab03920c1288d6a9da4db7ff66143de7c10f8a52a20" exitCode=0
Jul 06 23:55:25.706583 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:25.706278    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6" event={"ID":"7ca7948f-f124-4497-9ffe-05d83f0800da","Type":"ContainerDied","Data":"87831504b240edd9c7047ab03920c1288d6a9da4db7ff66143de7c10f8a52a20"}
Jul 06 23:55:26.711780 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:26.711724    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6" event={"ID":"7ca7948f-f124-4497-9ffe-05d83f0800da","Type":"ContainerStarted","Data":"a094a89803c69936a56fa98e67c5f51ecde2592e89e920a2eb5658725894e391"}
Jul 06 23:55:26.712243 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:26.711898    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:26.734313 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:26.734256    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6" podStartSLOduration=2.42594082 podStartE2EDuration="6.734236682s" totalImagesPullingTime="3.261645023s" totalInitContainerRuntime="1.046650839s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:26.73307196 +0000 UTC m=+406.340499975" watchObservedRunningTime="2026-07-06 23:55:26.734236682 +0000 UTC m=+406.341664692"
Jul 06 23:55:32.850080 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:32.850035    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:32.964279 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:32.964247    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:37.718516 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:37.718486    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bcdcfc745-sn6g6"
Jul 06 23:55:39.559143 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:39.559105    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:39.771408 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:39.771377    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:40.358892 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.358858    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:40.410678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.410644    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"]
Jul 06 23:55:40.415185 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.415165    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"
Jul 06 23:55:40.420195 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.420170    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 23:55:40.420321 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.420248    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 23:55:40.422182 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.422059    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 23:55:40.422182 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.422071    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 23:55:40.451820 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.451785    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"]
Jul 06 23:55:40.542993 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.542952    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed16ccfc-b542-433b-84c6-5ac26919538e-tmp\") pod \"kube-auth-proxy-5dc8c455ff-wj47q\" (UID: \"ed16ccfc-b542-433b-84c6-5ac26919538e\") " pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"
Jul 06 23:55:40.543163 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.543014    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhmh4\" (UniqueName: \"kubernetes.io/projected/ed16ccfc-b542-433b-84c6-5ac26919538e-kube-api-access-vhmh4\") pod \"kube-auth-proxy-5dc8c455ff-wj47q\" (UID: \"ed16ccfc-b542-433b-84c6-5ac26919538e\") " pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"
Jul 06 23:55:40.543163 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.543100    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed16ccfc-b542-433b-84c6-5ac26919538e-tls-certs\") pod \"kube-auth-proxy-5dc8c455ff-wj47q\" (UID: \"ed16ccfc-b542-433b-84c6-5ac26919538e\") " pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"
Jul 06 23:55:40.593924 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.593884    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jxg7s"]
Jul 06 23:55:40.596239 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.596221    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jxg7s"
Jul 06 23:55:40.599167 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.599147    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 23:55:40.605516 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.605495    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-p2vv7\""
Jul 06 23:55:40.629807 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.629718    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jxg7s"]
Jul 06 23:55:40.641461 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.641418    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:40.643457 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.643432    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhmh4\" (UniqueName: \"kubernetes.io/projected/ed16ccfc-b542-433b-84c6-5ac26919538e-kube-api-access-vhmh4\") pod \"kube-auth-proxy-5dc8c455ff-wj47q\" (UID: \"ed16ccfc-b542-433b-84c6-5ac26919538e\") " pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"
Jul 06 23:55:40.643565 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.643478    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed16ccfc-b542-433b-84c6-5ac26919538e-tls-certs\") pod \"kube-auth-proxy-5dc8c455ff-wj47q\" (UID: \"ed16ccfc-b542-433b-84c6-5ac26919538e\") " pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"
Jul 06 23:55:40.643565 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.643513    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed16ccfc-b542-433b-84c6-5ac26919538e-tmp\") pod \"kube-auth-proxy-5dc8c455ff-wj47q\" (UID: \"ed16ccfc-b542-433b-84c6-5ac26919538e\") " pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"
Jul 06 23:55:40.645867 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.645838    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed16ccfc-b542-433b-84c6-5ac26919538e-tmp\") pod \"kube-auth-proxy-5dc8c455ff-wj47q\" (UID: \"ed16ccfc-b542-433b-84c6-5ac26919538e\") " pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"
Jul 06 23:55:40.646167 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.646146    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed16ccfc-b542-433b-84c6-5ac26919538e-tls-certs\") pod \"kube-auth-proxy-5dc8c455ff-wj47q\" (UID: \"ed16ccfc-b542-433b-84c6-5ac26919538e\") " pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"
Jul 06 23:55:40.673715 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.673674    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhmh4\" (UniqueName: \"kubernetes.io/projected/ed16ccfc-b542-433b-84c6-5ac26919538e-kube-api-access-vhmh4\") pod \"kube-auth-proxy-5dc8c455ff-wj47q\" (UID: \"ed16ccfc-b542-433b-84c6-5ac26919538e\") " pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"
Jul 06 23:55:40.725572 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.725532    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"
Jul 06 23:55:40.744418 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.744381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d92df3b-a79c-4297-8a84-ae2c6ac03154-cert\") pod \"odh-model-controller-7998c67dc4-jxg7s\" (UID: \"8d92df3b-a79c-4297-8a84-ae2c6ac03154\") " pod="opendatahub/odh-model-controller-7998c67dc4-jxg7s"
Jul 06 23:55:40.744557 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.744526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsrwn\" (UniqueName: \"kubernetes.io/projected/8d92df3b-a79c-4297-8a84-ae2c6ac03154-kube-api-access-bsrwn\") pod \"odh-model-controller-7998c67dc4-jxg7s\" (UID: \"8d92df3b-a79c-4297-8a84-ae2c6ac03154\") " pod="opendatahub/odh-model-controller-7998c67dc4-jxg7s"
Jul 06 23:55:40.816373 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.816327    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:40.844979 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.844943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsrwn\" (UniqueName: \"kubernetes.io/projected/8d92df3b-a79c-4297-8a84-ae2c6ac03154-kube-api-access-bsrwn\") pod \"odh-model-controller-7998c67dc4-jxg7s\" (UID: \"8d92df3b-a79c-4297-8a84-ae2c6ac03154\") " pod="opendatahub/odh-model-controller-7998c67dc4-jxg7s"
Jul 06 23:55:40.845150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.844992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d92df3b-a79c-4297-8a84-ae2c6ac03154-cert\") pod \"odh-model-controller-7998c67dc4-jxg7s\" (UID: \"8d92df3b-a79c-4297-8a84-ae2c6ac03154\") " pod="opendatahub/odh-model-controller-7998c67dc4-jxg7s"
Jul 06 23:55:40.847689 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.847662    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 23:55:40.858056 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.858029    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d92df3b-a79c-4297-8a84-ae2c6ac03154-cert\") pod \"odh-model-controller-7998c67dc4-jxg7s\" (UID: \"8d92df3b-a79c-4297-8a84-ae2c6ac03154\") " pod="opendatahub/odh-model-controller-7998c67dc4-jxg7s"
Jul 06 23:55:40.860287 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.860267    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsrwn\" (UniqueName: \"kubernetes.io/projected/8d92df3b-a79c-4297-8a84-ae2c6ac03154-kube-api-access-bsrwn\") pod \"odh-model-controller-7998c67dc4-jxg7s\" (UID: \"8d92df3b-a79c-4297-8a84-ae2c6ac03154\") " pod="opendatahub/odh-model-controller-7998c67dc4-jxg7s"
Jul 06 23:55:40.889329 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.889185    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q"]
Jul 06 23:55:40.909290 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.909264    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-p2vv7\""
Jul 06 23:55:40.917281 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.917257    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jxg7s"
Jul 06 23:55:40.927922 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:40.927896    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:41.023305 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.023264    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:41.076605 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.076572    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jxg7s"]
Jul 06 23:55:41.079647 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:55:41.079616    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d92df3b_a79c_4297_8a84_ae2c6ac03154.slice/crio-b441e8484f89b89fd75f40a7e0f70859a80c38312e18d100641c543c1258ceb3 WatchSource:0}: Error finding container b441e8484f89b89fd75f40a7e0f70859a80c38312e18d100641c543c1258ceb3: Status 404 returned error can't find the container with id b441e8484f89b89fd75f40a7e0f70859a80c38312e18d100641c543c1258ceb3
Jul 06 23:55:41.622130 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.622090    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dg52h"]
Jul 06 23:55:41.624524 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.624493    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dg52h"
Jul 06 23:55:41.629435 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.629408    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 23:55:41.655445 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.655364    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dg52h"]
Jul 06 23:55:41.681149 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.681024    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:41.752316 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.752280    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g86p\" (UniqueName: \"kubernetes.io/projected/44ae4a0a-38ad-46fb-80d6-2517a0633c8b-kube-api-access-6g86p\") pod \"model-serving-api-54d89bd5fc-dg52h\" (UID: \"44ae4a0a-38ad-46fb-80d6-2517a0633c8b\") " pod="opendatahub/model-serving-api-54d89bd5fc-dg52h"
Jul 06 23:55:41.752516 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.752353    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44ae4a0a-38ad-46fb-80d6-2517a0633c8b-tls-certs\") pod \"model-serving-api-54d89bd5fc-dg52h\" (UID: \"44ae4a0a-38ad-46fb-80d6-2517a0633c8b\") " pod="opendatahub/model-serving-api-54d89bd5fc-dg52h"
Jul 06 23:55:41.777617 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.777571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jxg7s" event={"ID":"8d92df3b-a79c-4297-8a84-ae2c6ac03154","Type":"ContainerStarted","Data":"b441e8484f89b89fd75f40a7e0f70859a80c38312e18d100641c543c1258ceb3"}
Jul 06 23:55:41.779410 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.779377    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q" event={"ID":"ed16ccfc-b542-433b-84c6-5ac26919538e","Type":"ContainerStarted","Data":"965470d9759ee44bd4368a3183208f2aae4a886b930b1b17741a70a15a12c0c6"}
Jul 06 23:55:41.853357 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.852933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44ae4a0a-38ad-46fb-80d6-2517a0633c8b-tls-certs\") pod \"model-serving-api-54d89bd5fc-dg52h\" (UID: \"44ae4a0a-38ad-46fb-80d6-2517a0633c8b\") " pod="opendatahub/model-serving-api-54d89bd5fc-dg52h"
Jul 06 23:55:41.853357 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.853027    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g86p\" (UniqueName: \"kubernetes.io/projected/44ae4a0a-38ad-46fb-80d6-2517a0633c8b-kube-api-access-6g86p\") pod \"model-serving-api-54d89bd5fc-dg52h\" (UID: \"44ae4a0a-38ad-46fb-80d6-2517a0633c8b\") " pod="opendatahub/model-serving-api-54d89bd5fc-dg52h"
Jul 06 23:55:41.853604 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:55:41.853463    2582 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 06 23:55:41.853604 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:55:41.853528    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ae4a0a-38ad-46fb-80d6-2517a0633c8b-tls-certs podName:44ae4a0a-38ad-46fb-80d6-2517a0633c8b nodeName:}" failed. No retries permitted until 2026-07-06 23:55:42.353506476 +0000 UTC m=+421.960934467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/44ae4a0a-38ad-46fb-80d6-2517a0633c8b-tls-certs") pod "model-serving-api-54d89bd5fc-dg52h" (UID: "44ae4a0a-38ad-46fb-80d6-2517a0633c8b") : secret "model-serving-api-tls" not found
Jul 06 23:55:41.869716 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:41.869679    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g86p\" (UniqueName: \"kubernetes.io/projected/44ae4a0a-38ad-46fb-80d6-2517a0633c8b-kube-api-access-6g86p\") pod \"model-serving-api-54d89bd5fc-dg52h\" (UID: \"44ae4a0a-38ad-46fb-80d6-2517a0633c8b\") " pod="opendatahub/model-serving-api-54d89bd5fc-dg52h"
Jul 06 23:55:42.227525 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:42.227489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:42.337913 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:42.337860    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:42.359170 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:42.359120    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44ae4a0a-38ad-46fb-80d6-2517a0633c8b-tls-certs\") pod \"model-serving-api-54d89bd5fc-dg52h\" (UID: \"44ae4a0a-38ad-46fb-80d6-2517a0633c8b\") " pod="opendatahub/model-serving-api-54d89bd5fc-dg52h"
Jul 06 23:55:42.367045 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:42.367003    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44ae4a0a-38ad-46fb-80d6-2517a0633c8b-tls-certs\") pod \"model-serving-api-54d89bd5fc-dg52h\" (UID: \"44ae4a0a-38ad-46fb-80d6-2517a0633c8b\") " pod="opendatahub/model-serving-api-54d89bd5fc-dg52h"
Jul 06 23:55:42.436429 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:42.436394    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:42.538346 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:42.538188    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dg52h"
Jul 06 23:55:42.715182 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:42.715103    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dg52h"]
Jul 06 23:55:43.694653 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:43.694598    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:43.840602 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:55:43.840558    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ae4a0a_38ad_46fb_80d6_2517a0633c8b.slice/crio-c114da598b6a2a7604d0871d28f2f34cb942e04e38c7f8be6e6a1dce1a6cf580 WatchSource:0}: Error finding container c114da598b6a2a7604d0871d28f2f34cb942e04e38c7f8be6e6a1dce1a6cf580: Status 404 returned error can't find the container with id c114da598b6a2a7604d0871d28f2f34cb942e04e38c7f8be6e6a1dce1a6cf580
Jul 06 23:55:44.536583 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:44.536560    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 23:55:44.560319 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:44.560290    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:44.661492 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:44.661462    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:44.794833 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:44.794720    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dg52h" event={"ID":"44ae4a0a-38ad-46fb-80d6-2517a0633c8b","Type":"ContainerStarted","Data":"c114da598b6a2a7604d0871d28f2f34cb942e04e38c7f8be6e6a1dce1a6cf580"}
Jul 06 23:55:44.796085 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:44.796061    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q" event={"ID":"ed16ccfc-b542-433b-84c6-5ac26919538e","Type":"ContainerStarted","Data":"f3a1b87d2f366655f4789ddb0a9d248b285269ff0f7bb6c9e92c61be9ba69168"}
Jul 06 23:55:44.797941 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:44.797910    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jxg7s" event={"ID":"8d92df3b-a79c-4297-8a84-ae2c6ac03154","Type":"ContainerStarted","Data":"a21f57e54e9ac2a9e7943701052b70cbf9b1239dd79d76948be50e408ebcb30d"}
Jul 06 23:55:44.798065 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:44.797986    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jxg7s"
Jul 06 23:55:44.818949 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:44.818841    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dc8c455ff-wj47q" podStartSLOduration=1.180835629 podStartE2EDuration="4.81881995s" totalImagesPullingTime="3.637984321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:44.817825711 +0000 UTC m=+424.425253724" watchObservedRunningTime="2026-07-06 23:55:44.81881995 +0000 UTC m=+424.426247961"
Jul 06 23:55:44.833944 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:44.833832    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jxg7s" podStartSLOduration=1.3806218860000001 podStartE2EDuration="4.833809282s" totalImagesPullingTime="3.453187396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:44.833714168 +0000 UTC m=+424.441142179" watchObservedRunningTime="2026-07-06 23:55:44.833809282 +0000 UTC m=+424.441237285"
Jul 06 23:55:45.804704 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:45.804596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dg52h" event={"ID":"44ae4a0a-38ad-46fb-80d6-2517a0633c8b","Type":"ContainerStarted","Data":"997fa3e9241d25826b356019c1a749a888aedce7f2eb2f18e22481e4a75bad1e"}
Jul 06 23:55:45.805183 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:45.804696    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-dg52h"
Jul 06 23:55:45.823914 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:45.823850    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-dg52h" podStartSLOduration=3.121983889 podStartE2EDuration="4.823828792s" totalImagesPullingTime="1.701844903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:45.823590854 +0000 UTC m=+425.431018866" watchObservedRunningTime="2026-07-06 23:55:45.823828792 +0000 UTC m=+425.431256805"
Jul 06 23:55:46.412842 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.412799    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"]
Jul 06 23:55:46.416293 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.416262    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.418876 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.418848    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 23:55:46.419016 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.418894    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 23:55:46.419893 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.419876    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jknzk\""
Jul 06 23:55:46.420016 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.420002    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 23:55:46.424389 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.424365    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"]
Jul 06 23:55:46.493449 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.493400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27e50a48-6c05-4b52-b1d9-8750e9c48e6d-cert\") pod \"lws-controller-manager-9d77cc8c4-tglqw\" (UID: \"27e50a48-6c05-4b52-b1d9-8750e9c48e6d\") " pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.493605 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.493464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/27e50a48-6c05-4b52-b1d9-8750e9c48e6d-manager-config\") pod \"lws-controller-manager-9d77cc8c4-tglqw\" (UID: \"27e50a48-6c05-4b52-b1d9-8750e9c48e6d\") " pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.493605 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.493523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/27e50a48-6c05-4b52-b1d9-8750e9c48e6d-metrics-cert\") pod \"lws-controller-manager-9d77cc8c4-tglqw\" (UID: \"27e50a48-6c05-4b52-b1d9-8750e9c48e6d\") " pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.493605 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.493571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jln8g\" (UniqueName: \"kubernetes.io/projected/27e50a48-6c05-4b52-b1d9-8750e9c48e6d-kube-api-access-jln8g\") pod \"lws-controller-manager-9d77cc8c4-tglqw\" (UID: \"27e50a48-6c05-4b52-b1d9-8750e9c48e6d\") " pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.594862 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.594827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27e50a48-6c05-4b52-b1d9-8750e9c48e6d-cert\") pod \"lws-controller-manager-9d77cc8c4-tglqw\" (UID: \"27e50a48-6c05-4b52-b1d9-8750e9c48e6d\") " pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.595041 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.594876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/27e50a48-6c05-4b52-b1d9-8750e9c48e6d-manager-config\") pod \"lws-controller-manager-9d77cc8c4-tglqw\" (UID: \"27e50a48-6c05-4b52-b1d9-8750e9c48e6d\") " pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.595041 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.594925    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/27e50a48-6c05-4b52-b1d9-8750e9c48e6d-metrics-cert\") pod \"lws-controller-manager-9d77cc8c4-tglqw\" (UID: \"27e50a48-6c05-4b52-b1d9-8750e9c48e6d\") " pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.595041 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.594954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jln8g\" (UniqueName: \"kubernetes.io/projected/27e50a48-6c05-4b52-b1d9-8750e9c48e6d-kube-api-access-jln8g\") pod \"lws-controller-manager-9d77cc8c4-tglqw\" (UID: \"27e50a48-6c05-4b52-b1d9-8750e9c48e6d\") " pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.595707 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.595616    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/27e50a48-6c05-4b52-b1d9-8750e9c48e6d-manager-config\") pod \"lws-controller-manager-9d77cc8c4-tglqw\" (UID: \"27e50a48-6c05-4b52-b1d9-8750e9c48e6d\") " pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.597541 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.597521    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27e50a48-6c05-4b52-b1d9-8750e9c48e6d-cert\") pod \"lws-controller-manager-9d77cc8c4-tglqw\" (UID: \"27e50a48-6c05-4b52-b1d9-8750e9c48e6d\") " pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.597646 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.597617    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/27e50a48-6c05-4b52-b1d9-8750e9c48e6d-metrics-cert\") pod \"lws-controller-manager-9d77cc8c4-tglqw\" (UID: \"27e50a48-6c05-4b52-b1d9-8750e9c48e6d\") " pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.604113 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.604087    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jln8g\" (UniqueName: \"kubernetes.io/projected/27e50a48-6c05-4b52-b1d9-8750e9c48e6d-kube-api-access-jln8g\") pod \"lws-controller-manager-9d77cc8c4-tglqw\" (UID: \"27e50a48-6c05-4b52-b1d9-8750e9c48e6d\") " pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.726590 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.726558    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:46.864719 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.864685    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"]
Jul 06 23:55:46.868004 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:55:46.867976    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e50a48_6c05_4b52_b1d9_8750e9c48e6d.slice/crio-8dd09219a8d6b9c098c9c7c35766fe8cfbdb386a0370facbabc34ae13708c6f2 WatchSource:0}: Error finding container 8dd09219a8d6b9c098c9c7c35766fe8cfbdb386a0370facbabc34ae13708c6f2: Status 404 returned error can't find the container with id 8dd09219a8d6b9c098c9c7c35766fe8cfbdb386a0370facbabc34ae13708c6f2
Jul 06 23:55:46.873884 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.873855    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:46.959634 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:46.959600    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:47.688221 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:47.688187    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:47.815686 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:47.815652    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw" event={"ID":"27e50a48-6c05-4b52-b1d9-8750e9c48e6d","Type":"ContainerStarted","Data":"8dd09219a8d6b9c098c9c7c35766fe8cfbdb386a0370facbabc34ae13708c6f2"}
Jul 06 23:55:47.894074 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:47.894032    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:48.000399 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:48.000314    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:48.821493 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:48.821388    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw" event={"ID":"27e50a48-6c05-4b52-b1d9-8750e9c48e6d","Type":"ContainerStarted","Data":"4d12db497e0c5be524816a203a221ea0dce6c76c197796f4ff0b0cb0052ccd0c"}
Jul 06 23:55:48.821493 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:48.821455    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:55:48.856421 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:48.856363    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw" podStartSLOduration=1.303066996 podStartE2EDuration="2.856340934s" totalImagesPullingTime="1.553273938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:48.854961711 +0000 UTC m=+428.462389724" watchObservedRunningTime="2026-07-06 23:55:48.856340934 +0000 UTC m=+428.463768998"
Jul 06 23:55:52.342588 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:52.342548    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:52.467855 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:52.467820    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:52.671939 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:52.671913    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:53.077949 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:53.077871    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:53.699872 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:53.699840    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:53.848833 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:53.848798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:54.047929 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:54.047845    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:55:55.807258 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:55.807220    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jxg7s"
Jul 06 23:55:56.814636 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:56.814604    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-dg52h"
Jul 06 23:55:59.827458 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:55:59.827426    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9d77cc8c4-tglqw"
Jul 06 23:56:18.615241 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:56:18.615150    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:18.716353 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:56:18.716319    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:40.967555 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:56:40.967514    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:41.069515 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:56:41.069481    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:41.152859 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:56:41.152816    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:00.286713 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:00.286672    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:00.428023 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:00.427985    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:00.488451 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:00.488413    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:01.029148 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:01.029116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:01.084444 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:01.084369    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:09.374612 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:09.374568    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:09.983454 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:09.983415    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:11.000448 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:11.000390    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:11.089768 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:11.089709    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:14.392184 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:14.392149    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:16.642993 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:16.642957    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:19.251198 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:19.251167    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:19.596098 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:19.596015    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:22.068002 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:22.067967    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:22.638103 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:22.638069    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:25.034878 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:25.034841    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:25.788865 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:25.788824    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:25.889604 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:25.889570    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:25.956495 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:25.956463    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"]
Jul 06 23:57:25.959056 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:25.959036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"
Jul 06 23:57:25.961898 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:25.961874    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 23:57:25.961898 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:25.961890    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 23:57:25.962082 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:25.961899    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 23:57:25.962082 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:25.961969    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 23:57:25.962858 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:25.962835    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fhz99\""
Jul 06 23:57:25.969678 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:25.969652    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"]
Jul 06 23:57:25.975934 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:25.975912    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:26.099272 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.099173    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97g2l\" (UniqueName: \"kubernetes.io/projected/682456ac-d8cc-46c4-8bc2-63cffd496bc6-kube-api-access-97g2l\") pod \"kuadrant-console-plugin-66b5774985-6sxqm\" (UID: \"682456ac-d8cc-46c4-8bc2-63cffd496bc6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"
Jul 06 23:57:26.099793 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.099318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/682456ac-d8cc-46c4-8bc2-63cffd496bc6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6sxqm\" (UID: \"682456ac-d8cc-46c4-8bc2-63cffd496bc6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"
Jul 06 23:57:26.099793 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.099397    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/682456ac-d8cc-46c4-8bc2-63cffd496bc6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6sxqm\" (UID: \"682456ac-d8cc-46c4-8bc2-63cffd496bc6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"
Jul 06 23:57:26.179198 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.179169    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:26.200822 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.200790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/682456ac-d8cc-46c4-8bc2-63cffd496bc6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6sxqm\" (UID: \"682456ac-d8cc-46c4-8bc2-63cffd496bc6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"
Jul 06 23:57:26.200957 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.200839    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/682456ac-d8cc-46c4-8bc2-63cffd496bc6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6sxqm\" (UID: \"682456ac-d8cc-46c4-8bc2-63cffd496bc6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"
Jul 06 23:57:26.200957 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.200908    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97g2l\" (UniqueName: \"kubernetes.io/projected/682456ac-d8cc-46c4-8bc2-63cffd496bc6-kube-api-access-97g2l\") pod \"kuadrant-console-plugin-66b5774985-6sxqm\" (UID: \"682456ac-d8cc-46c4-8bc2-63cffd496bc6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"
Jul 06 23:57:26.200957 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:57:26.200948    2582 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 06 23:57:26.201082 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:57:26.201034    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682456ac-d8cc-46c4-8bc2-63cffd496bc6-plugin-serving-cert podName:682456ac-d8cc-46c4-8bc2-63cffd496bc6 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:26.701013866 +0000 UTC m=+526.308441854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/682456ac-d8cc-46c4-8bc2-63cffd496bc6-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-6sxqm" (UID: "682456ac-d8cc-46c4-8bc2-63cffd496bc6") : secret "plugin-serving-cert" not found
Jul 06 23:57:26.201536 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.201517    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/682456ac-d8cc-46c4-8bc2-63cffd496bc6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6sxqm\" (UID: \"682456ac-d8cc-46c4-8bc2-63cffd496bc6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"
Jul 06 23:57:26.210538 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.210504    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97g2l\" (UniqueName: \"kubernetes.io/projected/682456ac-d8cc-46c4-8bc2-63cffd496bc6-kube-api-access-97g2l\") pod \"kuadrant-console-plugin-66b5774985-6sxqm\" (UID: \"682456ac-d8cc-46c4-8bc2-63cffd496bc6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"
Jul 06 23:57:26.279299 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.279263    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:26.379403 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.379315    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:26.705626 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.705586    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/682456ac-d8cc-46c4-8bc2-63cffd496bc6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6sxqm\" (UID: \"682456ac-d8cc-46c4-8bc2-63cffd496bc6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"
Jul 06 23:57:26.708124 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.708101    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/682456ac-d8cc-46c4-8bc2-63cffd496bc6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6sxqm\" (UID: \"682456ac-d8cc-46c4-8bc2-63cffd496bc6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"
Jul 06 23:57:26.868468 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:26.868426    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"
Jul 06 23:57:27.000424 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:27.000398    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm"]
Jul 06 23:57:27.002813 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:57:27.002783    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod682456ac_d8cc_46c4_8bc2_63cffd496bc6.slice/crio-4265e0ecfc71262bc40af30d6f6e8abd64f077d7f8d3d604fb97549e49c0ae26 WatchSource:0}: Error finding container 4265e0ecfc71262bc40af30d6f6e8abd64f077d7f8d3d604fb97549e49c0ae26: Status 404 returned error can't find the container with id 4265e0ecfc71262bc40af30d6f6e8abd64f077d7f8d3d604fb97549e49c0ae26
Jul 06 23:57:27.244865 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:27.244829    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm" event={"ID":"682456ac-d8cc-46c4-8bc2-63cffd496bc6","Type":"ContainerStarted","Data":"4265e0ecfc71262bc40af30d6f6e8abd64f077d7f8d3d604fb97549e49c0ae26"}
Jul 06 23:57:28.112983 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:28.112948    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:28.209801 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:28.209763    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:29.786778 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:29.786716    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:29.887275 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:29.887240    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:37.015523 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:37.014945    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:37.106338 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:37.106303    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:41.008846 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:41.008802    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:41.109317 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:41.109279    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:44.797209 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:44.797172    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:44.852436 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:44.852392    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:45.001464 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:45.001306    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:45.102403 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:45.102327    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:47.552817 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:47.552777    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:47.651894 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:47.651862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:50.359659 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:50.359621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm" event={"ID":"682456ac-d8cc-46c4-8bc2-63cffd496bc6","Type":"ContainerStarted","Data":"5291fa2656a3a956a889166b5fd3e6de9f194b53f2d3a0910a1f823ff88ee0ba"}
Jul 06 23:57:50.379888 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:50.379838    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sxqm" podStartSLOduration=2.997593105 podStartE2EDuration="25.379822712s" totalImagesPullingTime="22.382229607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:50.379326631 +0000 UTC m=+549.986754644" watchObservedRunningTime="2026-07-06 23:57:50.379822712 +0000 UTC m=+549.987250772"
Jul 06 23:57:56.753945 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:56.753910    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:56.854192 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:56.854156    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:57.501554 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:57.501520    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:57.603018 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:57.602983    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:59.551922 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:59.551881    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:57:59.608023 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:57:59.607990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:00.642367 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:00.642333    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:00.736556 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:00.736524    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:04.347241 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:04.347196    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:04.407553 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:04.407526    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:04.745553 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:04.745520    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:04.845716 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:04.845681    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:05.414691 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:05.414656    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:05.711228 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:05.711194    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:07.130681 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:07.130641    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:07.234394 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:07.234359    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:07.333980 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:07.333946    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:07.926362 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:07.926321    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-8fgq2"]
Jul 06 23:58:07.929725 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:07.929700    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8fgq2"
Jul 06 23:58:07.932261 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:07.932240    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sgtww\""
Jul 06 23:58:07.939695 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:07.939661    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8fgq2"]
Jul 06 23:58:07.963437 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:07.963406    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:08.023973 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.023945    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:08.083195 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.083155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69qbj\" (UniqueName: \"kubernetes.io/projected/84ad0576-e88d-40ca-8702-3826dbee90c0-kube-api-access-69qbj\") pod \"authorino-58cd955675-8fgq2\" (UID: \"84ad0576-e88d-40ca-8702-3826dbee90c0\") " pod="kuadrant-system/authorino-58cd955675-8fgq2"
Jul 06 23:58:08.140880 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.140842    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-tvc96"]
Jul 06 23:58:08.144150 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.144132    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tvc96"
Jul 06 23:58:08.153229 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.153202    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tvc96"]
Jul 06 23:58:08.184483 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.184394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69qbj\" (UniqueName: \"kubernetes.io/projected/84ad0576-e88d-40ca-8702-3826dbee90c0-kube-api-access-69qbj\") pod \"authorino-58cd955675-8fgq2\" (UID: \"84ad0576-e88d-40ca-8702-3826dbee90c0\") " pod="kuadrant-system/authorino-58cd955675-8fgq2"
Jul 06 23:58:08.192732 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.192709    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69qbj\" (UniqueName: \"kubernetes.io/projected/84ad0576-e88d-40ca-8702-3826dbee90c0-kube-api-access-69qbj\") pod \"authorino-58cd955675-8fgq2\" (UID: \"84ad0576-e88d-40ca-8702-3826dbee90c0\") " pod="kuadrant-system/authorino-58cd955675-8fgq2"
Jul 06 23:58:08.239827 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.239790    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8fgq2"
Jul 06 23:58:08.285704 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.285663    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjvlv\" (UniqueName: \"kubernetes.io/projected/a208558e-0138-4508-8ba7-b4a6272d653e-kube-api-access-rjvlv\") pod \"authorino-75d556bd77-tvc96\" (UID: \"a208558e-0138-4508-8ba7-b4a6272d653e\") " pod="kuadrant-system/authorino-75d556bd77-tvc96"
Jul 06 23:58:08.368176 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.368143    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:08.379770 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.379723    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8fgq2"]
Jul 06 23:58:08.383075 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:58:08.383041    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84ad0576_e88d_40ca_8702_3826dbee90c0.slice/crio-474b6af1aac6f3242340094244efcddb4e129497d0b78f33de0c8447cac0349d WatchSource:0}: Error finding container 474b6af1aac6f3242340094244efcddb4e129497d0b78f33de0c8447cac0349d: Status 404 returned error can't find the container with id 474b6af1aac6f3242340094244efcddb4e129497d0b78f33de0c8447cac0349d
Jul 06 23:58:08.386087 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.386061    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjvlv\" (UniqueName: \"kubernetes.io/projected/a208558e-0138-4508-8ba7-b4a6272d653e-kube-api-access-rjvlv\") pod \"authorino-75d556bd77-tvc96\" (UID: \"a208558e-0138-4508-8ba7-b4a6272d653e\") " pod="kuadrant-system/authorino-75d556bd77-tvc96"
Jul 06 23:58:08.395103 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.395079    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjvlv\" (UniqueName: \"kubernetes.io/projected/a208558e-0138-4508-8ba7-b4a6272d653e-kube-api-access-rjvlv\") pod \"authorino-75d556bd77-tvc96\" (UID: \"a208558e-0138-4508-8ba7-b4a6272d653e\") " pod="kuadrant-system/authorino-75d556bd77-tvc96"
Jul 06 23:58:08.441522 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.441429    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8fgq2" event={"ID":"84ad0576-e88d-40ca-8702-3826dbee90c0","Type":"ContainerStarted","Data":"474b6af1aac6f3242340094244efcddb4e129497d0b78f33de0c8447cac0349d"}
Jul 06 23:58:08.453697 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.453673    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tvc96"
Jul 06 23:58:08.466692 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.466666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:08.586668 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:08.586636    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tvc96"]
Jul 06 23:58:08.589539 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:58:08.589512    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda208558e_0138_4508_8ba7_b4a6272d653e.slice/crio-5d9cb425cb3a3f9501493b5548f73105720187f377ff99cd76f27caf6bcdc4b3 WatchSource:0}: Error finding container 5d9cb425cb3a3f9501493b5548f73105720187f377ff99cd76f27caf6bcdc4b3: Status 404 returned error can't find the container with id 5d9cb425cb3a3f9501493b5548f73105720187f377ff99cd76f27caf6bcdc4b3
Jul 06 23:58:09.450538 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:09.450501    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tvc96" event={"ID":"a208558e-0138-4508-8ba7-b4a6272d653e","Type":"ContainerStarted","Data":"5d9cb425cb3a3f9501493b5548f73105720187f377ff99cd76f27caf6bcdc4b3"}
Jul 06 23:58:12.468036 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:12.467999    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tvc96" event={"ID":"a208558e-0138-4508-8ba7-b4a6272d653e","Type":"ContainerStarted","Data":"b39eac94d592f49129bf9c8cd70ec4585105089750f099b73da8501bed6bd053"}
Jul 06 23:58:12.469417 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:12.469391    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8fgq2" event={"ID":"84ad0576-e88d-40ca-8702-3826dbee90c0","Type":"ContainerStarted","Data":"2786ae7abdbc647e5927eeded8b211e4f015648ce358cd3d70a38627b8a37343"}
Jul 06 23:58:12.485996 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:12.485950    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-tvc96" podStartSLOduration=1.106851117 podStartE2EDuration="4.485936211s" totalImagesPullingTime="3.379085094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:12.484477305 +0000 UTC m=+572.091905317" watchObservedRunningTime="2026-07-06 23:58:12.485936211 +0000 UTC m=+572.093364221"
Jul 06 23:58:12.504213 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:12.504156    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-8fgq2" podStartSLOduration=1.93157366 podStartE2EDuration="5.504138291s" totalImagesPullingTime="3.572564631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:12.503109989 +0000 UTC m=+572.110538000" watchObservedRunningTime="2026-07-06 23:58:12.504138291 +0000 UTC m=+572.111566302"
Jul 06 23:58:12.514856 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:12.514821    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8fgq2"]
Jul 06 23:58:14.477252 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:14.477212    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-8fgq2" podUID="84ad0576-e88d-40ca-8702-3826dbee90c0" containerName="authorino" containerID="cri-o://2786ae7abdbc647e5927eeded8b211e4f015648ce358cd3d70a38627b8a37343" gracePeriod=30
Jul 06 23:58:14.640773 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:14.640702    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:14.695003 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:14.694975    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:14.727426 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:14.727364    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8fgq2"
Jul 06 23:58:14.846616 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:14.846575    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69qbj\" (UniqueName: \"kubernetes.io/projected/84ad0576-e88d-40ca-8702-3826dbee90c0-kube-api-access-69qbj\") pod \"84ad0576-e88d-40ca-8702-3826dbee90c0\" (UID: \"84ad0576-e88d-40ca-8702-3826dbee90c0\") "
Jul 06 23:58:14.849025 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:14.848998    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84ad0576-e88d-40ca-8702-3826dbee90c0-kube-api-access-69qbj" (OuterVolumeSpecName: "kube-api-access-69qbj") pod "84ad0576-e88d-40ca-8702-3826dbee90c0" (UID: "84ad0576-e88d-40ca-8702-3826dbee90c0"). InnerVolumeSpecName "kube-api-access-69qbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:58:14.947246 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:14.947205    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69qbj\" (UniqueName: \"kubernetes.io/projected/84ad0576-e88d-40ca-8702-3826dbee90c0-kube-api-access-69qbj\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:58:15.482159 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:15.482115    2582 generic.go:356] "Generic (PLEG): container finished" podID="84ad0576-e88d-40ca-8702-3826dbee90c0" containerID="2786ae7abdbc647e5927eeded8b211e4f015648ce358cd3d70a38627b8a37343" exitCode=0
Jul 06 23:58:15.482607 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:15.482179    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8fgq2"
Jul 06 23:58:15.482607 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:15.482198    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8fgq2" event={"ID":"84ad0576-e88d-40ca-8702-3826dbee90c0","Type":"ContainerDied","Data":"2786ae7abdbc647e5927eeded8b211e4f015648ce358cd3d70a38627b8a37343"}
Jul 06 23:58:15.482607 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:15.482241    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8fgq2" event={"ID":"84ad0576-e88d-40ca-8702-3826dbee90c0","Type":"ContainerDied","Data":"474b6af1aac6f3242340094244efcddb4e129497d0b78f33de0c8447cac0349d"}
Jul 06 23:58:15.482607 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:15.482257    2582 scope.go:117] "RemoveContainer" containerID="2786ae7abdbc647e5927eeded8b211e4f015648ce358cd3d70a38627b8a37343"
Jul 06 23:58:15.490826 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:15.490809    2582 scope.go:117] "RemoveContainer" containerID="2786ae7abdbc647e5927eeded8b211e4f015648ce358cd3d70a38627b8a37343"
Jul 06 23:58:15.491128 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:58:15.491107    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2786ae7abdbc647e5927eeded8b211e4f015648ce358cd3d70a38627b8a37343\": container with ID starting with 2786ae7abdbc647e5927eeded8b211e4f015648ce358cd3d70a38627b8a37343 not found: ID does not exist" containerID="2786ae7abdbc647e5927eeded8b211e4f015648ce358cd3d70a38627b8a37343"
Jul 06 23:58:15.491174 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:15.491136    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2786ae7abdbc647e5927eeded8b211e4f015648ce358cd3d70a38627b8a37343"} err="failed to get container status \"2786ae7abdbc647e5927eeded8b211e4f015648ce358cd3d70a38627b8a37343\": rpc error: code = NotFound desc = could not find container \"2786ae7abdbc647e5927eeded8b211e4f015648ce358cd3d70a38627b8a37343\": container with ID starting with 2786ae7abdbc647e5927eeded8b211e4f015648ce358cd3d70a38627b8a37343 not found: ID does not exist"
Jul 06 23:58:15.497578 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:15.497553    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8fgq2"]
Jul 06 23:58:15.503251 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:15.503223    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-8fgq2"]
Jul 06 23:58:16.963347 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:16.963312    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84ad0576-e88d-40ca-8702-3826dbee90c0" path="/var/lib/kubelet/pods/84ad0576-e88d-40ca-8702-3826dbee90c0/volumes"
Jul 06 23:58:19.386056 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:19.386015    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:19.491482 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:19.491446    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:28.757139 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:28.757106    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:40.689141 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:40.689087    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:40.848732 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:40.848699    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 06 23:58:40.850262 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:40.850240    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 06 23:58:40.883536 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:40.883509    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d4mg5"]
Jul 06 23:58:40.883845 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:40.883832    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84ad0576-e88d-40ca-8702-3826dbee90c0" containerName="authorino"
Jul 06 23:58:40.883912 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:40.883847    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="84ad0576-e88d-40ca-8702-3826dbee90c0" containerName="authorino"
Jul 06 23:58:40.883912 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:40.883901    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="84ad0576-e88d-40ca-8702-3826dbee90c0" containerName="authorino"
Jul 06 23:58:40.885929 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:40.885913    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-d4mg5"
Jul 06 23:58:40.893676 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:40.893643    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d4mg5"]
Jul 06 23:58:40.905901 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:40.905873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:40.969327 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:40.969243    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7xnw\" (UniqueName: \"kubernetes.io/projected/9fb7c883-3893-4e5c-9eb0-6526e641478d-kube-api-access-d7xnw\") pod \"authorino-5d4b67c446-d4mg5\" (UID: \"9fb7c883-3893-4e5c-9eb0-6526e641478d\") " pod="kuadrant-system/authorino-5d4b67c446-d4mg5"
Jul 06 23:58:41.066869 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.066834    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d4mg5"]
Jul 06 23:58:41.067113 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:58:41.067092    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d7xnw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-d4mg5" podUID="9fb7c883-3893-4e5c-9eb0-6526e641478d"
Jul 06 23:58:41.070523 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.070496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7xnw\" (UniqueName: \"kubernetes.io/projected/9fb7c883-3893-4e5c-9eb0-6526e641478d-kube-api-access-d7xnw\") pod \"authorino-5d4b67c446-d4mg5\" (UID: \"9fb7c883-3893-4e5c-9eb0-6526e641478d\") " pod="kuadrant-system/authorino-5d4b67c446-d4mg5"
Jul 06 23:58:41.082395 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.082360    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7xnw\" (UniqueName: \"kubernetes.io/projected/9fb7c883-3893-4e5c-9eb0-6526e641478d-kube-api-access-d7xnw\") pod \"authorino-5d4b67c446-d4mg5\" (UID: \"9fb7c883-3893-4e5c-9eb0-6526e641478d\") " pod="kuadrant-system/authorino-5d4b67c446-d4mg5"
Jul 06 23:58:41.096805 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.096765    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-k2xdm"]
Jul 06 23:58:41.100553 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.100459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-k2xdm"
Jul 06 23:58:41.104147 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.104117    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 23:58:41.106661 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.106624    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-k2xdm"]
Jul 06 23:58:41.146647 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.146613    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-k2xdm"]
Jul 06 23:58:41.146888 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:58:41.146867    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-48vh7 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-48vh7 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-k2xdm" podUID="d32ecf31-da8b-42e8-9058-2b9b026e422f"
Jul 06 23:58:41.171693 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.171659    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d32ecf31-da8b-42e8-9058-2b9b026e422f-tls-cert\") pod \"authorino-76877994-k2xdm\" (UID: \"d32ecf31-da8b-42e8-9058-2b9b026e422f\") " pod="kuadrant-system/authorino-76877994-k2xdm"
Jul 06 23:58:41.171877 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.171699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48vh7\" (UniqueName: \"kubernetes.io/projected/d32ecf31-da8b-42e8-9058-2b9b026e422f-kube-api-access-48vh7\") pod \"authorino-76877994-k2xdm\" (UID: \"d32ecf31-da8b-42e8-9058-2b9b026e422f\") " pod="kuadrant-system/authorino-76877994-k2xdm"
Jul 06 23:58:41.176436 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.176409    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7647bbf65-5szwr"]
Jul 06 23:58:41.178903 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.178886    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7647bbf65-5szwr"
Jul 06 23:58:41.187644 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.187615    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7647bbf65-5szwr"]
Jul 06 23:58:41.272697 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.272601    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7905edd1-7f90-44a7-b472-f515806bd529-tls-cert\") pod \"authorino-7647bbf65-5szwr\" (UID: \"7905edd1-7f90-44a7-b472-f515806bd529\") " pod="kuadrant-system/authorino-7647bbf65-5szwr"
Jul 06 23:58:41.272697 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.272660    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6scl\" (UniqueName: \"kubernetes.io/projected/7905edd1-7f90-44a7-b472-f515806bd529-kube-api-access-w6scl\") pod \"authorino-7647bbf65-5szwr\" (UID: \"7905edd1-7f90-44a7-b472-f515806bd529\") " pod="kuadrant-system/authorino-7647bbf65-5szwr"
Jul 06 23:58:41.272927 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.272715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d32ecf31-da8b-42e8-9058-2b9b026e422f-tls-cert\") pod \"authorino-76877994-k2xdm\" (UID: \"d32ecf31-da8b-42e8-9058-2b9b026e422f\") " pod="kuadrant-system/authorino-76877994-k2xdm"
Jul 06 23:58:41.272927 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.272821    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48vh7\" (UniqueName: \"kubernetes.io/projected/d32ecf31-da8b-42e8-9058-2b9b026e422f-kube-api-access-48vh7\") pod \"authorino-76877994-k2xdm\" (UID: \"d32ecf31-da8b-42e8-9058-2b9b026e422f\") " pod="kuadrant-system/authorino-76877994-k2xdm"
Jul 06 23:58:41.275372 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.275350    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d32ecf31-da8b-42e8-9058-2b9b026e422f-tls-cert\") pod \"authorino-76877994-k2xdm\" (UID: \"d32ecf31-da8b-42e8-9058-2b9b026e422f\") " pod="kuadrant-system/authorino-76877994-k2xdm"
Jul 06 23:58:41.280832 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.280800    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48vh7\" (UniqueName: \"kubernetes.io/projected/d32ecf31-da8b-42e8-9058-2b9b026e422f-kube-api-access-48vh7\") pod \"authorino-76877994-k2xdm\" (UID: \"d32ecf31-da8b-42e8-9058-2b9b026e422f\") " pod="kuadrant-system/authorino-76877994-k2xdm"
Jul 06 23:58:41.373832 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.373795    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6scl\" (UniqueName: \"kubernetes.io/projected/7905edd1-7f90-44a7-b472-f515806bd529-kube-api-access-w6scl\") pod \"authorino-7647bbf65-5szwr\" (UID: \"7905edd1-7f90-44a7-b472-f515806bd529\") " pod="kuadrant-system/authorino-7647bbf65-5szwr"
Jul 06 23:58:41.374179 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.373894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7905edd1-7f90-44a7-b472-f515806bd529-tls-cert\") pod \"authorino-7647bbf65-5szwr\" (UID: \"7905edd1-7f90-44a7-b472-f515806bd529\") " pod="kuadrant-system/authorino-7647bbf65-5szwr"
Jul 06 23:58:41.376441 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.376419    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7905edd1-7f90-44a7-b472-f515806bd529-tls-cert\") pod \"authorino-7647bbf65-5szwr\" (UID: \"7905edd1-7f90-44a7-b472-f515806bd529\") " pod="kuadrant-system/authorino-7647bbf65-5szwr"
Jul 06 23:58:41.382300 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.382272    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6scl\" (UniqueName: \"kubernetes.io/projected/7905edd1-7f90-44a7-b472-f515806bd529-kube-api-access-w6scl\") pod \"authorino-7647bbf65-5szwr\" (UID: \"7905edd1-7f90-44a7-b472-f515806bd529\") " pod="kuadrant-system/authorino-7647bbf65-5szwr"
Jul 06 23:58:41.488967 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.488926    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7647bbf65-5szwr"
Jul 06 23:58:41.592392 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.592362    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-k2xdm"
Jul 06 23:58:41.592583 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.592564    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-d4mg5"
Jul 06 23:58:41.608245 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.608216    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-k2xdm"
Jul 06 23:58:41.612709 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.612682    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-d4mg5"
Jul 06 23:58:41.633321 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.633295    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7647bbf65-5szwr"]
Jul 06 23:58:41.635723 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:58:41.635691    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7905edd1_7f90_44a7_b472_f515806bd529.slice/crio-f869193c83ef72ff22a9b352bd1d04d0d45a9b0f623fc17c60a203c68612c97d WatchSource:0}: Error finding container f869193c83ef72ff22a9b352bd1d04d0d45a9b0f623fc17c60a203c68612c97d: Status 404 returned error can't find the container with id f869193c83ef72ff22a9b352bd1d04d0d45a9b0f623fc17c60a203c68612c97d
Jul 06 23:58:41.676813 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.676782    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d32ecf31-da8b-42e8-9058-2b9b026e422f-tls-cert\") pod \"d32ecf31-da8b-42e8-9058-2b9b026e422f\" (UID: \"d32ecf31-da8b-42e8-9058-2b9b026e422f\") "
Jul 06 23:58:41.676969 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.676829    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48vh7\" (UniqueName: \"kubernetes.io/projected/d32ecf31-da8b-42e8-9058-2b9b026e422f-kube-api-access-48vh7\") pod \"d32ecf31-da8b-42e8-9058-2b9b026e422f\" (UID: \"d32ecf31-da8b-42e8-9058-2b9b026e422f\") "
Jul 06 23:58:41.676969 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.676887    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7xnw\" (UniqueName: \"kubernetes.io/projected/9fb7c883-3893-4e5c-9eb0-6526e641478d-kube-api-access-d7xnw\") pod \"9fb7c883-3893-4e5c-9eb0-6526e641478d\" (UID: \"9fb7c883-3893-4e5c-9eb0-6526e641478d\") "
Jul 06 23:58:41.679129 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.679093    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb7c883-3893-4e5c-9eb0-6526e641478d-kube-api-access-d7xnw" (OuterVolumeSpecName: "kube-api-access-d7xnw") pod "9fb7c883-3893-4e5c-9eb0-6526e641478d" (UID: "9fb7c883-3893-4e5c-9eb0-6526e641478d"). InnerVolumeSpecName "kube-api-access-d7xnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:58:41.679262 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.679134    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d32ecf31-da8b-42e8-9058-2b9b026e422f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d32ecf31-da8b-42e8-9058-2b9b026e422f" (UID: "d32ecf31-da8b-42e8-9058-2b9b026e422f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:58:41.679262 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.679141    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d32ecf31-da8b-42e8-9058-2b9b026e422f-kube-api-access-48vh7" (OuterVolumeSpecName: "kube-api-access-48vh7") pod "d32ecf31-da8b-42e8-9058-2b9b026e422f" (UID: "d32ecf31-da8b-42e8-9058-2b9b026e422f"). InnerVolumeSpecName "kube-api-access-48vh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:58:41.777720 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.777683    2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d32ecf31-da8b-42e8-9058-2b9b026e422f-tls-cert\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:58:41.777720 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.777713    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48vh7\" (UniqueName: \"kubernetes.io/projected/d32ecf31-da8b-42e8-9058-2b9b026e422f-kube-api-access-48vh7\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:58:41.777720 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:41.777723    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7xnw\" (UniqueName: \"kubernetes.io/projected/9fb7c883-3893-4e5c-9eb0-6526e641478d-kube-api-access-d7xnw\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:58:42.597801 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.597770    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-k2xdm"
Jul 06 23:58:42.597801 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.597785    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7647bbf65-5szwr" event={"ID":"7905edd1-7f90-44a7-b472-f515806bd529","Type":"ContainerStarted","Data":"3dd110f4da9c41f2ab80ba27072c4aa6fa8fd0a6b92e832e5960c859edc63518"}
Jul 06 23:58:42.598110 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.597822    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7647bbf65-5szwr" event={"ID":"7905edd1-7f90-44a7-b472-f515806bd529","Type":"ContainerStarted","Data":"f869193c83ef72ff22a9b352bd1d04d0d45a9b0f623fc17c60a203c68612c97d"}
Jul 06 23:58:42.598110 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.597955    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-d4mg5"
Jul 06 23:58:42.615268 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.615208    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7647bbf65-5szwr" podStartSLOduration=1.1524570650000001 podStartE2EDuration="1.61519333s" totalImagesPullingTime="462.736265ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:42.613071643 +0000 UTC m=+602.220499656" watchObservedRunningTime="2026-07-06 23:58:42.61519333 +0000 UTC m=+602.222621341"
Jul 06 23:58:42.641310 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.641271    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tvc96"]
Jul 06 23:58:42.641525 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.641500    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-tvc96" podUID="a208558e-0138-4508-8ba7-b4a6272d653e" containerName="authorino" containerID="cri-o://b39eac94d592f49129bf9c8cd70ec4585105089750f099b73da8501bed6bd053" gracePeriod=30
Jul 06 23:58:42.645865 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.645835    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-k2xdm"]
Jul 06 23:58:42.654027 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.654005    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-k2xdm"]
Jul 06 23:58:42.673586 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.673556    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d4mg5"]
Jul 06 23:58:42.677599 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.677564    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d4mg5"]
Jul 06 23:58:42.872842 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.872818    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tvc96"
Jul 06 23:58:42.963976 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.963945    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fb7c883-3893-4e5c-9eb0-6526e641478d" path="/var/lib/kubelet/pods/9fb7c883-3893-4e5c-9eb0-6526e641478d/volumes"
Jul 06 23:58:42.964223 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.964183    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d32ecf31-da8b-42e8-9058-2b9b026e422f" path="/var/lib/kubelet/pods/d32ecf31-da8b-42e8-9058-2b9b026e422f/volumes"
Jul 06 23:58:42.989188 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.989151    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjvlv\" (UniqueName: \"kubernetes.io/projected/a208558e-0138-4508-8ba7-b4a6272d653e-kube-api-access-rjvlv\") pod \"a208558e-0138-4508-8ba7-b4a6272d653e\" (UID: \"a208558e-0138-4508-8ba7-b4a6272d653e\") "
Jul 06 23:58:42.991351 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:42.991317    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a208558e-0138-4508-8ba7-b4a6272d653e-kube-api-access-rjvlv" (OuterVolumeSpecName: "kube-api-access-rjvlv") pod "a208558e-0138-4508-8ba7-b4a6272d653e" (UID: "a208558e-0138-4508-8ba7-b4a6272d653e"). InnerVolumeSpecName "kube-api-access-rjvlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:58:43.090069 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:43.090039    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjvlv\" (UniqueName: \"kubernetes.io/projected/a208558e-0138-4508-8ba7-b4a6272d653e-kube-api-access-rjvlv\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 06 23:58:43.603806 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:43.603764    2582 generic.go:356] "Generic (PLEG): container finished" podID="a208558e-0138-4508-8ba7-b4a6272d653e" containerID="b39eac94d592f49129bf9c8cd70ec4585105089750f099b73da8501bed6bd053" exitCode=0
Jul 06 23:58:43.603806 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:43.603810    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tvc96"
Jul 06 23:58:43.604063 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:43.603853    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tvc96" event={"ID":"a208558e-0138-4508-8ba7-b4a6272d653e","Type":"ContainerDied","Data":"b39eac94d592f49129bf9c8cd70ec4585105089750f099b73da8501bed6bd053"}
Jul 06 23:58:43.604063 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:43.603892    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tvc96" event={"ID":"a208558e-0138-4508-8ba7-b4a6272d653e","Type":"ContainerDied","Data":"5d9cb425cb3a3f9501493b5548f73105720187f377ff99cd76f27caf6bcdc4b3"}
Jul 06 23:58:43.604063 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:43.603915    2582 scope.go:117] "RemoveContainer" containerID="b39eac94d592f49129bf9c8cd70ec4585105089750f099b73da8501bed6bd053"
Jul 06 23:58:43.621476 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:43.621446    2582 scope.go:117] "RemoveContainer" containerID="b39eac94d592f49129bf9c8cd70ec4585105089750f099b73da8501bed6bd053"
Jul 06 23:58:43.621859 ip-10-0-129-95 kubenswrapper[2582]: E0706 23:58:43.621836    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b39eac94d592f49129bf9c8cd70ec4585105089750f099b73da8501bed6bd053\": container with ID starting with b39eac94d592f49129bf9c8cd70ec4585105089750f099b73da8501bed6bd053 not found: ID does not exist" containerID="b39eac94d592f49129bf9c8cd70ec4585105089750f099b73da8501bed6bd053"
Jul 06 23:58:43.621920 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:43.621869    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b39eac94d592f49129bf9c8cd70ec4585105089750f099b73da8501bed6bd053"} err="failed to get container status \"b39eac94d592f49129bf9c8cd70ec4585105089750f099b73da8501bed6bd053\": rpc error: code = NotFound desc = could not find container \"b39eac94d592f49129bf9c8cd70ec4585105089750f099b73da8501bed6bd053\": container with ID starting with b39eac94d592f49129bf9c8cd70ec4585105089750f099b73da8501bed6bd053 not found: ID does not exist"
Jul 06 23:58:43.624867 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:43.624838    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tvc96"]
Jul 06 23:58:43.628551 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:43.628529    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tvc96"]
Jul 06 23:58:44.963785 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:44.963724    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a208558e-0138-4508-8ba7-b4a6272d653e" path="/var/lib/kubelet/pods/a208558e-0138-4508-8ba7-b4a6272d653e/volumes"
Jul 06 23:58:47.009172 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:47.009139    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:47.104139 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:47.104105    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:47.170690 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:47.170654    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:47.522855 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:47.522814    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:50.348019 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:50.347988    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:58:50.446197 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:58:50.446168    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:17.089843 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:17.089806    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:21.107636 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:21.107601    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:21.621769 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:21.621722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:21.813677 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:21.813639    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:22.042665 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:22.042631    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:22.142153 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:22.142115    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:27.029003 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:27.028969    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:32.671545 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:32.671487    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:32.826942 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:32.826902    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:47.162316 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:47.162279    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:51.781689 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.781655    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"]
Jul 06 23:59:51.782166 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.782150    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a208558e-0138-4508-8ba7-b4a6272d653e" containerName="authorino"
Jul 06 23:59:51.782212 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.782170    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a208558e-0138-4508-8ba7-b4a6272d653e" containerName="authorino"
Jul 06 23:59:51.782258 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.782245    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a208558e-0138-4508-8ba7-b4a6272d653e" containerName="authorino"
Jul 06 23:59:51.786543 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.786523    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.789763 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.789714    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4pfpg\""
Jul 06 23:59:51.789763 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.789731    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 23:59:51.789943 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.789786    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 23:59:51.789943 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.789721    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 23:59:51.798215 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.798188    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"]
Jul 06 23:59:51.812009 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.811975    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:51.889016 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.888974    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.889200 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.889026    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28b6w\" (UniqueName: \"kubernetes.io/projected/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-kube-api-access-28b6w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.889200 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.889122    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.889200 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.889174    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.889307 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.889233    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.889307 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.889270    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.990670 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.990626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.990670 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.990673    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28b6w\" (UniqueName: \"kubernetes.io/projected/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-kube-api-access-28b6w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.990928 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.990715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.990928 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.990781    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.990928 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.990819    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.990928 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.990853    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.991227 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.991200    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.991227 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.991211    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.991328 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.991251    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.993136 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.993113    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.993332 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.993316    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:51.998731 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:51.998707    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28b6w\" (UniqueName: \"kubernetes.io/projected/8c5d16a6-344a-43e7-9237-fd1ab8a9db02-kube-api-access-28b6w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw\" (UID: \"8c5d16a6-344a-43e7-9237-fd1ab8a9db02\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:52.104073 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:52.103983    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 06 23:59:52.243332 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:52.243306    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"]
Jul 06 23:59:52.245932 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:59:52.245901    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5d16a6_344a_43e7_9237_fd1ab8a9db02.slice/crio-7f63a363f31212b4e4cdc7a8a7d6644f837295e1490e6e8f519c414d191f078d WatchSource:0}: Error finding container 7f63a363f31212b4e4cdc7a8a7d6644f837295e1490e6e8f519c414d191f078d: Status 404 returned error can't find the container with id 7f63a363f31212b4e4cdc7a8a7d6644f837295e1490e6e8f519c414d191f078d
Jul 06 23:59:52.905361 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:52.905318    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw" event={"ID":"8c5d16a6-344a-43e7-9237-fd1ab8a9db02","Type":"ContainerStarted","Data":"7f63a363f31212b4e4cdc7a8a7d6644f837295e1490e6e8f519c414d191f078d"}
Jul 06 23:59:53.910520 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:53.910488    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw" event={"ID":"8c5d16a6-344a-43e7-9237-fd1ab8a9db02","Type":"ContainerStarted","Data":"b803be6324c34619e7a21b3414e8e89bd245a60f6b8d05fa3d7662d4ea0483ef"}
Jul 06 23:59:53.927627 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:53.927569    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw" podStartSLOduration=1.845721088 podStartE2EDuration="2.927550684s" totalImagesPullingTime="1.081829596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:53.927175573 +0000 UTC m=+673.534603585" watchObservedRunningTime="2026-07-06 23:59:53.927550684 +0000 UTC m=+673.534978694"
Jul 06 23:59:57.467821 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.467784    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"]
Jul 06 23:59:57.471632 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.471615    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.474158 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.474137    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 23:59:57.480569 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.480540    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"]
Jul 06 23:59:57.492449 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.492421    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 06 23:59:57.642789 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.642721    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3841f22-dc16-4ed0-b526-6b2da532b303-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.642989 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.642806    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3841f22-dc16-4ed0-b526-6b2da532b303-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.642989 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.642845    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkr85\" (UniqueName: \"kubernetes.io/projected/f3841f22-dc16-4ed0-b526-6b2da532b303-kube-api-access-pkr85\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.642989 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.642940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3841f22-dc16-4ed0-b526-6b2da532b303-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.642989 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.642981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3841f22-dc16-4ed0-b526-6b2da532b303-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.643160 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.643012    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3841f22-dc16-4ed0-b526-6b2da532b303-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.744502 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.744411    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3841f22-dc16-4ed0-b526-6b2da532b303-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.744502 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.744450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3841f22-dc16-4ed0-b526-6b2da532b303-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.744502 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.744480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3841f22-dc16-4ed0-b526-6b2da532b303-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.744775 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.744526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3841f22-dc16-4ed0-b526-6b2da532b303-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.744775 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.744556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3841f22-dc16-4ed0-b526-6b2da532b303-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.744775 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.744575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkr85\" (UniqueName: \"kubernetes.io/projected/f3841f22-dc16-4ed0-b526-6b2da532b303-kube-api-access-pkr85\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.744911 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.744886    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3841f22-dc16-4ed0-b526-6b2da532b303-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.744974 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.744955    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3841f22-dc16-4ed0-b526-6b2da532b303-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.745039 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.745023    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3841f22-dc16-4ed0-b526-6b2da532b303-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.746945 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.746920    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3841f22-dc16-4ed0-b526-6b2da532b303-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.747196 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.747176    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3841f22-dc16-4ed0-b526-6b2da532b303-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.753174 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.753148    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkr85\" (UniqueName: \"kubernetes.io/projected/f3841f22-dc16-4ed0-b526-6b2da532b303-kube-api-access-pkr85\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7q47w\" (UID: \"f3841f22-dc16-4ed0-b526-6b2da532b303\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.783230 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.783182    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 06 23:59:57.917851 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.917826    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"]
Jul 06 23:59:57.919818 ip-10-0-129-95 kubenswrapper[2582]: W0706 23:59:57.919791    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3841f22_dc16_4ed0_b526_6b2da532b303.slice/crio-c9089affe9695bbb8f3901bb5d5a3cdaf5f747e09829c551ca0d1c14bbb7b841 WatchSource:0}: Error finding container c9089affe9695bbb8f3901bb5d5a3cdaf5f747e09829c551ca0d1c14bbb7b841: Status 404 returned error can't find the container with id c9089affe9695bbb8f3901bb5d5a3cdaf5f747e09829c551ca0d1c14bbb7b841
Jul 06 23:59:57.931602 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:57.931575    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w" event={"ID":"f3841f22-dc16-4ed0-b526-6b2da532b303","Type":"ContainerStarted","Data":"c9089affe9695bbb8f3901bb5d5a3cdaf5f747e09829c551ca0d1c14bbb7b841"}
Jul 06 23:59:58.939206 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:58.939166    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w" event={"ID":"f3841f22-dc16-4ed0-b526-6b2da532b303","Type":"ContainerStarted","Data":"599d294072a7ded55c18603cc94acecb96686e87f83dedd122f0a14346866017"}
Jul 06 23:59:58.957190 ip-10-0-129-95 kubenswrapper[2582]: I0706 23:59:58.957137    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w" podStartSLOduration=1.772919333 podStartE2EDuration="1.957119429s" totalImagesPullingTime="184.200096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:59:58.955080593 +0000 UTC m=+678.562508606" watchObservedRunningTime="2026-07-06 23:59:58.957119429 +0000 UTC m=+678.564547439"
Jul 07 00:00:01.614286 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:01.614258    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:02.104425 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:02.104378    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 07 00:00:02.104617 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:02.104454    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 07 00:00:02.116871 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:02.116843    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 07 00:00:02.969260 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:02.969225    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw"
Jul 07 00:00:07.783851 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:07.783808    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 07 00:00:07.784274 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:07.783879    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 07 00:00:07.796411 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:07.796387    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 07 00:00:07.988160 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:07.988130    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7q47w"
Jul 07 00:00:13.404660 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:13.404624    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:24.905229 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:24.905197    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:32.840280 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:32.840186    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:40.671175 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:40.671138    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:40.772298 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:40.772267    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:47.772652 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.772619    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"]
Jul 07 00:00:47.775425 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.775402    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.777876 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.777851    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 07 00:00:47.784860 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.784835    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"]
Jul 07 00:00:47.808160 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.808125    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:00:47.876310 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.876265    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e67625ff-e529-4343-9d37-1ed198bf1d4a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.876310 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.876309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcdbl\" (UniqueName: \"kubernetes.io/projected/e67625ff-e529-4343-9d37-1ed198bf1d4a-kube-api-access-xcdbl\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.876531 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.876347    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e67625ff-e529-4343-9d37-1ed198bf1d4a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.876531 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.876441    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e67625ff-e529-4343-9d37-1ed198bf1d4a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.876531 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.876481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e67625ff-e529-4343-9d37-1ed198bf1d4a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.876531 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.876513    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e67625ff-e529-4343-9d37-1ed198bf1d4a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.977426 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.977385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e67625ff-e529-4343-9d37-1ed198bf1d4a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.977426 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.977426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcdbl\" (UniqueName: \"kubernetes.io/projected/e67625ff-e529-4343-9d37-1ed198bf1d4a-kube-api-access-xcdbl\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.977685 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.977469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e67625ff-e529-4343-9d37-1ed198bf1d4a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.977685 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.977506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e67625ff-e529-4343-9d37-1ed198bf1d4a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.977832 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.977680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e67625ff-e529-4343-9d37-1ed198bf1d4a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.977832 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.977795    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e67625ff-e529-4343-9d37-1ed198bf1d4a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.977932 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.977893    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e67625ff-e529-4343-9d37-1ed198bf1d4a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.977932 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.977912    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e67625ff-e529-4343-9d37-1ed198bf1d4a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.978128 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.978107    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e67625ff-e529-4343-9d37-1ed198bf1d4a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.980107 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.980084    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e67625ff-e529-4343-9d37-1ed198bf1d4a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.980392 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.980371    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e67625ff-e529-4343-9d37-1ed198bf1d4a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:47.986595 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:47.986558    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcdbl\" (UniqueName: \"kubernetes.io/projected/e67625ff-e529-4343-9d37-1ed198bf1d4a-kube-api-access-xcdbl\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl\" (UID: \"e67625ff-e529-4343-9d37-1ed198bf1d4a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:48.086637 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:48.086540    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:48.221405 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:48.221368    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"]
Jul 07 00:00:48.224390 ip-10-0-129-95 kubenswrapper[2582]: W0707 00:00:48.224363    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode67625ff_e529_4343_9d37_1ed198bf1d4a.slice/crio-1f2490d2e56073780de8625da6b5f6283e2d27b3947646787051ecc273503f7f WatchSource:0}: Error finding container 1f2490d2e56073780de8625da6b5f6283e2d27b3947646787051ecc273503f7f: Status 404 returned error can't find the container with id 1f2490d2e56073780de8625da6b5f6283e2d27b3947646787051ecc273503f7f
Jul 07 00:00:48.226081 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:48.226063    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:00:49.154460 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:49.154367    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl" event={"ID":"e67625ff-e529-4343-9d37-1ed198bf1d4a","Type":"ContainerStarted","Data":"91fc52d35912557344ab49e82c0cc79e7c31aa335300f3039c85924097bd561b"}
Jul 07 00:00:49.154460 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:49.154409    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl" event={"ID":"e67625ff-e529-4343-9d37-1ed198bf1d4a","Type":"ContainerStarted","Data":"1f2490d2e56073780de8625da6b5f6283e2d27b3947646787051ecc273503f7f"}
Jul 07 00:00:49.175991 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:49.175928    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl" podStartSLOduration=1.706190224 podStartE2EDuration="2.17590764s" totalImagesPullingTime="469.717416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:49.171887321 +0000 UTC m=+728.779315343" watchObservedRunningTime="2026-07-07 00:00:49.17590764 +0000 UTC m=+728.783335652"
Jul 07 00:00:58.087271 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:58.087229    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:58.087790 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:58.087540    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:58.099914 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:58.099884    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:00:58.208825 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:00:58.208794    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl"
Jul 07 00:01:37.690879 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:37.690838    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-756c6985b-rf8ss"]
Jul 07 00:01:37.693329 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:37.693311    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-756c6985b-rf8ss"
Jul 07 00:01:37.702696 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:37.702666    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-756c6985b-rf8ss"]
Jul 07 00:01:37.808041 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:37.808004    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aea9803f-4c6a-4522-8700-d9fec9108709-tls-cert\") pod \"authorino-756c6985b-rf8ss\" (UID: \"aea9803f-4c6a-4522-8700-d9fec9108709\") " pod="kuadrant-system/authorino-756c6985b-rf8ss"
Jul 07 00:01:37.808215 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:37.808065    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5xbg\" (UniqueName: \"kubernetes.io/projected/aea9803f-4c6a-4522-8700-d9fec9108709-kube-api-access-k5xbg\") pod \"authorino-756c6985b-rf8ss\" (UID: \"aea9803f-4c6a-4522-8700-d9fec9108709\") " pod="kuadrant-system/authorino-756c6985b-rf8ss"
Jul 07 00:01:37.877196 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:37.877159    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:37.909451 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:37.909406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aea9803f-4c6a-4522-8700-d9fec9108709-tls-cert\") pod \"authorino-756c6985b-rf8ss\" (UID: \"aea9803f-4c6a-4522-8700-d9fec9108709\") " pod="kuadrant-system/authorino-756c6985b-rf8ss"
Jul 07 00:01:37.909602 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:37.909468    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5xbg\" (UniqueName: \"kubernetes.io/projected/aea9803f-4c6a-4522-8700-d9fec9108709-kube-api-access-k5xbg\") pod \"authorino-756c6985b-rf8ss\" (UID: \"aea9803f-4c6a-4522-8700-d9fec9108709\") " pod="kuadrant-system/authorino-756c6985b-rf8ss"
Jul 07 00:01:37.912163 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:37.912139    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aea9803f-4c6a-4522-8700-d9fec9108709-tls-cert\") pod \"authorino-756c6985b-rf8ss\" (UID: \"aea9803f-4c6a-4522-8700-d9fec9108709\") " pod="kuadrant-system/authorino-756c6985b-rf8ss"
Jul 07 00:01:37.917791 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:37.917766    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5xbg\" (UniqueName: \"kubernetes.io/projected/aea9803f-4c6a-4522-8700-d9fec9108709-kube-api-access-k5xbg\") pod \"authorino-756c6985b-rf8ss\" (UID: \"aea9803f-4c6a-4522-8700-d9fec9108709\") " pod="kuadrant-system/authorino-756c6985b-rf8ss"
Jul 07 00:01:37.975623 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:37.975540    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:38.003555 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:38.003527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-756c6985b-rf8ss"
Jul 07 00:01:38.150350 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:38.150325    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-756c6985b-rf8ss"]
Jul 07 00:01:38.153291 ip-10-0-129-95 kubenswrapper[2582]: W0707 00:01:38.153267    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaea9803f_4c6a_4522_8700_d9fec9108709.slice/crio-c414b49a438aef53e8ae8836446c211b347e552b9cb9fffe8d7c999fa83b03c4 WatchSource:0}: Error finding container c414b49a438aef53e8ae8836446c211b347e552b9cb9fffe8d7c999fa83b03c4: Status 404 returned error can't find the container with id c414b49a438aef53e8ae8836446c211b347e552b9cb9fffe8d7c999fa83b03c4
Jul 07 00:01:38.382491 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:38.382396    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-756c6985b-rf8ss" event={"ID":"aea9803f-4c6a-4522-8700-d9fec9108709","Type":"ContainerStarted","Data":"c414b49a438aef53e8ae8836446c211b347e552b9cb9fffe8d7c999fa83b03c4"}
Jul 07 00:01:39.081025 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:39.080977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:39.180624 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:39.180590    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:01:40.394475 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:40.394443    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-756c6985b-rf8ss" event={"ID":"aea9803f-4c6a-4522-8700-d9fec9108709","Type":"ContainerStarted","Data":"4833247ab22c325d6a005e3e67271bc2b475f9065fc4e5621c10f02b4a0a644b"}
Jul 07 00:01:40.410174 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:40.410111    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-756c6985b-rf8ss" podStartSLOduration=2.126892752 podStartE2EDuration="3.410086817s" totalImagesPullingTime="1.283194065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:40.409429368 +0000 UTC m=+780.016857381" watchObservedRunningTime="2026-07-07 00:01:40.410086817 +0000 UTC m=+780.017514829"
Jul 07 00:01:40.443597 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:40.443565    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7647bbf65-5szwr"]
Jul 07 00:01:40.444045 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:40.444014    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7647bbf65-5szwr" podUID="7905edd1-7f90-44a7-b472-f515806bd529" containerName="authorino" containerID="cri-o://3dd110f4da9c41f2ab80ba27072c4aa6fa8fd0a6b92e832e5960c859edc63518" gracePeriod=30
Jul 07 00:01:40.705402 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:40.705370    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7647bbf65-5szwr"
Jul 07 00:01:40.837185 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:40.837157    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7905edd1-7f90-44a7-b472-f515806bd529-tls-cert\") pod \"7905edd1-7f90-44a7-b472-f515806bd529\" (UID: \"7905edd1-7f90-44a7-b472-f515806bd529\") "
Jul 07 00:01:40.837382 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:40.837209    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6scl\" (UniqueName: \"kubernetes.io/projected/7905edd1-7f90-44a7-b472-f515806bd529-kube-api-access-w6scl\") pod \"7905edd1-7f90-44a7-b472-f515806bd529\" (UID: \"7905edd1-7f90-44a7-b472-f515806bd529\") "
Jul 07 00:01:40.839665 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:40.839636    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7905edd1-7f90-44a7-b472-f515806bd529-kube-api-access-w6scl" (OuterVolumeSpecName: "kube-api-access-w6scl") pod "7905edd1-7f90-44a7-b472-f515806bd529" (UID: "7905edd1-7f90-44a7-b472-f515806bd529"). InnerVolumeSpecName "kube-api-access-w6scl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:01:40.849051 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:40.849013    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7905edd1-7f90-44a7-b472-f515806bd529-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7905edd1-7f90-44a7-b472-f515806bd529" (UID: "7905edd1-7f90-44a7-b472-f515806bd529"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:01:40.938048 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:40.937962    2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7905edd1-7f90-44a7-b472-f515806bd529-tls-cert\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:01:40.938048 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:40.937995    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6scl\" (UniqueName: \"kubernetes.io/projected/7905edd1-7f90-44a7-b472-f515806bd529-kube-api-access-w6scl\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:01:41.402729 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:41.402616    2582 generic.go:356] "Generic (PLEG): container finished" podID="7905edd1-7f90-44a7-b472-f515806bd529" containerID="3dd110f4da9c41f2ab80ba27072c4aa6fa8fd0a6b92e832e5960c859edc63518" exitCode=0
Jul 07 00:01:41.403368 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:41.403337    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7647bbf65-5szwr"
Jul 07 00:01:41.405289 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:41.405255    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7647bbf65-5szwr" event={"ID":"7905edd1-7f90-44a7-b472-f515806bd529","Type":"ContainerDied","Data":"3dd110f4da9c41f2ab80ba27072c4aa6fa8fd0a6b92e832e5960c859edc63518"}
Jul 07 00:01:41.405413 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:41.405311    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7647bbf65-5szwr" event={"ID":"7905edd1-7f90-44a7-b472-f515806bd529","Type":"ContainerDied","Data":"f869193c83ef72ff22a9b352bd1d04d0d45a9b0f623fc17c60a203c68612c97d"}
Jul 07 00:01:41.405413 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:41.405336    2582 scope.go:117] "RemoveContainer" containerID="3dd110f4da9c41f2ab80ba27072c4aa6fa8fd0a6b92e832e5960c859edc63518"
Jul 07 00:01:41.422710 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:41.422683    2582 scope.go:117] "RemoveContainer" containerID="3dd110f4da9c41f2ab80ba27072c4aa6fa8fd0a6b92e832e5960c859edc63518"
Jul 07 00:01:41.423039 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:41.423018    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7647bbf65-5szwr"]
Jul 07 00:01:41.423109 ip-10-0-129-95 kubenswrapper[2582]: E0707 00:01:41.423078    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dd110f4da9c41f2ab80ba27072c4aa6fa8fd0a6b92e832e5960c859edc63518\": container with ID starting with 3dd110f4da9c41f2ab80ba27072c4aa6fa8fd0a6b92e832e5960c859edc63518 not found: ID does not exist" containerID="3dd110f4da9c41f2ab80ba27072c4aa6fa8fd0a6b92e832e5960c859edc63518"
Jul 07 00:01:41.423156 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:41.423101    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd110f4da9c41f2ab80ba27072c4aa6fa8fd0a6b92e832e5960c859edc63518"} err="failed to get container status \"3dd110f4da9c41f2ab80ba27072c4aa6fa8fd0a6b92e832e5960c859edc63518\": rpc error: code = NotFound desc = could not find container \"3dd110f4da9c41f2ab80ba27072c4aa6fa8fd0a6b92e832e5960c859edc63518\": container with ID starting with 3dd110f4da9c41f2ab80ba27072c4aa6fa8fd0a6b92e832e5960c859edc63518 not found: ID does not exist"
Jul 07 00:01:41.426726 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:41.426703    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7647bbf65-5szwr"]
Jul 07 00:01:42.963925 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:01:42.963896    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7905edd1-7f90-44a7-b472-f515806bd529" path="/var/lib/kubelet/pods/7905edd1-7f90-44a7-b472-f515806bd529/volumes"
Jul 07 00:02:50.076059 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:02:50.076027    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:02:51.513465 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:02:51.513429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:34.438823 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:03:34.438682    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:34.537367 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:03:34.537340    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:34.653637 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:03:34.653599    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:38.468333 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:03:38.468298    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:40.509157 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:03:40.509123    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:40.613719 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:03:40.613679    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:40.706881 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:03:40.706844    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:40.876784 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:03:40.876674    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 07 00:03:40.877346 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:03:40.877319    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 07 00:03:41.510862 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:03:41.510821    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:46.669054 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:03:46.669020    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:03:46.741368 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:03:46.741335    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:04:54.430764 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:04:54.430700    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:05:28.081574 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:05:28.081455    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:06:24.516383 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:06:24.516349    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:08:40.903240 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:08:40.903156    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 07 00:08:40.904896 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:08:40.904876    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 07 00:12:46.899077 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:12:46.899039    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:12:48.194902 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:12:48.194862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:13:40.929831 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:13:40.929798    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 07 00:13:40.932582 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:13:40.932547    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 07 00:13:53.205001 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:13:53.204944    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:25.877450 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:25.877354    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:33.389390 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:33.389348    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:41.747560 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:41.747519    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:46.877190 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:46.877144    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:49.887038 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:49.887004    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:49.981046 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:49.978815    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:50.375049 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:50.375017    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:56.092731 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:56.092678    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:56.162465 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:56.162424    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:56.326772 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:56.326715    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:56.422609 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:56.422570    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:57.487990 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:57.487949    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:57.596510 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:57.596474    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:57.678455 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:57.678417    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:58.156453 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:58.156418    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:58.256645 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:58.256614    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:58.472136 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:58.472100    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:14:58.693899 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:14:58.693866    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:00.094771 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.094713    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:00.164214 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.164181    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm"]
Jul 07 00:15:00.164547 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.164534    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7905edd1-7f90-44a7-b472-f515806bd529" containerName="authorino"
Jul 07 00:15:00.164590 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.164550    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7905edd1-7f90-44a7-b472-f515806bd529" containerName="authorino"
Jul 07 00:15:00.164626 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.164616    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7905edd1-7f90-44a7-b472-f515806bd529" containerName="authorino"
Jul 07 00:15:00.167772 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.167730    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm"
Jul 07 00:15:00.173913 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.173889    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8lgjp\""
Jul 07 00:15:00.180134 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.180105    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm"]
Jul 07 00:15:00.321356 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.321305    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mv8b\" (UniqueName: \"kubernetes.io/projected/0f3555f3-48ad-4470-a0c0-a928a4f79ab9-kube-api-access-7mv8b\") pod \"maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm\" (UID: \"0f3555f3-48ad-4470-a0c0-a928a4f79ab9\") " pod="opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm"
Jul 07 00:15:00.422615 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.422578    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mv8b\" (UniqueName: \"kubernetes.io/projected/0f3555f3-48ad-4470-a0c0-a928a4f79ab9-kube-api-access-7mv8b\") pod \"maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm\" (UID: \"0f3555f3-48ad-4470-a0c0-a928a4f79ab9\") " pod="opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm"
Jul 07 00:15:00.431507 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.431481    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mv8b\" (UniqueName: \"kubernetes.io/projected/0f3555f3-48ad-4470-a0c0-a928a4f79ab9-kube-api-access-7mv8b\") pod \"maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm\" (UID: \"0f3555f3-48ad-4470-a0c0-a928a4f79ab9\") " pod="opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm"
Jul 07 00:15:00.478289 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.478248    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm"
Jul 07 00:15:00.616322 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.616297    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm"]
Jul 07 00:15:00.619103 ip-10-0-129-95 kubenswrapper[2582]: W0707 00:15:00.619067    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f3555f3_48ad_4470_a0c0_a928a4f79ab9.slice/crio-75b62f1a3f5ffe562433f4979589f676ad9ecea7bd20bc254792238f76dc9698 WatchSource:0}: Error finding container 75b62f1a3f5ffe562433f4979589f676ad9ecea7bd20bc254792238f76dc9698: Status 404 returned error can't find the container with id 75b62f1a3f5ffe562433f4979589f676ad9ecea7bd20bc254792238f76dc9698
Jul 07 00:15:00.620884 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:00.620866    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:15:01.013799 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:01.013765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm" event={"ID":"0f3555f3-48ad-4470-a0c0-a928a4f79ab9","Type":"ContainerStarted","Data":"75b62f1a3f5ffe562433f4979589f676ad9ecea7bd20bc254792238f76dc9698"}
Jul 07 00:15:02.614708 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:02.614659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:02.786809 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:02.786769    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:02.901411 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:02.901314    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:03.127271 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:03.127229    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:03.131405 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:03.131368    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm"]
Jul 07 00:15:04.029576 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:04.029542    2582 generic.go:356] "Generic (PLEG): container finished" podID="0f3555f3-48ad-4470-a0c0-a928a4f79ab9" containerID="d6c900c8dde688fb41ba8b8cd234972c82c88f6fa0c87206f28354ae189424c1" exitCode=6
Jul 07 00:15:04.029988 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:04.029589    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm" event={"ID":"0f3555f3-48ad-4470-a0c0-a928a4f79ab9","Type":"ContainerDied","Data":"d6c900c8dde688fb41ba8b8cd234972c82c88f6fa0c87206f28354ae189424c1"}
Jul 07 00:15:04.029988 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:04.029729    2582 scope.go:117] "RemoveContainer" containerID="d6c900c8dde688fb41ba8b8cd234972c82c88f6fa0c87206f28354ae189424c1"
Jul 07 00:15:04.700837 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:04.700805    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:05.035407 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:05.035322    2582 generic.go:356] "Generic (PLEG): container finished" podID="0f3555f3-48ad-4470-a0c0-a928a4f79ab9" containerID="9785693e86e3080044535ee5e2c79f5df8c293a863a8b9085b0c5db9204d95c2" exitCode=6
Jul 07 00:15:05.035860 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:05.035413    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm" event={"ID":"0f3555f3-48ad-4470-a0c0-a928a4f79ab9","Type":"ContainerDied","Data":"9785693e86e3080044535ee5e2c79f5df8c293a863a8b9085b0c5db9204d95c2"}
Jul 07 00:15:05.035860 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:05.035477    2582 scope.go:117] "RemoveContainer" containerID="d6c900c8dde688fb41ba8b8cd234972c82c88f6fa0c87206f28354ae189424c1"
Jul 07 00:15:05.172656 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:05.172619    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm"
Jul 07 00:15:05.269480 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:05.269439    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mv8b\" (UniqueName: \"kubernetes.io/projected/0f3555f3-48ad-4470-a0c0-a928a4f79ab9-kube-api-access-7mv8b\") pod \"0f3555f3-48ad-4470-a0c0-a928a4f79ab9\" (UID: \"0f3555f3-48ad-4470-a0c0-a928a4f79ab9\") "
Jul 07 00:15:05.271853 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:05.271811    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f3555f3-48ad-4470-a0c0-a928a4f79ab9-kube-api-access-7mv8b" (OuterVolumeSpecName: "kube-api-access-7mv8b") pod "0f3555f3-48ad-4470-a0c0-a928a4f79ab9" (UID: "0f3555f3-48ad-4470-a0c0-a928a4f79ab9"). InnerVolumeSpecName "kube-api-access-7mv8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:15:05.370298 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:05.370192    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mv8b\" (UniqueName: \"kubernetes.io/projected/0f3555f3-48ad-4470-a0c0-a928a4f79ab9-kube-api-access-7mv8b\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:15:06.041166 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:06.041136    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm"
Jul 07 00:15:06.041166 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:06.041163    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm" event={"ID":"0f3555f3-48ad-4470-a0c0-a928a4f79ab9","Type":"ContainerDied","Data":"75b62f1a3f5ffe562433f4979589f676ad9ecea7bd20bc254792238f76dc9698"}
Jul 07 00:15:06.041707 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:06.041218    2582 scope.go:117] "RemoveContainer" containerID="9785693e86e3080044535ee5e2c79f5df8c293a863a8b9085b0c5db9204d95c2"
Jul 07 00:15:06.062217 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:06.062183    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm"]
Jul 07 00:15:06.069634 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:06.069604    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-ait-aab879b8-29723055-vm9sm"]
Jul 07 00:15:06.963892 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:06.963855    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f3555f3-48ad-4470-a0c0-a928a4f79ab9" path="/var/lib/kubelet/pods/0f3555f3-48ad-4470-a0c0-a928a4f79ab9/volumes"
Jul 07 00:15:08.777071 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:08.777027    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:08.876503 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:08.876454    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:08.997673 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:08.997617    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:09.135152 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:09.135071    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:10.103226 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:10.103178    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:10.190083 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:10.190049    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:10.269288 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:10.269242    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:10.562701 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:10.562660    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:10.683339 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:10.683288    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:10.786766 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:10.786715    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:12.449650 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:12.449616    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:15.266803 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:15.266762    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:15.727030 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:15.726989    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:21.414496 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:21.414460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:21.515612 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:21.515569    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:23.048420 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:23.048359    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:27.683778 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:27.683720    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:27.783155 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:27.783118    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:27.936672 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:27.936580    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:28.034782 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:28.034717    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:29.017059 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:29.017022    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:29.104107 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:29.104066    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:29.170326 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:29.170289    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:29.352658 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:29.352569    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:29.551589 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:29.551554    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:29.648853 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:29.648728    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:31.084321 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:31.084289    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:33.496313 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:33.496223    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:33.710383 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:33.710347    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:33.817589 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:33.817496    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:33.917281 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:33.917252    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:35.781635 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:35.781597    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:39.589937 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:39.589883    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:39.675212 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:39.675169    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:40.087181 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:40.087146    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:40.190117 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:40.190078    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:40.290966 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:40.290924    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:41.831522 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:41.831476    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:47.884247 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:47.884208    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:48.000520 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:48.000477    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:48.085154 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:48.085115    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:48.185117 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:48.185082    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:48.664143 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:48.664058    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:15:55.078900 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:15:55.078862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:14.686716 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:14.686674    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:20.271222 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:20.271183    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:20.332337 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:20.332298    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:20.399205 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:20.399163    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:20.498808 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:20.498728    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:36.377985 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:36.377937    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:42.175476 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:42.175429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:42.281456 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:42.281417    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:42.388333 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:42.388293    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:52.960670 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:52.960627    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:53.766704 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:53.766662    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:59.795964 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:59.795925    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:59.900638 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:59.900598    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:16:59.997106 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:16:59.997070    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:00.096795 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:00.096668    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:00.904730 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:00.904694    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:01.005980 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:01.005940    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:01.105365 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:01.105325    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:02.758835 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:02.758727    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:08.395087 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:08.395047    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:08.465976 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:08.465931    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:09.094042 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:09.094005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:15.183710 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:15.183672    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:15.283113 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:15.283072    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:15.423075 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:15.423038    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:15.728052 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:15.728013    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:16.055639 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:16.055538    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:18.935900 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:18.935863    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:19.054200 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:19.054162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:19.173580 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:19.173544    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:19.470414 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:19.470378    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:19.605133 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:19.605094    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:19.711265 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:19.711222    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:23.437675 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:23.437641    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:24.108206 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:24.108162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:24.200313 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:24.200278    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:24.537222 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:24.537190    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:30.208405 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:30.208369    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:30.309116 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:30.309083    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:30.610849 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:30.610725    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:30.895513 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:30.895425    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:31.043482 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:31.043435    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:36.948686 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:36.948649    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:37.048908 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:37.048879    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:37.226670 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:37.226574    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:37.548326 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:37.548225    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:37.640366 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:37.640330    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:37.738909 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:37.738858    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:37.840012 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:37.839918    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:43.548423 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:43.548378    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:43.634304 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:43.634273    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:43.723343 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:43.723291    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:43.905396 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:43.905274    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:49.649644 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:49.649613    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:51.003526 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:51.003485    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:56.586871 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:56.586830    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:56.918067 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:56.917972    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:17:57.193676 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:17:57.193641    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:00.224884 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:00.224839    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:00.328761 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:00.328701    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:00.417606 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:00.417556    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:00.646562 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:00.646465    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:00.952187 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:00.952154    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:01.050946 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:01.050913    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:04.783933 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:04.783892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:15.198624 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:15.198579    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:15.300174 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:15.300133    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:17.377713 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.377676    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"]
Jul 07 00:18:17.378100 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.378016    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f3555f3-48ad-4470-a0c0-a928a4f79ab9" containerName="cleanup"
Jul 07 00:18:17.378100 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.378029    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f3555f3-48ad-4470-a0c0-a928a4f79ab9" containerName="cleanup"
Jul 07 00:18:17.378100 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.378095    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f3555f3-48ad-4470-a0c0-a928a4f79ab9" containerName="cleanup"
Jul 07 00:18:17.378203 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.378104    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f3555f3-48ad-4470-a0c0-a928a4f79ab9" containerName="cleanup"
Jul 07 00:18:17.380968 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.380950    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.383821 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.383799    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-1ddddfee\"/\"e2e-lifecycle-model-1ddddfee-kserve-self-signed-certs\""
Jul 07 00:18:17.384788 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.384765    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-1ddddfee\"/\"default-dockercfg-ckqrl\""
Jul 07 00:18:17.384924 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.384799    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-1ddddfee\"/\"openshift-service-ca.crt\""
Jul 07 00:18:17.384924 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.384801    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-1ddddfee\"/\"kube-root-ca.crt\""
Jul 07 00:18:17.394732 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.394704    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"]
Jul 07 00:18:17.417451 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.417406    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:17.555555 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.555516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-dshm\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.555555 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.555555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-tmp-dir\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.555801 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.555634    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1adcc52-fefe-4763-9e29-ad0a908700d8-tls-certs\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.555801 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.555652    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmshg\" (UniqueName: \"kubernetes.io/projected/b1adcc52-fefe-4763-9e29-ad0a908700d8-kube-api-access-jmshg\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.555801 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.555722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-home\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.555801 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.555791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-model-cache\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.656546 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.656449    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1adcc52-fefe-4763-9e29-ad0a908700d8-tls-certs\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.656546 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.656493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmshg\" (UniqueName: \"kubernetes.io/projected/b1adcc52-fefe-4763-9e29-ad0a908700d8-kube-api-access-jmshg\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.656775 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.656633    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-home\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.656775 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.656674    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-model-cache\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.656880 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.656777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-dshm\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.656880 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.656809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-tmp-dir\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.657130 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.657109    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-home\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.657210 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.657153    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-model-cache\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.657210 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.657177    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-tmp-dir\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.658943 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.658926    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-dshm\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.659244 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.659226    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1adcc52-fefe-4763-9e29-ad0a908700d8-tls-certs\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.664453 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.664422    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmshg\" (UniqueName: \"kubernetes.io/projected/b1adcc52-fefe-4763-9e29-ad0a908700d8-kube-api-access-jmshg\") pod \"e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") " pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.690634 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.690589    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:17.826053 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.826024    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"]
Jul 07 00:18:17.828374 ip-10-0-129-95 kubenswrapper[2582]: W0707 00:18:17.828340    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1adcc52_fefe_4763_9e29_ad0a908700d8.slice/crio-1859ddc9c88d3f67319ef60320bc290c9ab2bf25cccb75239fd5b3419728f1cf WatchSource:0}: Error finding container 1859ddc9c88d3f67319ef60320bc290c9ab2bf25cccb75239fd5b3419728f1cf: Status 404 returned error can't find the container with id 1859ddc9c88d3f67319ef60320bc290c9ab2bf25cccb75239fd5b3419728f1cf
Jul 07 00:18:17.891471 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:17.891441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v" event={"ID":"b1adcc52-fefe-4763-9e29-ad0a908700d8","Type":"ContainerStarted","Data":"1859ddc9c88d3f67319ef60320bc290c9ab2bf25cccb75239fd5b3419728f1cf"}
Jul 07 00:18:18.897861 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:18.897826    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v" event={"ID":"b1adcc52-fefe-4763-9e29-ad0a908700d8","Type":"ContainerStarted","Data":"9afa35c8d20ea39d6af1bde7ec5b1433a4424ca5a1c0743dcd81f7a1395f816f"}
Jul 07 00:18:18.915428 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:18.915383    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v" podStartSLOduration=1.915366849 podStartE2EDuration="1.915366849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:18:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:18:18.913193986 +0000 UTC m=+1778.520621998" watchObservedRunningTime="2026-07-07 00:18:18.915366849 +0000 UTC m=+1778.522794859"
Jul 07 00:18:21.700828 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:21.700782    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:21.801343 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:21.801298    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:27.691120 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:27.691080    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:27.691534 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:27.691135    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:27.703880 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:27.703848    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:27.948394 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:27.948307    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:18:40.956587 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:40.956559    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 07 00:18:40.961525 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:40.961498    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 07 00:18:50.460199 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:50.460152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:50.562543 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:50.562506    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:52.712257 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:52.712221    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:53.054791 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:53.054676    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:18:58.895475 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:18:58.895431    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:19:03.879961 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:03.879918    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"]
Jul 07 00:19:03.976055 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:03.976024    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:19:18.900973 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:18.900923    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v" podUID="b1adcc52-fefe-4763-9e29-ad0a908700d8" containerName="main" containerID="cri-o://9afa35c8d20ea39d6af1bde7ec5b1433a4424ca5a1c0743dcd81f7a1395f816f" gracePeriod=45
Jul 07 00:19:19.155238 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.155160    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:19:19.176697 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.176641    2582 generic.go:356] "Generic (PLEG): container finished" podID="b1adcc52-fefe-4763-9e29-ad0a908700d8" containerID="9afa35c8d20ea39d6af1bde7ec5b1433a4424ca5a1c0743dcd81f7a1395f816f" exitCode=0
Jul 07 00:19:19.176697 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.176698    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v" event={"ID":"b1adcc52-fefe-4763-9e29-ad0a908700d8","Type":"ContainerDied","Data":"9afa35c8d20ea39d6af1bde7ec5b1433a4424ca5a1c0743dcd81f7a1395f816f"}
Jul 07 00:19:19.176973 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.176705    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"
Jul 07 00:19:19.176973 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.176734    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v" event={"ID":"b1adcc52-fefe-4763-9e29-ad0a908700d8","Type":"ContainerDied","Data":"1859ddc9c88d3f67319ef60320bc290c9ab2bf25cccb75239fd5b3419728f1cf"}
Jul 07 00:19:19.176973 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.176776    2582 scope.go:117] "RemoveContainer" containerID="9afa35c8d20ea39d6af1bde7ec5b1433a4424ca5a1c0743dcd81f7a1395f816f"
Jul 07 00:19:19.185601 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.185577    2582 scope.go:117] "RemoveContainer" containerID="9afa35c8d20ea39d6af1bde7ec5b1433a4424ca5a1c0743dcd81f7a1395f816f"
Jul 07 00:19:19.186015 ip-10-0-129-95 kubenswrapper[2582]: E0707 00:19:19.185994    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9afa35c8d20ea39d6af1bde7ec5b1433a4424ca5a1c0743dcd81f7a1395f816f\": container with ID starting with 9afa35c8d20ea39d6af1bde7ec5b1433a4424ca5a1c0743dcd81f7a1395f816f not found: ID does not exist" containerID="9afa35c8d20ea39d6af1bde7ec5b1433a4424ca5a1c0743dcd81f7a1395f816f"
Jul 07 00:19:19.186140 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.186026    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9afa35c8d20ea39d6af1bde7ec5b1433a4424ca5a1c0743dcd81f7a1395f816f"} err="failed to get container status \"9afa35c8d20ea39d6af1bde7ec5b1433a4424ca5a1c0743dcd81f7a1395f816f\": rpc error: code = NotFound desc = could not find container \"9afa35c8d20ea39d6af1bde7ec5b1433a4424ca5a1c0743dcd81f7a1395f816f\": container with ID starting with 9afa35c8d20ea39d6af1bde7ec5b1433a4424ca5a1c0743dcd81f7a1395f816f not found: ID does not exist"
Jul 07 00:19:19.218515 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.218474    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-model-cache\") pod \"b1adcc52-fefe-4763-9e29-ad0a908700d8\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") "
Jul 07 00:19:19.218723 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.218529    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-tmp-dir\") pod \"b1adcc52-fefe-4763-9e29-ad0a908700d8\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") "
Jul 07 00:19:19.218723 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.218572    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-dshm\") pod \"b1adcc52-fefe-4763-9e29-ad0a908700d8\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") "
Jul 07 00:19:19.218723 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.218612    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-home\") pod \"b1adcc52-fefe-4763-9e29-ad0a908700d8\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") "
Jul 07 00:19:19.218723 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.218651    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmshg\" (UniqueName: \"kubernetes.io/projected/b1adcc52-fefe-4763-9e29-ad0a908700d8-kube-api-access-jmshg\") pod \"b1adcc52-fefe-4763-9e29-ad0a908700d8\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") "
Jul 07 00:19:19.218723 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.218678    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1adcc52-fefe-4763-9e29-ad0a908700d8-tls-certs\") pod \"b1adcc52-fefe-4763-9e29-ad0a908700d8\" (UID: \"b1adcc52-fefe-4763-9e29-ad0a908700d8\") "
Jul 07 00:19:19.219014 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.218820    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-model-cache" (OuterVolumeSpecName: "model-cache") pod "b1adcc52-fefe-4763-9e29-ad0a908700d8" (UID: "b1adcc52-fefe-4763-9e29-ad0a908700d8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:19:19.219014 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.218927    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-model-cache\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:19:19.219014 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.218922    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-home" (OuterVolumeSpecName: "home") pod "b1adcc52-fefe-4763-9e29-ad0a908700d8" (UID: "b1adcc52-fefe-4763-9e29-ad0a908700d8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:19:19.219014 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.218931    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b1adcc52-fefe-4763-9e29-ad0a908700d8" (UID: "b1adcc52-fefe-4763-9e29-ad0a908700d8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:19:19.220954 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.220927    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-dshm" (OuterVolumeSpecName: "dshm") pod "b1adcc52-fefe-4763-9e29-ad0a908700d8" (UID: "b1adcc52-fefe-4763-9e29-ad0a908700d8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:19:19.221106 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.221087    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1adcc52-fefe-4763-9e29-ad0a908700d8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b1adcc52-fefe-4763-9e29-ad0a908700d8" (UID: "b1adcc52-fefe-4763-9e29-ad0a908700d8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:19:19.221165 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.221077    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1adcc52-fefe-4763-9e29-ad0a908700d8-kube-api-access-jmshg" (OuterVolumeSpecName: "kube-api-access-jmshg") pod "b1adcc52-fefe-4763-9e29-ad0a908700d8" (UID: "b1adcc52-fefe-4763-9e29-ad0a908700d8"). InnerVolumeSpecName "kube-api-access-jmshg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:19:19.319767 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.319707    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-dshm\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:19:19.319767 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.319752    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-home\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:19:19.319767 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.319762    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmshg\" (UniqueName: \"kubernetes.io/projected/b1adcc52-fefe-4763-9e29-ad0a908700d8-kube-api-access-jmshg\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:19:19.319767 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.319773    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1adcc52-fefe-4763-9e29-ad0a908700d8-tls-certs\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:19:19.319767 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.319783    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1adcc52-fefe-4763-9e29-ad0a908700d8-tmp-dir\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:19:19.498052 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.498016    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"]
Jul 07 00:19:19.502024 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:19.501998    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-1ddddfee/e2e-lifecycle-model-1ddddfee-kserve-5bcf48877f-4d65v"]
Jul 07 00:19:20.964478 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:20.964446    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1adcc52-fefe-4763-9e29-ad0a908700d8" path="/var/lib/kubelet/pods/b1adcc52-fefe-4763-9e29-ad0a908700d8/volumes"
Jul 07 00:19:40.435998 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:40.435956    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:19:40.813243 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:40.813157    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:19:46.547872 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:19:46.547839    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:09.670931 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:09.670838    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:09.734993 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:09.734951    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:10.063570 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:10.063479    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:10.227796 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:10.227724    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:11.371077 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:11.371032    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:11.471414 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:11.471377    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:11.571896 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:11.571853    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:12.425862 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:12.425815    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:12.526000 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:12.525962    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:12.624791 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:12.624750    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:14.183049 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:14.183010    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:19.986753 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:19.986705    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:20.088506 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:20.088465    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:20.783641 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:20.783603    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:26.532678 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:26.532635    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:26.631626 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:26.631583    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:26.732371 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:26.732334    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:37.334273 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:37.334231    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:37.720976 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:37.720938    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:20:58.734262 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:20:58.734219    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:04.788138 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:04.788095    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:04.888607 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:04.888574    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:05.188413 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:05.188371    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:05.547202 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:05.547094    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:05.970593 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:05.970547    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:08.418870 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:08.418827    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:08.626906 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:08.626863    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:08.729129 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:08.729093    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:09.050485 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:09.050388    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:09.154177 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:09.154136    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:09.252984 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:09.252946    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:12.955684 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:12.955647    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:13.299949 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:13.299856    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:13.679331 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:13.679290    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:13.880448 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:13.880407    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:16.436523 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:16.436486    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:16.540757 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:16.540693    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:16.623103 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:16.623060    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:17.124596 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:17.124560    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:17.224782 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:17.224749    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:20.976908 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:20.976854    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:30.544461 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:30.544421    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:30.648426 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:30.648384    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:38.079796 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:38.079695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:38.179325 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:38.179261    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:39.994091 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:39.994056    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"]
Jul 07 00:21:39.994488 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:39.994376    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1adcc52-fefe-4763-9e29-ad0a908700d8" containerName="main"
Jul 07 00:21:39.994488 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:39.994386    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1adcc52-fefe-4763-9e29-ad0a908700d8" containerName="main"
Jul 07 00:21:39.994488 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:39.994397    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f3555f3-48ad-4470-a0c0-a928a4f79ab9" containerName="cleanup"
Jul 07 00:21:39.994488 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:39.994402    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f3555f3-48ad-4470-a0c0-a928a4f79ab9" containerName="cleanup"
Jul 07 00:21:39.994488 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:39.994464    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1adcc52-fefe-4763-9e29-ad0a908700d8" containerName="main"
Jul 07 00:21:39.997311 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:39.997294    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.000869 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.000844    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b48493\"/\"kube-root-ca.crt\""
Jul 07 00:21:40.001019 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.000850    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b48493\"/\"openshift-service-ca.crt\""
Jul 07 00:21:40.001019 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.000922    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b48493\"/\"default-dockercfg-zlf98\""
Jul 07 00:21:40.001019 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.000984    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b48493\"/\"test-model-b48493-kserve-self-signed-certs\""
Jul 07 00:21:40.006280 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.006256    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"]
Jul 07 00:21:40.017006 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.016979    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:21:40.061233 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.061191    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-home\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.061233 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.061234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-tmp-dir\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.061457 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.061269    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-dshm\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.061457 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.061347    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba8935c1-1939-4592-871f-0e69bcff3d15-tls-certs\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.061457 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.061403    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bq49\" (UniqueName: \"kubernetes.io/projected/ba8935c1-1939-4592-871f-0e69bcff3d15-kube-api-access-5bq49\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.061457 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.061433    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-model-cache\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.162481 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.162438    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-model-cache\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.162681 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.162494    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-home\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.162681 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.162513    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-tmp-dir\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.162681 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.162545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-dshm\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.162681 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.162568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba8935c1-1939-4592-871f-0e69bcff3d15-tls-certs\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.162940 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.162769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bq49\" (UniqueName: \"kubernetes.io/projected/ba8935c1-1939-4592-871f-0e69bcff3d15-kube-api-access-5bq49\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.162940 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.162929    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-model-cache\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.163051 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.162979    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-tmp-dir\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.163107 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.163076    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-home\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.165019 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.164997    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-dshm\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.165296 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.165277    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba8935c1-1939-4592-871f-0e69bcff3d15-tls-certs\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.173441 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.173407    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bq49\" (UniqueName: \"kubernetes.io/projected/ba8935c1-1939-4592-871f-0e69bcff3d15-kube-api-access-5bq49\") pod \"test-model-b48493-kserve-7b7c45d977-7qlv8\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") " pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.307457 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.307365    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:40.444024 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.443988    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"]
Jul 07 00:21:40.447092 ip-10-0-129-95 kubenswrapper[2582]: W0707 00:21:40.447061    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba8935c1_1939_4592_871f_0e69bcff3d15.slice/crio-0496a5a80bda39389bcaabd07b3a89a634417f58a65a37a7e6573b77e41eb557 WatchSource:0}: Error finding container 0496a5a80bda39389bcaabd07b3a89a634417f58a65a37a7e6573b77e41eb557: Status 404 returned error can't find the container with id 0496a5a80bda39389bcaabd07b3a89a634417f58a65a37a7e6573b77e41eb557
Jul 07 00:21:40.802173 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.802137    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8" event={"ID":"ba8935c1-1939-4592-871f-0e69bcff3d15","Type":"ContainerStarted","Data":"9a7317c5ed42ef0f7830c8e321a00dea46b53cb20d36080c3d771bc773ab4ec6"}
Jul 07 00:21:40.802173 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.802176    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8" event={"ID":"ba8935c1-1939-4592-871f-0e69bcff3d15","Type":"ContainerStarted","Data":"0496a5a80bda39389bcaabd07b3a89a634417f58a65a37a7e6573b77e41eb557"}
Jul 07 00:21:40.825046 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:40.824991    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8" podStartSLOduration=1.824973553 podStartE2EDuration="1.824973553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:21:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:21:40.82279847 +0000 UTC m=+1980.430226478" watchObservedRunningTime="2026-07-07 00:21:40.824973553 +0000 UTC m=+1980.432401564"
Jul 07 00:21:50.308318 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:50.308281    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:50.308709 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:50.308346    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:50.320970 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:50.320936    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:21:50.858195 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:21:50.858162    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:22:08.091077 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.091043    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"]
Jul 07 00:22:08.094346 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.094327    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.096898 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.096867    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b8c86c\"/\"default-dockercfg-sfq4c\""
Jul 07 00:22:08.097076 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.096878    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b8c86c\"/\"openshift-service-ca.crt\""
Jul 07 00:22:08.098936 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.098904    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b8c86c\"/\"kube-root-ca.crt\""
Jul 07 00:22:08.100299 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.100276    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b8c86c\"/\"test-model-b8c86c-kserve-self-signed-certs\""
Jul 07 00:22:08.108130 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.108106    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"]
Jul 07 00:22:08.132248 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.132204    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:08.224063 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.224023    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-dshm\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.224274 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.224084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7dxk\" (UniqueName: \"kubernetes.io/projected/d8a0923b-f439-4a99-bcde-d063c027c11b-kube-api-access-l7dxk\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.224274 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.224163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a0923b-f439-4a99-bcde-d063c027c11b-tls-certs\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.224274 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.224210    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-home\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.224274 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.224255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-tmp-dir\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.224434 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.224294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-model-cache\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.325119 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.325079    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-dshm\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.325280 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.325131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7dxk\" (UniqueName: \"kubernetes.io/projected/d8a0923b-f439-4a99-bcde-d063c027c11b-kube-api-access-l7dxk\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.325280 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.325250    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a0923b-f439-4a99-bcde-d063c027c11b-tls-certs\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.325377 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.325288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-home\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.325377 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.325329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-tmp-dir\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.325377 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.325359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-model-cache\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.325774 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.325720    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-tmp-dir\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.325861 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.325779    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-home\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.325917 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.325895    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-model-cache\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.327543 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.327524    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-dshm\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.327922 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.327904    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a0923b-f439-4a99-bcde-d063c027c11b-tls-certs\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.334008 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.333983    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7dxk\" (UniqueName: \"kubernetes.io/projected/d8a0923b-f439-4a99-bcde-d063c027c11b-kube-api-access-l7dxk\") pod \"test-model-b8c86c-kserve-5f66d9f99c-m58dm\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") " pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.407803 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.407685    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:08.545727 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.545627    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"]
Jul 07 00:22:08.548043 ip-10-0-129-95 kubenswrapper[2582]: W0707 00:22:08.548017    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8a0923b_f439_4a99_bcde_d063c027c11b.slice/crio-3e839f968060757d3968e5ea9ec5871e57c697d114c758e19a8a54e00d91914f WatchSource:0}: Error finding container 3e839f968060757d3968e5ea9ec5871e57c697d114c758e19a8a54e00d91914f: Status 404 returned error can't find the container with id 3e839f968060757d3968e5ea9ec5871e57c697d114c758e19a8a54e00d91914f
Jul 07 00:22:08.931170 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.931132    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm" event={"ID":"d8a0923b-f439-4a99-bcde-d063c027c11b","Type":"ContainerStarted","Data":"1f1c0346a4a40b9ba68da4ff9488117e196a9b3c8c2e1037ddc10b09d9bd544f"}
Jul 07 00:22:08.931170 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.931172    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm" event={"ID":"d8a0923b-f439-4a99-bcde-d063c027c11b","Type":"ContainerStarted","Data":"3e839f968060757d3968e5ea9ec5871e57c697d114c758e19a8a54e00d91914f"}
Jul 07 00:22:08.953667 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:08.953597    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm" podStartSLOduration=0.953575126 podStartE2EDuration="953.575126ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:22:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:22:08.952101585 +0000 UTC m=+2008.559529596" watchObservedRunningTime="2026-07-07 00:22:08.953575126 +0000 UTC m=+2008.561003140"
Jul 07 00:22:18.408238 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:18.408196    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:18.408238 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:18.408244    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:18.421200 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:18.421171    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:18.985854 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:18.985820    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:22:33.041003 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:33.040968    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:47.165273 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:47.165236    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"]
Jul 07 00:22:47.228581 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:47.228545    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:48.072798 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:48.072733    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"]
Jul 07 00:22:48.093001 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:48.092970    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:48.439342 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:48.439304    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:48.892309 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:48.892206    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:49.027050 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:49.027015    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:49.166147 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:49.166055    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:49.452427 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:49.452389    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:22:54.065484 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:22:54.065445    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:02.185762 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.185620    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8" podUID="ba8935c1-1939-4592-871f-0e69bcff3d15" containerName="main" containerID="cri-o://9a7317c5ed42ef0f7830c8e321a00dea46b53cb20d36080c3d771bc773ab4ec6" gracePeriod=45
Jul 07 00:23:02.446107 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.446031    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:23:02.517308 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.517274    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-dshm\") pod \"ba8935c1-1939-4592-871f-0e69bcff3d15\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") "
Jul 07 00:23:02.517515 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.517336    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-tmp-dir\") pod \"ba8935c1-1939-4592-871f-0e69bcff3d15\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") "
Jul 07 00:23:02.517515 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.517357    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-home\") pod \"ba8935c1-1939-4592-871f-0e69bcff3d15\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") "
Jul 07 00:23:02.517515 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.517387    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bq49\" (UniqueName: \"kubernetes.io/projected/ba8935c1-1939-4592-871f-0e69bcff3d15-kube-api-access-5bq49\") pod \"ba8935c1-1939-4592-871f-0e69bcff3d15\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") "
Jul 07 00:23:02.517515 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.517416    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-model-cache\") pod \"ba8935c1-1939-4592-871f-0e69bcff3d15\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") "
Jul 07 00:23:02.517515 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.517440    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba8935c1-1939-4592-871f-0e69bcff3d15-tls-certs\") pod \"ba8935c1-1939-4592-871f-0e69bcff3d15\" (UID: \"ba8935c1-1939-4592-871f-0e69bcff3d15\") "
Jul 07 00:23:02.517808 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.517645    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ba8935c1-1939-4592-871f-0e69bcff3d15" (UID: "ba8935c1-1939-4592-871f-0e69bcff3d15"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:23:02.517808 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.517711    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-home" (OuterVolumeSpecName: "home") pod "ba8935c1-1939-4592-871f-0e69bcff3d15" (UID: "ba8935c1-1939-4592-871f-0e69bcff3d15"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:23:02.517808 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.517768    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-model-cache" (OuterVolumeSpecName: "model-cache") pod "ba8935c1-1939-4592-871f-0e69bcff3d15" (UID: "ba8935c1-1939-4592-871f-0e69bcff3d15"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:23:02.517959 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.517845    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-tmp-dir\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:23:02.517959 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.517863    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-home\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:23:02.517959 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.517872    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-model-cache\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:23:02.519848 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.519811    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba8935c1-1939-4592-871f-0e69bcff3d15-kube-api-access-5bq49" (OuterVolumeSpecName: "kube-api-access-5bq49") pod "ba8935c1-1939-4592-871f-0e69bcff3d15" (UID: "ba8935c1-1939-4592-871f-0e69bcff3d15"). InnerVolumeSpecName "kube-api-access-5bq49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:23:02.519957 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.519853    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-dshm" (OuterVolumeSpecName: "dshm") pod "ba8935c1-1939-4592-871f-0e69bcff3d15" (UID: "ba8935c1-1939-4592-871f-0e69bcff3d15"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:23:02.519957 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.519847    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba8935c1-1939-4592-871f-0e69bcff3d15-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ba8935c1-1939-4592-871f-0e69bcff3d15" (UID: "ba8935c1-1939-4592-871f-0e69bcff3d15"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:23:02.618968 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.618924    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bq49\" (UniqueName: \"kubernetes.io/projected/ba8935c1-1939-4592-871f-0e69bcff3d15-kube-api-access-5bq49\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:23:02.618968 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.618959    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba8935c1-1939-4592-871f-0e69bcff3d15-tls-certs\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:23:02.618968 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:02.618970    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba8935c1-1939-4592-871f-0e69bcff3d15-dshm\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:23:03.093591 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.093524    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm" podUID="d8a0923b-f439-4a99-bcde-d063c027c11b" containerName="main" containerID="cri-o://1f1c0346a4a40b9ba68da4ff9488117e196a9b3c8c2e1037ddc10b09d9bd544f" gracePeriod=45
Jul 07 00:23:03.185639 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.185606    2582 generic.go:356] "Generic (PLEG): container finished" podID="ba8935c1-1939-4592-871f-0e69bcff3d15" containerID="9a7317c5ed42ef0f7830c8e321a00dea46b53cb20d36080c3d771bc773ab4ec6" exitCode=0
Jul 07 00:23:03.185834 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.185669    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"
Jul 07 00:23:03.185834 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.185693    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8" event={"ID":"ba8935c1-1939-4592-871f-0e69bcff3d15","Type":"ContainerDied","Data":"9a7317c5ed42ef0f7830c8e321a00dea46b53cb20d36080c3d771bc773ab4ec6"}
Jul 07 00:23:03.185834 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.185750    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8" event={"ID":"ba8935c1-1939-4592-871f-0e69bcff3d15","Type":"ContainerDied","Data":"0496a5a80bda39389bcaabd07b3a89a634417f58a65a37a7e6573b77e41eb557"}
Jul 07 00:23:03.185834 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.185774    2582 scope.go:117] "RemoveContainer" containerID="9a7317c5ed42ef0f7830c8e321a00dea46b53cb20d36080c3d771bc773ab4ec6"
Jul 07 00:23:03.204977 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.204953    2582 scope.go:117] "RemoveContainer" containerID="9a7317c5ed42ef0f7830c8e321a00dea46b53cb20d36080c3d771bc773ab4ec6"
Jul 07 00:23:03.205326 ip-10-0-129-95 kubenswrapper[2582]: E0707 00:23:03.205306    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a7317c5ed42ef0f7830c8e321a00dea46b53cb20d36080c3d771bc773ab4ec6\": container with ID starting with 9a7317c5ed42ef0f7830c8e321a00dea46b53cb20d36080c3d771bc773ab4ec6 not found: ID does not exist" containerID="9a7317c5ed42ef0f7830c8e321a00dea46b53cb20d36080c3d771bc773ab4ec6"
Jul 07 00:23:03.205389 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.205336    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a7317c5ed42ef0f7830c8e321a00dea46b53cb20d36080c3d771bc773ab4ec6"} err="failed to get container status \"9a7317c5ed42ef0f7830c8e321a00dea46b53cb20d36080c3d771bc773ab4ec6\": rpc error: code = NotFound desc = could not find container \"9a7317c5ed42ef0f7830c8e321a00dea46b53cb20d36080c3d771bc773ab4ec6\": container with ID starting with 9a7317c5ed42ef0f7830c8e321a00dea46b53cb20d36080c3d771bc773ab4ec6 not found: ID does not exist"
Jul 07 00:23:03.208545 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.208507    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"]
Jul 07 00:23:03.213607 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.213576    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-b48493/test-model-b48493-kserve-7b7c45d977-7qlv8"]
Jul 07 00:23:03.345987 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.345952    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:23:03.427683 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.427643    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-tmp-dir\") pod \"d8a0923b-f439-4a99-bcde-d063c027c11b\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") "
Jul 07 00:23:03.427917 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.427690    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-model-cache\") pod \"d8a0923b-f439-4a99-bcde-d063c027c11b\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") "
Jul 07 00:23:03.427917 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.427731    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a0923b-f439-4a99-bcde-d063c027c11b-tls-certs\") pod \"d8a0923b-f439-4a99-bcde-d063c027c11b\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") "
Jul 07 00:23:03.427917 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.427780    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-home\") pod \"d8a0923b-f439-4a99-bcde-d063c027c11b\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") "
Jul 07 00:23:03.427917 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.427808    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-dshm\") pod \"d8a0923b-f439-4a99-bcde-d063c027c11b\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") "
Jul 07 00:23:03.427917 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.427873    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7dxk\" (UniqueName: \"kubernetes.io/projected/d8a0923b-f439-4a99-bcde-d063c027c11b-kube-api-access-l7dxk\") pod \"d8a0923b-f439-4a99-bcde-d063c027c11b\" (UID: \"d8a0923b-f439-4a99-bcde-d063c027c11b\") "
Jul 07 00:23:03.428158 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.427999    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d8a0923b-f439-4a99-bcde-d063c027c11b" (UID: "d8a0923b-f439-4a99-bcde-d063c027c11b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:23:03.428158 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.428058    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-model-cache" (OuterVolumeSpecName: "model-cache") pod "d8a0923b-f439-4a99-bcde-d063c027c11b" (UID: "d8a0923b-f439-4a99-bcde-d063c027c11b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:23:03.428158 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.428078    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-home" (OuterVolumeSpecName: "home") pod "d8a0923b-f439-4a99-bcde-d063c027c11b" (UID: "d8a0923b-f439-4a99-bcde-d063c027c11b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:23:03.428300 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.428206    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-model-cache\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:23:03.428300 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.428227    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-home\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:23:03.428300 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.428240    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-tmp-dir\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:23:03.430224 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.430197    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8a0923b-f439-4a99-bcde-d063c027c11b-kube-api-access-l7dxk" (OuterVolumeSpecName: "kube-api-access-l7dxk") pod "d8a0923b-f439-4a99-bcde-d063c027c11b" (UID: "d8a0923b-f439-4a99-bcde-d063c027c11b"). InnerVolumeSpecName "kube-api-access-l7dxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:23:03.430349 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.430229    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-dshm" (OuterVolumeSpecName: "dshm") pod "d8a0923b-f439-4a99-bcde-d063c027c11b" (UID: "d8a0923b-f439-4a99-bcde-d063c027c11b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:23:03.430349 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.430235    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8a0923b-f439-4a99-bcde-d063c027c11b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d8a0923b-f439-4a99-bcde-d063c027c11b" (UID: "d8a0923b-f439-4a99-bcde-d063c027c11b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:23:03.528927 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.528836    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a0923b-f439-4a99-bcde-d063c027c11b-tls-certs\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:23:03.528927 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.528870    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8a0923b-f439-4a99-bcde-d063c027c11b-dshm\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:23:03.528927 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:03.528880    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7dxk\" (UniqueName: \"kubernetes.io/projected/d8a0923b-f439-4a99-bcde-d063c027c11b-kube-api-access-l7dxk\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:23:04.192136 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:04.192097    2582 generic.go:356] "Generic (PLEG): container finished" podID="d8a0923b-f439-4a99-bcde-d063c027c11b" containerID="1f1c0346a4a40b9ba68da4ff9488117e196a9b3c8c2e1037ddc10b09d9bd544f" exitCode=0
Jul 07 00:23:04.192136 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:04.192137    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm" event={"ID":"d8a0923b-f439-4a99-bcde-d063c027c11b","Type":"ContainerDied","Data":"1f1c0346a4a40b9ba68da4ff9488117e196a9b3c8c2e1037ddc10b09d9bd544f"}
Jul 07 00:23:04.192136 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:04.192140    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"
Jul 07 00:23:04.192721 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:04.192169    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm" event={"ID":"d8a0923b-f439-4a99-bcde-d063c027c11b","Type":"ContainerDied","Data":"3e839f968060757d3968e5ea9ec5871e57c697d114c758e19a8a54e00d91914f"}
Jul 07 00:23:04.192721 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:04.192187    2582 scope.go:117] "RemoveContainer" containerID="1f1c0346a4a40b9ba68da4ff9488117e196a9b3c8c2e1037ddc10b09d9bd544f"
Jul 07 00:23:04.201224 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:04.201201    2582 scope.go:117] "RemoveContainer" containerID="1f1c0346a4a40b9ba68da4ff9488117e196a9b3c8c2e1037ddc10b09d9bd544f"
Jul 07 00:23:04.201512 ip-10-0-129-95 kubenswrapper[2582]: E0707 00:23:04.201492    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f1c0346a4a40b9ba68da4ff9488117e196a9b3c8c2e1037ddc10b09d9bd544f\": container with ID starting with 1f1c0346a4a40b9ba68da4ff9488117e196a9b3c8c2e1037ddc10b09d9bd544f not found: ID does not exist" containerID="1f1c0346a4a40b9ba68da4ff9488117e196a9b3c8c2e1037ddc10b09d9bd544f"
Jul 07 00:23:04.201575 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:04.201520    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f1c0346a4a40b9ba68da4ff9488117e196a9b3c8c2e1037ddc10b09d9bd544f"} err="failed to get container status \"1f1c0346a4a40b9ba68da4ff9488117e196a9b3c8c2e1037ddc10b09d9bd544f\": rpc error: code = NotFound desc = could not find container \"1f1c0346a4a40b9ba68da4ff9488117e196a9b3c8c2e1037ddc10b09d9bd544f\": container with ID starting with 1f1c0346a4a40b9ba68da4ff9488117e196a9b3c8c2e1037ddc10b09d9bd544f not found: ID does not exist"
Jul 07 00:23:04.214703 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:04.214670    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"]
Jul 07 00:23:04.218951 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:04.218919    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-b8c86c/test-model-b8c86c-kserve-5f66d9f99c-m58dm"]
Jul 07 00:23:04.965135 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:04.965099    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba8935c1-1939-4592-871f-0e69bcff3d15" path="/var/lib/kubelet/pods/ba8935c1-1939-4592-871f-0e69bcff3d15/volumes"
Jul 07 00:23:04.965493 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:04.965479    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8a0923b-f439-4a99-bcde-d063c027c11b" path="/var/lib/kubelet/pods/d8a0923b-f439-4a99-bcde-d063c027c11b/volumes"
Jul 07 00:23:15.856493 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:15.856450    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:15.955296 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:15.955264    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:30.886445 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:30.886412    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:31.172932 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:31.172891    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:31.419965 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:31.419920    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:31.582999 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:31.582896    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:32.004425 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:32.004384    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:32.110944 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:32.110898    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:32.287663 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:32.287564    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:38.265343 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:38.265302    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:38.368712 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:38.368676    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:38.451305 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:38.451267    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:38.629130 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:38.629031    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:38.975687 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:38.975651    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:39.332354 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:39.332258    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:39.586219 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:39.586120    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:40.991508 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:40.991477    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 07 00:23:40.998032 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:40.998011    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 07 00:23:42.390929 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:42.390880    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:42.488175 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:42.488137    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:42.701367 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:42.701327    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:43.146854 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:43.146762    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:43.296419 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:43.296383    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:43.397343 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:43.397250    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:46.934219 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:46.934180    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:47.440435 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:47.440402    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:47.779260 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:47.779168    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:48.220754 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:48.220707    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:50.522458 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:50.522424    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:50.698416 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:50.698364    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:50.810560 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:50.810461    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:50.938143 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:50.938092    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:51.376125 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:51.376088    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:51.476945 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:51.476901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:51.690497 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:51.690464    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:51.791105 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:51.791066    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:23:54.979928 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:23:54.979890    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:03.297889 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:03.297857    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:03.774370 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:03.774338    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:03.896698 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:03.896666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:03.987491 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:03.987454    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:04.359733 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:04.359695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:09.629170 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:09.629134    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:09.729369 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:09.729310    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:09.922807 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:09.922774    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:10.147972 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:10.147925    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:10.319373 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:10.319273    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:10.724826 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:10.724790    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:10.826158 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:10.826116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:10.962982 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:10.962941    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:16.604828 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:16.604788    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:16.776990 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:16.776953    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:16.907401 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:16.907305    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:17.209005 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:17.208972    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:17.544634 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:17.544521    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:17.883655 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:17.883564    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:18.181860 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:18.181822    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:20.695196 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:20.695165    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:20.775907 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:20.775859    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:20.844457 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:20.844415    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:20.966995 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:20.966902    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:21.267676 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:21.267584    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:21.366337 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:21.366302    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:25.239510 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:25.239466    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:25.607126 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:25.607032    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:25.922418 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:25.922384    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:26.028155 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:26.028113    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:28.722138 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:28.722075    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:28.817207 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:28.817169    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:28.900238 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:28.900193    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:29.096323 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:29.096205    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:29.446237 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:29.446186    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:29.546200 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:29.546166    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:33.260568 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:33.260482    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:40.973414 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:40.973383    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"]
Jul 07 00:24:40.973913 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:40.973706    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8a0923b-f439-4a99-bcde-d063c027c11b" containerName="main"
Jul 07 00:24:40.973913 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:40.973718    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8a0923b-f439-4a99-bcde-d063c027c11b" containerName="main"
Jul 07 00:24:40.973913 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:40.973749    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba8935c1-1939-4592-871f-0e69bcff3d15" containerName="main"
Jul 07 00:24:40.973913 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:40.973755    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba8935c1-1939-4592-871f-0e69bcff3d15" containerName="main"
Jul 07 00:24:40.973913 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:40.973812    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8a0923b-f439-4a99-bcde-d063c027c11b" containerName="main"
Jul 07 00:24:40.973913 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:40.973822    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba8935c1-1939-4592-871f-0e69bcff3d15" containerName="main"
Jul 07 00:24:40.976798 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:40.976778    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:40.980308 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:40.980283    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fced7e\"/\"openshift-service-ca.crt\""
Jul 07 00:24:40.980576 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:40.980374    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fced7e\"/\"kube-root-ca.crt\""
Jul 07 00:24:40.980576 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:40.980406    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fced7e\"/\"default-dockercfg-58vmt\""
Jul 07 00:24:40.980576 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:40.980406    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fced7e\"/\"auth-test-model-fced7e-kserve-self-signed-certs\""
Jul 07 00:24:40.985687 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:40.985663    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"]
Jul 07 00:24:41.005915 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.005881    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:41.098358 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.098318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-dshm\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.098551 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.098365    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-model-cache\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.098551 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.098420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh4zv\" (UniqueName: \"kubernetes.io/projected/b698c225-97f8-439d-8b39-09490e1079ca-kube-api-access-mh4zv\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.098551 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.098480    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-tmp-dir\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.098551 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.098499    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b698c225-97f8-439d-8b39-09490e1079ca-tls-certs\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.098551 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.098519    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-home\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.199922 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.199886    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-dshm\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.199922 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.199926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-model-cache\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.200172 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.199946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh4zv\" (UniqueName: \"kubernetes.io/projected/b698c225-97f8-439d-8b39-09490e1079ca-kube-api-access-mh4zv\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.200172 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.199985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-tmp-dir\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.200172 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.200007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b698c225-97f8-439d-8b39-09490e1079ca-tls-certs\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.200172 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.200034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-home\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.200414 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.200388    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-model-cache\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.200477 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.200411    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-tmp-dir\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.200477 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.200466    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-home\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.202469 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.202441    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-dshm\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.202723 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.202707    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b698c225-97f8-439d-8b39-09490e1079ca-tls-certs\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.208372 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.208351    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh4zv\" (UniqueName: \"kubernetes.io/projected/b698c225-97f8-439d-8b39-09490e1079ca-kube-api-access-mh4zv\") pod \"auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") " pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.288640 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.288527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:41.427827 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.427792    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"]
Jul 07 00:24:41.430884 ip-10-0-129-95 kubenswrapper[2582]: W0707 00:24:41.430851    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb698c225_97f8_439d_8b39_09490e1079ca.slice/crio-8f618cb19e2ef01d7731993257658049cd28eeda72af2fda5f5e5518aff1e9f3 WatchSource:0}: Error finding container 8f618cb19e2ef01d7731993257658049cd28eeda72af2fda5f5e5518aff1e9f3: Status 404 returned error can't find the container with id 8f618cb19e2ef01d7731993257658049cd28eeda72af2fda5f5e5518aff1e9f3
Jul 07 00:24:41.632915 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.632813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx" event={"ID":"b698c225-97f8-439d-8b39-09490e1079ca","Type":"ContainerStarted","Data":"0b54177a389d26bea6c973ba22c91400651f77c086a82f0e29fa961ce6d3a093"}
Jul 07 00:24:41.632915 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.632865    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx" event={"ID":"b698c225-97f8-439d-8b39-09490e1079ca","Type":"ContainerStarted","Data":"8f618cb19e2ef01d7731993257658049cd28eeda72af2fda5f5e5518aff1e9f3"}
Jul 07 00:24:41.650475 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:41.650418    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx" podStartSLOduration=1.650401939 podStartE2EDuration="1.650401939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:24:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:24:41.648859885 +0000 UTC m=+2161.256287897" watchObservedRunningTime="2026-07-07 00:24:41.650401939 +0000 UTC m=+2161.257829949"
Jul 07 00:24:42.687059 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:42.687018    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:42.788146 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:42.788109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:50.927644 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:50.927593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:51.030449 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:51.030398    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:24:51.289606 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:51.289511    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:51.289606 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:51.289568    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:51.302112 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:51.302080    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:24:51.696223 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:24:51.696194    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:25:12.477299 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.477262    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"]
Jul 07 00:25:12.481062 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.481045    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.483794 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.483771    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-accfb9\"/\"kube-root-ca.crt\""
Jul 07 00:25:12.484534 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.484519    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-accfb9\"/\"openshift-service-ca.crt\""
Jul 07 00:25:12.484860 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.484842    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-accfb9\"/\"auth-test-model-accfb9-kserve-self-signed-certs\""
Jul 07 00:25:12.484992 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.484975    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-accfb9\"/\"default-dockercfg-mqs6h\""
Jul 07 00:25:12.490139 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.490115    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"]
Jul 07 00:25:12.569339 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.569305    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:12.581728 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.581691    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-model-cache\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.581917 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.581779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-home\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.581917 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.581819    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e03bab6-240e-4e37-8c41-6f04d7173abe-tls-certs\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.581917 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.581865    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdklb\" (UniqueName: \"kubernetes.io/projected/9e03bab6-240e-4e37-8c41-6f04d7173abe-kube-api-access-fdklb\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.582044 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.581957    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-dshm\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.582044 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.581990    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-tmp-dir\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.683433 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.683373    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-dshm\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.683433 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.683435    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-tmp-dir\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.683697 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.683478    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-model-cache\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.683697 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.683515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-home\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.683697 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.683545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e03bab6-240e-4e37-8c41-6f04d7173abe-tls-certs\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.683697 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.683610    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdklb\" (UniqueName: \"kubernetes.io/projected/9e03bab6-240e-4e37-8c41-6f04d7173abe-kube-api-access-fdklb\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.683952 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.683927    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-home\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.684007 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.683954    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-model-cache\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.684007 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.683966    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-tmp-dir\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.685887 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.685868    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-dshm\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.686152 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.686133    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e03bab6-240e-4e37-8c41-6f04d7173abe-tls-certs\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.693032 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.693008    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdklb\" (UniqueName: \"kubernetes.io/projected/9e03bab6-240e-4e37-8c41-6f04d7173abe-kube-api-access-fdklb\") pod \"auth-test-model-accfb9-kserve-5f44fccf79-56tmk\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") " pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.791939 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.791852    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:12.930145 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:12.930108    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"]
Jul 07 00:25:12.934857 ip-10-0-129-95 kubenswrapper[2582]: W0707 00:25:12.934825    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e03bab6_240e_4e37_8c41_6f04d7173abe.slice/crio-c2ccbb06a94bc76c7ab7eff0b946a17249301bd046bde244bd4bd881468d5739 WatchSource:0}: Error finding container c2ccbb06a94bc76c7ab7eff0b946a17249301bd046bde244bd4bd881468d5739: Status 404 returned error can't find the container with id c2ccbb06a94bc76c7ab7eff0b946a17249301bd046bde244bd4bd881468d5739
Jul 07 00:25:13.788222 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:13.788184    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk" event={"ID":"9e03bab6-240e-4e37-8c41-6f04d7173abe","Type":"ContainerStarted","Data":"8c8db45de411e42cb9c7eff3e00ef937d62dc2717e8b0355c084bc019f3ff726"}
Jul 07 00:25:13.788222 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:13.788225    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk" event={"ID":"9e03bab6-240e-4e37-8c41-6f04d7173abe","Type":"ContainerStarted","Data":"c2ccbb06a94bc76c7ab7eff0b946a17249301bd046bde244bd4bd881468d5739"}
Jul 07 00:25:13.805067 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:13.805014    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk" podStartSLOduration=1.804997174 podStartE2EDuration="1.804997174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:25:13.804768552 +0000 UTC m=+2193.412196558" watchObservedRunningTime="2026-07-07 00:25:13.804997174 +0000 UTC m=+2193.412425185"
Jul 07 00:25:22.792810 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:22.792766    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:22.792810 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:22.792815    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:22.805376 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:22.805345    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:22.840061 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:22.840032    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:25:39.714683 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:39.714639    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:25:39.783992 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:25:39.783933    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:26:47.308254 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:26:47.308214    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:26:47.408455 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:26:47.408417    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:04.476464 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:04.476426    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"]
Jul 07 00:27:04.510298 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:04.510251    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:05.469073 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:05.469034    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"]
Jul 07 00:27:05.496687 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:05.496651    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:16.560952 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.560904    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"]
Jul 07 00:27:16.564794 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.564772    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.567194 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.567166    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fced7e\"/\"sub-test-model-fced7e-kserve-self-signed-certs\""
Jul 07 00:27:16.575625 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.575590    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"]
Jul 07 00:27:16.598343 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.598292    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:16.621821 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.621783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-dshm\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.621955 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.621836    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd4552c2-bda2-4fec-b954-7f5d58096f9a-tls-certs\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.621955 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.621860    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-home\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.621955 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.621882    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-tmp-dir\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.622064 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.621974    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v2v5\" (UniqueName: \"kubernetes.io/projected/bd4552c2-bda2-4fec-b954-7f5d58096f9a-kube-api-access-9v2v5\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.622064 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.622009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-model-cache\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.723290 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.723248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-dshm\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.723290 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.723291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd4552c2-bda2-4fec-b954-7f5d58096f9a-tls-certs\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.723469 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.723308    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-home\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.723469 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.723438    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-tmp-dir\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.723548 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.723515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v2v5\" (UniqueName: \"kubernetes.io/projected/bd4552c2-bda2-4fec-b954-7f5d58096f9a-kube-api-access-9v2v5\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.723594 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.723551    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-model-cache\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.723841 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.723811    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-home\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.723969 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.723925    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-tmp-dir\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.723969 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.723947    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-model-cache\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.725911 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.725888    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-dshm\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.726133 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.726114    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd4552c2-bda2-4fec-b954-7f5d58096f9a-tls-certs\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.732822 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.732790    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v2v5\" (UniqueName: \"kubernetes.io/projected/bd4552c2-bda2-4fec-b954-7f5d58096f9a-kube-api-access-9v2v5\") pod \"sub-test-model-fced7e-kserve-6879f4d75f-x5q7d\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") " pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:16.875132 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:16.875045    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:17.018169 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:17.018096    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"]
Jul 07 00:27:17.020877 ip-10-0-129-95 kubenswrapper[2582]: W0707 00:27:17.020844    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd4552c2_bda2_4fec_b954_7f5d58096f9a.slice/crio-642dc54fe4119a6588ac586ad85e9647f72014d70f35db87e363d777ad7fa156 WatchSource:0}: Error finding container 642dc54fe4119a6588ac586ad85e9647f72014d70f35db87e363d777ad7fa156: Status 404 returned error can't find the container with id 642dc54fe4119a6588ac586ad85e9647f72014d70f35db87e363d777ad7fa156
Jul 07 00:27:17.358622 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:17.358579    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d" event={"ID":"bd4552c2-bda2-4fec-b954-7f5d58096f9a","Type":"ContainerStarted","Data":"fb441b4c2b031a4f2686ce36c5329df17f7adfd86a796854046eb0970dfef41d"}
Jul 07 00:27:17.358622 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:17.358630    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d" event={"ID":"bd4552c2-bda2-4fec-b954-7f5d58096f9a","Type":"ContainerStarted","Data":"642dc54fe4119a6588ac586ad85e9647f72014d70f35db87e363d777ad7fa156"}
Jul 07 00:27:17.377629 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:17.377574    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d" podStartSLOduration=1.3775580060000001 podStartE2EDuration="1.377558006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:27:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:27:17.377017994 +0000 UTC m=+2316.984446006" watchObservedRunningTime="2026-07-07 00:27:17.377558006 +0000 UTC m=+2316.984986076"
Jul 07 00:27:19.497214 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.497162    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx" podUID="b698c225-97f8-439d-8b39-09490e1079ca" containerName="main" containerID="cri-o://0b54177a389d26bea6c973ba22c91400651f77c086a82f0e29fa961ce6d3a093" gracePeriod=45
Jul 07 00:27:19.759141 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.759073    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:27:19.853197 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.853157    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-home\") pod \"b698c225-97f8-439d-8b39-09490e1079ca\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") "
Jul 07 00:27:19.853379 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.853225    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b698c225-97f8-439d-8b39-09490e1079ca-tls-certs\") pod \"b698c225-97f8-439d-8b39-09490e1079ca\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") "
Jul 07 00:27:19.853379 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.853258    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-tmp-dir\") pod \"b698c225-97f8-439d-8b39-09490e1079ca\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") "
Jul 07 00:27:19.853379 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.853295    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-dshm\") pod \"b698c225-97f8-439d-8b39-09490e1079ca\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") "
Jul 07 00:27:19.853379 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.853313    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh4zv\" (UniqueName: \"kubernetes.io/projected/b698c225-97f8-439d-8b39-09490e1079ca-kube-api-access-mh4zv\") pod \"b698c225-97f8-439d-8b39-09490e1079ca\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") "
Jul 07 00:27:19.853597 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.853374    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-model-cache\") pod \"b698c225-97f8-439d-8b39-09490e1079ca\" (UID: \"b698c225-97f8-439d-8b39-09490e1079ca\") "
Jul 07 00:27:19.853597 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.853488    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-home" (OuterVolumeSpecName: "home") pod "b698c225-97f8-439d-8b39-09490e1079ca" (UID: "b698c225-97f8-439d-8b39-09490e1079ca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:27:19.853597 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.853568    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b698c225-97f8-439d-8b39-09490e1079ca" (UID: "b698c225-97f8-439d-8b39-09490e1079ca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:27:19.853781 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.853658    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-model-cache" (OuterVolumeSpecName: "model-cache") pod "b698c225-97f8-439d-8b39-09490e1079ca" (UID: "b698c225-97f8-439d-8b39-09490e1079ca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:27:19.853849 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.853813    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-model-cache\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:27:19.853849 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.853835    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-home\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:27:19.853930 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.853848    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-tmp-dir\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:27:19.855734 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.855711    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-dshm" (OuterVolumeSpecName: "dshm") pod "b698c225-97f8-439d-8b39-09490e1079ca" (UID: "b698c225-97f8-439d-8b39-09490e1079ca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:27:19.856285 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.856260    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b698c225-97f8-439d-8b39-09490e1079ca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b698c225-97f8-439d-8b39-09490e1079ca" (UID: "b698c225-97f8-439d-8b39-09490e1079ca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:27:19.856285 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.856268    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b698c225-97f8-439d-8b39-09490e1079ca-kube-api-access-mh4zv" (OuterVolumeSpecName: "kube-api-access-mh4zv") pod "b698c225-97f8-439d-8b39-09490e1079ca" (UID: "b698c225-97f8-439d-8b39-09490e1079ca"). InnerVolumeSpecName "kube-api-access-mh4zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:27:19.955192 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.955150    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b698c225-97f8-439d-8b39-09490e1079ca-tls-certs\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:27:19.955192 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.955183    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b698c225-97f8-439d-8b39-09490e1079ca-dshm\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:27:19.955192 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:19.955198    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh4zv\" (UniqueName: \"kubernetes.io/projected/b698c225-97f8-439d-8b39-09490e1079ca-kube-api-access-mh4zv\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:27:20.373653 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.373611    2582 generic.go:356] "Generic (PLEG): container finished" podID="b698c225-97f8-439d-8b39-09490e1079ca" containerID="0b54177a389d26bea6c973ba22c91400651f77c086a82f0e29fa961ce6d3a093" exitCode=0
Jul 07 00:27:20.373653 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.373656    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"
Jul 07 00:27:20.373972 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.373698    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx" event={"ID":"b698c225-97f8-439d-8b39-09490e1079ca","Type":"ContainerDied","Data":"0b54177a389d26bea6c973ba22c91400651f77c086a82f0e29fa961ce6d3a093"}
Jul 07 00:27:20.373972 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.373784    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx" event={"ID":"b698c225-97f8-439d-8b39-09490e1079ca","Type":"ContainerDied","Data":"8f618cb19e2ef01d7731993257658049cd28eeda72af2fda5f5e5518aff1e9f3"}
Jul 07 00:27:20.373972 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.373808    2582 scope.go:117] "RemoveContainer" containerID="0b54177a389d26bea6c973ba22c91400651f77c086a82f0e29fa961ce6d3a093"
Jul 07 00:27:20.382990 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.382969    2582 scope.go:117] "RemoveContainer" containerID="0b54177a389d26bea6c973ba22c91400651f77c086a82f0e29fa961ce6d3a093"
Jul 07 00:27:20.383321 ip-10-0-129-95 kubenswrapper[2582]: E0707 00:27:20.383299    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b54177a389d26bea6c973ba22c91400651f77c086a82f0e29fa961ce6d3a093\": container with ID starting with 0b54177a389d26bea6c973ba22c91400651f77c086a82f0e29fa961ce6d3a093 not found: ID does not exist" containerID="0b54177a389d26bea6c973ba22c91400651f77c086a82f0e29fa961ce6d3a093"
Jul 07 00:27:20.383388 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.383330    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b54177a389d26bea6c973ba22c91400651f77c086a82f0e29fa961ce6d3a093"} err="failed to get container status \"0b54177a389d26bea6c973ba22c91400651f77c086a82f0e29fa961ce6d3a093\": rpc error: code = NotFound desc = could not find container \"0b54177a389d26bea6c973ba22c91400651f77c086a82f0e29fa961ce6d3a093\": container with ID starting with 0b54177a389d26bea6c973ba22c91400651f77c086a82f0e29fa961ce6d3a093 not found: ID does not exist"
Jul 07 00:27:20.394545 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.394517    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"]
Jul 07 00:27:20.398484 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.398456    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/auth-test-model-fced7e-kserve-574c7cf5bc-5pgtx"]
Jul 07 00:27:20.490018 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.489974    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk" podUID="9e03bab6-240e-4e37-8c41-6f04d7173abe" containerName="main" containerID="cri-o://8c8db45de411e42cb9c7eff3e00ef937d62dc2717e8b0355c084bc019f3ff726" gracePeriod=45
Jul 07 00:27:20.737913 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.737883    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:27:20.863773 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.863689    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-tmp-dir\") pod \"9e03bab6-240e-4e37-8c41-6f04d7173abe\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") "
Jul 07 00:27:20.863986 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.863793    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-home\") pod \"9e03bab6-240e-4e37-8c41-6f04d7173abe\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") "
Jul 07 00:27:20.863986 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.863836    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e03bab6-240e-4e37-8c41-6f04d7173abe-tls-certs\") pod \"9e03bab6-240e-4e37-8c41-6f04d7173abe\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") "
Jul 07 00:27:20.863986 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.863852    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdklb\" (UniqueName: \"kubernetes.io/projected/9e03bab6-240e-4e37-8c41-6f04d7173abe-kube-api-access-fdklb\") pod \"9e03bab6-240e-4e37-8c41-6f04d7173abe\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") "
Jul 07 00:27:20.863986 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.863925    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-model-cache\") pod \"9e03bab6-240e-4e37-8c41-6f04d7173abe\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") "
Jul 07 00:27:20.863986 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.863941    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-dshm\") pod \"9e03bab6-240e-4e37-8c41-6f04d7173abe\" (UID: \"9e03bab6-240e-4e37-8c41-6f04d7173abe\") "
Jul 07 00:27:20.864253 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.863999    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9e03bab6-240e-4e37-8c41-6f04d7173abe" (UID: "9e03bab6-240e-4e37-8c41-6f04d7173abe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:27:20.864253 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.864075    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-home" (OuterVolumeSpecName: "home") pod "9e03bab6-240e-4e37-8c41-6f04d7173abe" (UID: "9e03bab6-240e-4e37-8c41-6f04d7173abe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:27:20.864253 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.864202    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-model-cache" (OuterVolumeSpecName: "model-cache") pod "9e03bab6-240e-4e37-8c41-6f04d7173abe" (UID: "9e03bab6-240e-4e37-8c41-6f04d7173abe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:27:20.864253 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.864223    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-tmp-dir\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:27:20.864253 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.864243    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-home\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:27:20.866175 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.866153    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-dshm" (OuterVolumeSpecName: "dshm") pod "9e03bab6-240e-4e37-8c41-6f04d7173abe" (UID: "9e03bab6-240e-4e37-8c41-6f04d7173abe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:27:20.866175 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.866157    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e03bab6-240e-4e37-8c41-6f04d7173abe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9e03bab6-240e-4e37-8c41-6f04d7173abe" (UID: "9e03bab6-240e-4e37-8c41-6f04d7173abe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:27:20.866297 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.866282    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e03bab6-240e-4e37-8c41-6f04d7173abe-kube-api-access-fdklb" (OuterVolumeSpecName: "kube-api-access-fdklb") pod "9e03bab6-240e-4e37-8c41-6f04d7173abe" (UID: "9e03bab6-240e-4e37-8c41-6f04d7173abe"). InnerVolumeSpecName "kube-api-access-fdklb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:27:20.967586 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.967442    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-model-cache\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:27:20.967865 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.967733    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e03bab6-240e-4e37-8c41-6f04d7173abe-dshm\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:27:20.967865 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.967775    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e03bab6-240e-4e37-8c41-6f04d7173abe-tls-certs\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:27:20.967865 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.967795    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdklb\" (UniqueName: \"kubernetes.io/projected/9e03bab6-240e-4e37-8c41-6f04d7173abe-kube-api-access-fdklb\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:27:20.968947 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:20.968919    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b698c225-97f8-439d-8b39-09490e1079ca" path="/var/lib/kubelet/pods/b698c225-97f8-439d-8b39-09490e1079ca/volumes"
Jul 07 00:27:21.379468 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:21.379371    2582 generic.go:356] "Generic (PLEG): container finished" podID="9e03bab6-240e-4e37-8c41-6f04d7173abe" containerID="8c8db45de411e42cb9c7eff3e00ef937d62dc2717e8b0355c084bc019f3ff726" exitCode=0
Jul 07 00:27:21.379468 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:21.379428    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"
Jul 07 00:27:21.379717 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:21.379458    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk" event={"ID":"9e03bab6-240e-4e37-8c41-6f04d7173abe","Type":"ContainerDied","Data":"8c8db45de411e42cb9c7eff3e00ef937d62dc2717e8b0355c084bc019f3ff726"}
Jul 07 00:27:21.379717 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:21.379507    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk" event={"ID":"9e03bab6-240e-4e37-8c41-6f04d7173abe","Type":"ContainerDied","Data":"c2ccbb06a94bc76c7ab7eff0b946a17249301bd046bde244bd4bd881468d5739"}
Jul 07 00:27:21.379717 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:21.379527    2582 scope.go:117] "RemoveContainer" containerID="8c8db45de411e42cb9c7eff3e00ef937d62dc2717e8b0355c084bc019f3ff726"
Jul 07 00:27:21.388312 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:21.388292    2582 scope.go:117] "RemoveContainer" containerID="8c8db45de411e42cb9c7eff3e00ef937d62dc2717e8b0355c084bc019f3ff726"
Jul 07 00:27:21.388578 ip-10-0-129-95 kubenswrapper[2582]: E0707 00:27:21.388556    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c8db45de411e42cb9c7eff3e00ef937d62dc2717e8b0355c084bc019f3ff726\": container with ID starting with 8c8db45de411e42cb9c7eff3e00ef937d62dc2717e8b0355c084bc019f3ff726 not found: ID does not exist" containerID="8c8db45de411e42cb9c7eff3e00ef937d62dc2717e8b0355c084bc019f3ff726"
Jul 07 00:27:21.388623 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:21.388588    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8db45de411e42cb9c7eff3e00ef937d62dc2717e8b0355c084bc019f3ff726"} err="failed to get container status \"8c8db45de411e42cb9c7eff3e00ef937d62dc2717e8b0355c084bc019f3ff726\": rpc error: code = NotFound desc = could not find container \"8c8db45de411e42cb9c7eff3e00ef937d62dc2717e8b0355c084bc019f3ff726\": container with ID starting with 8c8db45de411e42cb9c7eff3e00ef937d62dc2717e8b0355c084bc019f3ff726 not found: ID does not exist"
Jul 07 00:27:21.396730 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:21.396696    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"]
Jul 07 00:27:21.398899 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:21.398870    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/auth-test-model-accfb9-kserve-5f44fccf79-56tmk"]
Jul 07 00:27:22.964272 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:22.964233    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e03bab6-240e-4e37-8c41-6f04d7173abe" path="/var/lib/kubelet/pods/9e03bab6-240e-4e37-8c41-6f04d7173abe/volumes"
Jul 07 00:27:26.875927 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:26.875880    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:26.875927 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:26.875933    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:26.888428 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:26.888394    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:27.420350 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:27.420319    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:27:52.381119 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.381085    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"]
Jul 07 00:27:52.381605 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.381442    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e03bab6-240e-4e37-8c41-6f04d7173abe" containerName="main"
Jul 07 00:27:52.381605 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.381453    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e03bab6-240e-4e37-8c41-6f04d7173abe" containerName="main"
Jul 07 00:27:52.381605 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.381475    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b698c225-97f8-439d-8b39-09490e1079ca" containerName="main"
Jul 07 00:27:52.381605 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.381480    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b698c225-97f8-439d-8b39-09490e1079ca" containerName="main"
Jul 07 00:27:52.381605 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.381531    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e03bab6-240e-4e37-8c41-6f04d7173abe" containerName="main"
Jul 07 00:27:52.381605 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.381541    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b698c225-97f8-439d-8b39-09490e1079ca" containerName="main"
Jul 07 00:27:52.384495 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.384472    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.388120 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.388090    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-accfb9\"/\"kube-root-ca.crt\""
Jul 07 00:27:52.388282 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.388092    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-accfb9\"/\"openshift-service-ca.crt\""
Jul 07 00:27:52.388282 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.388135    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-accfb9\"/\"default-dockercfg-mqs6h\""
Jul 07 00:27:52.388282 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.388092    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-accfb9\"/\"sub-test-model-accfb9-kserve-self-signed-certs\""
Jul 07 00:27:52.399826 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.399793    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"]
Jul 07 00:27:52.416380 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.416350    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:27:52.446134 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.446091    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-home\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.446134 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.446138    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7ab22d-10f6-4609-9e78-c1eb654856e8-tls-certs\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.446316 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.446216    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-tmp-dir\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.446316 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.446249    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-dshm\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.446316 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.446276    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-model-cache\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.446316 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.446307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbp25\" (UniqueName: \"kubernetes.io/projected/8c7ab22d-10f6-4609-9e78-c1eb654856e8-kube-api-access-sbp25\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.547124 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.547085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-tmp-dir\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.547124 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.547129    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-dshm\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.547390 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.547165    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-model-cache\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.547390 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.547202    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbp25\" (UniqueName: \"kubernetes.io/projected/8c7ab22d-10f6-4609-9e78-c1eb654856e8-kube-api-access-sbp25\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.547390 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.547271    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-home\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.547390 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.547304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7ab22d-10f6-4609-9e78-c1eb654856e8-tls-certs\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.547608 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.547526    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-tmp-dir\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.547608 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.547580    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-model-cache\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.547718 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.547700    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-home\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.549538 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.549519    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-dshm\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.549928 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.549908    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7ab22d-10f6-4609-9e78-c1eb654856e8-tls-certs\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.555953 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.555928    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbp25\" (UniqueName: \"kubernetes.io/projected/8c7ab22d-10f6-4609-9e78-c1eb654856e8-kube-api-access-sbp25\") pod \"sub-test-model-accfb9-kserve-866946cc5-mwbtt\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") " pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.693507 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.693472    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:27:52.831691 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:52.831532    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"]
Jul 07 00:27:52.834612 ip-10-0-129-95 kubenswrapper[2582]: W0707 00:27:52.834568    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c7ab22d_10f6_4609_9e78_c1eb654856e8.slice/crio-31d7941f001112a8172f89ff2ddc1a6d58a3e40db634692393ff9d44906237ac WatchSource:0}: Error finding container 31d7941f001112a8172f89ff2ddc1a6d58a3e40db634692393ff9d44906237ac: Status 404 returned error can't find the container with id 31d7941f001112a8172f89ff2ddc1a6d58a3e40db634692393ff9d44906237ac
Jul 07 00:27:53.538626 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:53.538592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt" event={"ID":"8c7ab22d-10f6-4609-9e78-c1eb654856e8","Type":"ContainerStarted","Data":"77a90eb01d6f235fb595273d34b808d7936e4a6e55c731db2124ea5e0637d212"}
Jul 07 00:27:53.538626 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:53.538634    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt" event={"ID":"8c7ab22d-10f6-4609-9e78-c1eb654856e8","Type":"ContainerStarted","Data":"31d7941f001112a8172f89ff2ddc1a6d58a3e40db634692393ff9d44906237ac"}
Jul 07 00:27:53.560285 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:27:53.560234    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt" podStartSLOduration=1.56021526 podStartE2EDuration="1.56021526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:27:53.558697204 +0000 UTC m=+2353.166125215" watchObservedRunningTime="2026-07-07 00:27:53.56021526 +0000 UTC m=+2353.167643271"
Jul 07 00:28:02.694180 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:02.694137    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:28:02.694630 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:02.694392    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:28:02.707028 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:02.706992    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:28:03.597604 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:03.597566    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:28:16.690992 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:16.690929    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:18.569625 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:18.569588    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:41.017856 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:41.017827    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 07 00:28:41.025843 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:41.025820    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fltzc_09adca1e-8a8a-4783-b288-a30f9684cad3/ovn-acl-logging/0.log"
Jul 07 00:28:41.109360 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:41.109308    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:45.555884 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:45.555840    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"]
Jul 07 00:28:45.577273 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:45.577230    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:46.467223 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:46.467184    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"]
Jul 07 00:28:46.487152 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:46.487119    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:49.984278 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:49.984244    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"]
Jul 07 00:28:49.987443 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:49.987425    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:49.989976 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:49.989951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fced7e\"/\"rate-test-model-fced7e-kserve-self-signed-certs\""
Jul 07 00:28:50.004897 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.004865    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"]
Jul 07 00:28:50.011120 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.011077    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:28:50.078328 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.078290    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-home\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.078328 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.078334    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prgpf\" (UniqueName: \"kubernetes.io/projected/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-kube-api-access-prgpf\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.078564 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.078426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-tmp-dir\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.078564 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.078489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-tls-certs\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.078564 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.078521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-dshm\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.078772 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.078667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-model-cache\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.179957 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.179913    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-home\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.180143 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.179965    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prgpf\" (UniqueName: \"kubernetes.io/projected/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-kube-api-access-prgpf\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.180143 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.180021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-tmp-dir\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.180143 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.180040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-tls-certs\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.180143 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.180055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-dshm\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.180143 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.180105    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-model-cache\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.180495 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.180386    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-home\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.180495 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.180423    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-tmp-dir\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.180495 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.180448    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-model-cache\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.182450 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.182423    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-dshm\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.182720 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.182701    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-tls-certs\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.189467 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.189436    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prgpf\" (UniqueName: \"kubernetes.io/projected/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-kube-api-access-prgpf\") pod \"rate-test-model-fced7e-kserve-65c794699-zftng\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") " pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.297312 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.297234    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:28:50.436125 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.436095    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"]
Jul 07 00:28:50.438092 ip-10-0-129-95 kubenswrapper[2582]: W0707 00:28:50.438066    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ca7245b_8ddf_4ee8_adcc_28b3a349ca37.slice/crio-d83eea49da681db6302691c42d49e0ac76fbe3ab4f07fcdda9aae53a2afd5b6c WatchSource:0}: Error finding container d83eea49da681db6302691c42d49e0ac76fbe3ab4f07fcdda9aae53a2afd5b6c: Status 404 returned error can't find the container with id d83eea49da681db6302691c42d49e0ac76fbe3ab4f07fcdda9aae53a2afd5b6c
Jul 07 00:28:50.797802 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.797762    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng" event={"ID":"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37","Type":"ContainerStarted","Data":"ed825375d4afec1cd3ab7dcdd6ffee6b84eb56a69d81caf6e5aa972ba755a4cc"}
Jul 07 00:28:50.797802 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.797806    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng" event={"ID":"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37","Type":"ContainerStarted","Data":"d83eea49da681db6302691c42d49e0ac76fbe3ab4f07fcdda9aae53a2afd5b6c"}
Jul 07 00:28:50.815949 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:28:50.815895    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng" podStartSLOduration=1.815878139 podStartE2EDuration="1.815878139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:28:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:28:50.814879712 +0000 UTC m=+2410.422307725" watchObservedRunningTime="2026-07-07 00:28:50.815878139 +0000 UTC m=+2410.423306224"
Jul 07 00:29:00.297901 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:00.297869    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:29:00.298266 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:00.297928    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:29:00.310268 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:00.310236    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:29:00.793952 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:00.793906    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d" podUID="bd4552c2-bda2-4fec-b954-7f5d58096f9a" containerName="main" containerID="cri-o://fb441b4c2b031a4f2686ce36c5329df17f7adfd86a796854046eb0970dfef41d" gracePeriod=45
Jul 07 00:29:00.854995 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:00.854964    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:29:01.042985 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.042958    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:29:01.183582 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.183544    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-home\") pod \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") "
Jul 07 00:29:01.183801 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.183600    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-model-cache\") pod \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") "
Jul 07 00:29:01.183801 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.183635    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd4552c2-bda2-4fec-b954-7f5d58096f9a-tls-certs\") pod \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") "
Jul 07 00:29:01.183801 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.183657    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v2v5\" (UniqueName: \"kubernetes.io/projected/bd4552c2-bda2-4fec-b954-7f5d58096f9a-kube-api-access-9v2v5\") pod \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") "
Jul 07 00:29:01.183801 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.183770    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-tmp-dir\") pod \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") "
Jul 07 00:29:01.184034 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.183825    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-dshm\") pod \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\" (UID: \"bd4552c2-bda2-4fec-b954-7f5d58096f9a\") "
Jul 07 00:29:01.184034 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.183918    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-home" (OuterVolumeSpecName: "home") pod "bd4552c2-bda2-4fec-b954-7f5d58096f9a" (UID: "bd4552c2-bda2-4fec-b954-7f5d58096f9a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:29:01.184152 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.184005    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-model-cache" (OuterVolumeSpecName: "model-cache") pod "bd4552c2-bda2-4fec-b954-7f5d58096f9a" (UID: "bd4552c2-bda2-4fec-b954-7f5d58096f9a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:29:01.184152 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.184117    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bd4552c2-bda2-4fec-b954-7f5d58096f9a" (UID: "bd4552c2-bda2-4fec-b954-7f5d58096f9a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:29:01.184152 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.184136    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-home\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:29:01.184152 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.184150    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-model-cache\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:29:01.186108 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.186076    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-dshm" (OuterVolumeSpecName: "dshm") pod "bd4552c2-bda2-4fec-b954-7f5d58096f9a" (UID: "bd4552c2-bda2-4fec-b954-7f5d58096f9a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:29:01.186212 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.186141    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4552c2-bda2-4fec-b954-7f5d58096f9a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bd4552c2-bda2-4fec-b954-7f5d58096f9a" (UID: "bd4552c2-bda2-4fec-b954-7f5d58096f9a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:29:01.186212 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.186153    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd4552c2-bda2-4fec-b954-7f5d58096f9a-kube-api-access-9v2v5" (OuterVolumeSpecName: "kube-api-access-9v2v5") pod "bd4552c2-bda2-4fec-b954-7f5d58096f9a" (UID: "bd4552c2-bda2-4fec-b954-7f5d58096f9a"). InnerVolumeSpecName "kube-api-access-9v2v5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:29:01.284835 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.284799    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd4552c2-bda2-4fec-b954-7f5d58096f9a-tls-certs\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:29:01.284835 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.284829    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v2v5\" (UniqueName: \"kubernetes.io/projected/bd4552c2-bda2-4fec-b954-7f5d58096f9a-kube-api-access-9v2v5\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:29:01.284835 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.284839    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-tmp-dir\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:29:01.285072 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.284850    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd4552c2-bda2-4fec-b954-7f5d58096f9a-dshm\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:29:01.488236 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.488135    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt" podUID="8c7ab22d-10f6-4609-9e78-c1eb654856e8" containerName="main" containerID="cri-o://77a90eb01d6f235fb595273d34b808d7936e4a6e55c731db2124ea5e0637d212" gracePeriod=45
Jul 07 00:29:01.730460 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.730433    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:29:01.788961 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.788861    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-tmp-dir\") pod \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") "
Jul 07 00:29:01.788961 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.788908    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-model-cache\") pod \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") "
Jul 07 00:29:01.788961 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.788938    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7ab22d-10f6-4609-9e78-c1eb654856e8-tls-certs\") pod \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") "
Jul 07 00:29:01.789247 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.788985    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbp25\" (UniqueName: \"kubernetes.io/projected/8c7ab22d-10f6-4609-9e78-c1eb654856e8-kube-api-access-sbp25\") pod \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") "
Jul 07 00:29:01.789247 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.789043    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-home\") pod \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") "
Jul 07 00:29:01.789247 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.789098    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-dshm\") pod \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\" (UID: \"8c7ab22d-10f6-4609-9e78-c1eb654856e8\") "
Jul 07 00:29:01.789247 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.789216    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-model-cache" (OuterVolumeSpecName: "model-cache") pod "8c7ab22d-10f6-4609-9e78-c1eb654856e8" (UID: "8c7ab22d-10f6-4609-9e78-c1eb654856e8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:29:01.789247 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.789229    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8c7ab22d-10f6-4609-9e78-c1eb654856e8" (UID: "8c7ab22d-10f6-4609-9e78-c1eb654856e8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:29:01.789447 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.789376    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-tmp-dir\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:29:01.789447 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.789376    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-home" (OuterVolumeSpecName: "home") pod "8c7ab22d-10f6-4609-9e78-c1eb654856e8" (UID: "8c7ab22d-10f6-4609-9e78-c1eb654856e8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:29:01.789447 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.789390    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-model-cache\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:29:01.791417 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.791392    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c7ab22d-10f6-4609-9e78-c1eb654856e8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8c7ab22d-10f6-4609-9e78-c1eb654856e8" (UID: "8c7ab22d-10f6-4609-9e78-c1eb654856e8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:29:01.791417 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.791403    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7ab22d-10f6-4609-9e78-c1eb654856e8-kube-api-access-sbp25" (OuterVolumeSpecName: "kube-api-access-sbp25") pod "8c7ab22d-10f6-4609-9e78-c1eb654856e8" (UID: "8c7ab22d-10f6-4609-9e78-c1eb654856e8"). InnerVolumeSpecName "kube-api-access-sbp25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:29:01.791543 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.791389    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-dshm" (OuterVolumeSpecName: "dshm") pod "8c7ab22d-10f6-4609-9e78-c1eb654856e8" (UID: "8c7ab22d-10f6-4609-9e78-c1eb654856e8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:29:01.850789 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.850729    2582 generic.go:356] "Generic (PLEG): container finished" podID="8c7ab22d-10f6-4609-9e78-c1eb654856e8" containerID="77a90eb01d6f235fb595273d34b808d7936e4a6e55c731db2124ea5e0637d212" exitCode=0
Jul 07 00:29:01.850989 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.850806    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"
Jul 07 00:29:01.850989 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.850832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt" event={"ID":"8c7ab22d-10f6-4609-9e78-c1eb654856e8","Type":"ContainerDied","Data":"77a90eb01d6f235fb595273d34b808d7936e4a6e55c731db2124ea5e0637d212"}
Jul 07 00:29:01.850989 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.850877    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt" event={"ID":"8c7ab22d-10f6-4609-9e78-c1eb654856e8","Type":"ContainerDied","Data":"31d7941f001112a8172f89ff2ddc1a6d58a3e40db634692393ff9d44906237ac"}
Jul 07 00:29:01.850989 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.850894    2582 scope.go:117] "RemoveContainer" containerID="77a90eb01d6f235fb595273d34b808d7936e4a6e55c731db2124ea5e0637d212"
Jul 07 00:29:01.852291 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.852101    2582 generic.go:356] "Generic (PLEG): container finished" podID="bd4552c2-bda2-4fec-b954-7f5d58096f9a" containerID="fb441b4c2b031a4f2686ce36c5329df17f7adfd86a796854046eb0970dfef41d" exitCode=0
Jul 07 00:29:01.852291 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.852140    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"
Jul 07 00:29:01.852291 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.852181    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d" event={"ID":"bd4552c2-bda2-4fec-b954-7f5d58096f9a","Type":"ContainerDied","Data":"fb441b4c2b031a4f2686ce36c5329df17f7adfd86a796854046eb0970dfef41d"}
Jul 07 00:29:01.852291 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.852218    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d" event={"ID":"bd4552c2-bda2-4fec-b954-7f5d58096f9a","Type":"ContainerDied","Data":"642dc54fe4119a6588ac586ad85e9647f72014d70f35db87e363d777ad7fa156"}
Jul 07 00:29:01.859911 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.859889    2582 scope.go:117] "RemoveContainer" containerID="77a90eb01d6f235fb595273d34b808d7936e4a6e55c731db2124ea5e0637d212"
Jul 07 00:29:01.860199 ip-10-0-129-95 kubenswrapper[2582]: E0707 00:29:01.860182    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77a90eb01d6f235fb595273d34b808d7936e4a6e55c731db2124ea5e0637d212\": container with ID starting with 77a90eb01d6f235fb595273d34b808d7936e4a6e55c731db2124ea5e0637d212 not found: ID does not exist" containerID="77a90eb01d6f235fb595273d34b808d7936e4a6e55c731db2124ea5e0637d212"
Jul 07 00:29:01.860273 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.860208    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77a90eb01d6f235fb595273d34b808d7936e4a6e55c731db2124ea5e0637d212"} err="failed to get container status \"77a90eb01d6f235fb595273d34b808d7936e4a6e55c731db2124ea5e0637d212\": rpc error: code = NotFound desc = could not find container \"77a90eb01d6f235fb595273d34b808d7936e4a6e55c731db2124ea5e0637d212\": container with ID starting with 77a90eb01d6f235fb595273d34b808d7936e4a6e55c731db2124ea5e0637d212 not found: ID does not exist"
Jul 07 00:29:01.860273 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.860225    2582 scope.go:117] "RemoveContainer" containerID="fb441b4c2b031a4f2686ce36c5329df17f7adfd86a796854046eb0970dfef41d"
Jul 07 00:29:01.868473 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.868453    2582 scope.go:117] "RemoveContainer" containerID="fb441b4c2b031a4f2686ce36c5329df17f7adfd86a796854046eb0970dfef41d"
Jul 07 00:29:01.868776 ip-10-0-129-95 kubenswrapper[2582]: E0707 00:29:01.868733    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb441b4c2b031a4f2686ce36c5329df17f7adfd86a796854046eb0970dfef41d\": container with ID starting with fb441b4c2b031a4f2686ce36c5329df17f7adfd86a796854046eb0970dfef41d not found: ID does not exist" containerID="fb441b4c2b031a4f2686ce36c5329df17f7adfd86a796854046eb0970dfef41d"
Jul 07 00:29:01.868865 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.868781    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb441b4c2b031a4f2686ce36c5329df17f7adfd86a796854046eb0970dfef41d"} err="failed to get container status \"fb441b4c2b031a4f2686ce36c5329df17f7adfd86a796854046eb0970dfef41d\": rpc error: code = NotFound desc = could not find container \"fb441b4c2b031a4f2686ce36c5329df17f7adfd86a796854046eb0970dfef41d\": container with ID starting with fb441b4c2b031a4f2686ce36c5329df17f7adfd86a796854046eb0970dfef41d not found: ID does not exist"
Jul 07 00:29:01.874759 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.874715    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"]
Jul 07 00:29:01.878308 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.878281    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/sub-test-model-accfb9-kserve-866946cc5-mwbtt"]
Jul 07 00:29:01.888437 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.888411    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"]
Jul 07 00:29:01.889864 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.889844    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7ab22d-10f6-4609-9e78-c1eb654856e8-tls-certs\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:29:01.889919 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.889868    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbp25\" (UniqueName: \"kubernetes.io/projected/8c7ab22d-10f6-4609-9e78-c1eb654856e8-kube-api-access-sbp25\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:29:01.889919 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.889880    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-home\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:29:01.889919 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.889889    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7ab22d-10f6-4609-9e78-c1eb654856e8-dshm\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:29:01.892691 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:01.892664    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/sub-test-model-fced7e-kserve-6879f4d75f-x5q7d"]
Jul 07 00:29:02.965272 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:02.965234    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c7ab22d-10f6-4609-9e78-c1eb654856e8" path="/var/lib/kubelet/pods/8c7ab22d-10f6-4609-9e78-c1eb654856e8/volumes"
Jul 07 00:29:02.965638 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:02.965606    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd4552c2-bda2-4fec-b954-7f5d58096f9a" path="/var/lib/kubelet/pods/bd4552c2-bda2-4fec-b954-7f5d58096f9a/volumes"
Jul 07 00:29:11.378212 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.378170    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"]
Jul 07 00:29:11.378629 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.378593    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4552c2-bda2-4fec-b954-7f5d58096f9a" containerName="main"
Jul 07 00:29:11.378629 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.378606    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4552c2-bda2-4fec-b954-7f5d58096f9a" containerName="main"
Jul 07 00:29:11.378629 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.378628    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7ab22d-10f6-4609-9e78-c1eb654856e8" containerName="main"
Jul 07 00:29:11.378734 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.378634    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7ab22d-10f6-4609-9e78-c1eb654856e8" containerName="main"
Jul 07 00:29:11.378734 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.378688    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c7ab22d-10f6-4609-9e78-c1eb654856e8" containerName="main"
Jul 07 00:29:11.378734 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.378696    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd4552c2-bda2-4fec-b954-7f5d58096f9a" containerName="main"
Jul 07 00:29:11.383324 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.383301    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.385716 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.385691    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-accfb9\"/\"kube-root-ca.crt\""
Jul 07 00:29:11.386643 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.386622    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-accfb9\"/\"rate-test-model-accfb9-kserve-self-signed-certs\""
Jul 07 00:29:11.386776 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.386629    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-accfb9\"/\"default-dockercfg-mqs6h\""
Jul 07 00:29:11.386776 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.386659    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-accfb9\"/\"openshift-service-ca.crt\""
Jul 07 00:29:11.391835 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.391813    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"]
Jul 07 00:29:11.405464 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.405422    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:11.480881 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.480844    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2e89957-8390-47f7-af75-eca0a72a12bb-tls-certs\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.480881 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.480883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-model-cache\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.481104 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.480903    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-dshm\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.481104 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.480988    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-home\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.481104 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.481046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pjth\" (UniqueName: \"kubernetes.io/projected/d2e89957-8390-47f7-af75-eca0a72a12bb-kube-api-access-2pjth\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.481104 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.481071    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-tmp-dir\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.581800 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.581763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2e89957-8390-47f7-af75-eca0a72a12bb-tls-certs\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.581800 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.581812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-model-cache\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.582050 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.581847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-dshm\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.582050 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.581908    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-home\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.582050 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.581948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjth\" (UniqueName: \"kubernetes.io/projected/d2e89957-8390-47f7-af75-eca0a72a12bb-kube-api-access-2pjth\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.582050 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.581981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-tmp-dir\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.582298 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.582240    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-model-cache\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.582357 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.582290    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-home\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.582408 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.582380    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-tmp-dir\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.584452 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.584426    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-dshm\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.584605 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.584588    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2e89957-8390-47f7-af75-eca0a72a12bb-tls-certs\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.590712 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.590684    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pjth\" (UniqueName: \"kubernetes.io/projected/d2e89957-8390-47f7-af75-eca0a72a12bb-kube-api-access-2pjth\") pod \"rate-test-model-accfb9-kserve-6795d9c54c-s4lmp\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") " pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.694001 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.693954    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:11.833981 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.833950    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"]
Jul 07 00:29:11.836155 ip-10-0-129-95 kubenswrapper[2582]: W0707 00:29:11.836120    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2e89957_8390_47f7_af75_eca0a72a12bb.slice/crio-6a62248a4b3e90abfc7fba77f20bb81cfbab7f38d6d8ec0c2b3e1d8cb9757124 WatchSource:0}: Error finding container 6a62248a4b3e90abfc7fba77f20bb81cfbab7f38d6d8ec0c2b3e1d8cb9757124: Status 404 returned error can't find the container with id 6a62248a4b3e90abfc7fba77f20bb81cfbab7f38d6d8ec0c2b3e1d8cb9757124
Jul 07 00:29:11.901715 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.901680    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp" event={"ID":"d2e89957-8390-47f7-af75-eca0a72a12bb","Type":"ContainerStarted","Data":"43a5aeeaf7c257ec7c8a6e0fcf0c36e1dc22e7789f00951601f568bcd4c04cef"}
Jul 07 00:29:11.901904 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.901725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp" event={"ID":"d2e89957-8390-47f7-af75-eca0a72a12bb","Type":"ContainerStarted","Data":"6a62248a4b3e90abfc7fba77f20bb81cfbab7f38d6d8ec0c2b3e1d8cb9757124"}
Jul 07 00:29:11.920438 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:11.920385    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp" podStartSLOduration=0.920370048 podStartE2EDuration="920.370048ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:29:11.91818847 +0000 UTC m=+2431.525616483" watchObservedRunningTime="2026-07-07 00:29:11.920370048 +0000 UTC m=+2431.527798059"
Jul 07 00:29:21.694755 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:21.694696    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:21.694755 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:21.694767    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:21.707632 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:21.707597    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:21.957808 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:21.957708    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:29:43.362329 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:43.362273    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:43.464166 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:43.464133    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:50.781570 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:50.781534    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"]
Jul 07 00:29:50.807802 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:50.807729    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:51.610455 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:51.610423    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:51.663841 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:51.663808    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"]
Jul 07 00:29:51.684770 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:51.684722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:51.742861 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:51.742822    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:52.776590 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:52.776554    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:53.195545 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:53.195510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:53.296490 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:53.296448    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:53.470272 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:53.470179    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:29:58.266170 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:29:58.266118    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:05.802458 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:05.802394    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng" podUID="3ca7245b-8ddf-4ee8-adcc-28b3a349ca37" containerName="main" containerID="cri-o://ed825375d4afec1cd3ab7dcdd6ffee6b84eb56a69d81caf6e5aa972ba755a4cc" gracePeriod=45
Jul 07 00:30:06.057823 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.057723    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:30:06.076684 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.076650    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prgpf\" (UniqueName: \"kubernetes.io/projected/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-kube-api-access-prgpf\") pod \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") "
Jul 07 00:30:06.076885 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.076713    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-dshm\") pod \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") "
Jul 07 00:30:06.076885 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.076771    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-tmp-dir\") pod \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") "
Jul 07 00:30:06.076885 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.076809    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-tls-certs\") pod \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") "
Jul 07 00:30:06.076885 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.076847    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-home\") pod \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") "
Jul 07 00:30:06.077102 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.076892    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-model-cache\") pod \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\" (UID: \"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37\") "
Jul 07 00:30:06.077102 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.077086    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3ca7245b-8ddf-4ee8-adcc-28b3a349ca37" (UID: "3ca7245b-8ddf-4ee8-adcc-28b3a349ca37"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:30:06.077206 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.077130    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-home" (OuterVolumeSpecName: "home") pod "3ca7245b-8ddf-4ee8-adcc-28b3a349ca37" (UID: "3ca7245b-8ddf-4ee8-adcc-28b3a349ca37"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:30:06.077360 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.077332    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-model-cache" (OuterVolumeSpecName: "model-cache") pod "3ca7245b-8ddf-4ee8-adcc-28b3a349ca37" (UID: "3ca7245b-8ddf-4ee8-adcc-28b3a349ca37"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:30:06.079398 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.079367    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-dshm" (OuterVolumeSpecName: "dshm") pod "3ca7245b-8ddf-4ee8-adcc-28b3a349ca37" (UID: "3ca7245b-8ddf-4ee8-adcc-28b3a349ca37"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:30:06.079652 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.079624    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3ca7245b-8ddf-4ee8-adcc-28b3a349ca37" (UID: "3ca7245b-8ddf-4ee8-adcc-28b3a349ca37"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:30:06.079652 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.079639    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-kube-api-access-prgpf" (OuterVolumeSpecName: "kube-api-access-prgpf") pod "3ca7245b-8ddf-4ee8-adcc-28b3a349ca37" (UID: "3ca7245b-8ddf-4ee8-adcc-28b3a349ca37"). InnerVolumeSpecName "kube-api-access-prgpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:30:06.145317 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.145279    2582 generic.go:356] "Generic (PLEG): container finished" podID="3ca7245b-8ddf-4ee8-adcc-28b3a349ca37" containerID="ed825375d4afec1cd3ab7dcdd6ffee6b84eb56a69d81caf6e5aa972ba755a4cc" exitCode=0
Jul 07 00:30:06.145317 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.145318    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng" event={"ID":"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37","Type":"ContainerDied","Data":"ed825375d4afec1cd3ab7dcdd6ffee6b84eb56a69d81caf6e5aa972ba755a4cc"}
Jul 07 00:30:06.145575 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.145326    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"
Jul 07 00:30:06.145575 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.145345    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng" event={"ID":"3ca7245b-8ddf-4ee8-adcc-28b3a349ca37","Type":"ContainerDied","Data":"d83eea49da681db6302691c42d49e0ac76fbe3ab4f07fcdda9aae53a2afd5b6c"}
Jul 07 00:30:06.145575 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.145363    2582 scope.go:117] "RemoveContainer" containerID="ed825375d4afec1cd3ab7dcdd6ffee6b84eb56a69d81caf6e5aa972ba755a4cc"
Jul 07 00:30:06.155091 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.155070    2582 scope.go:117] "RemoveContainer" containerID="ed825375d4afec1cd3ab7dcdd6ffee6b84eb56a69d81caf6e5aa972ba755a4cc"
Jul 07 00:30:06.155410 ip-10-0-129-95 kubenswrapper[2582]: E0707 00:30:06.155391    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed825375d4afec1cd3ab7dcdd6ffee6b84eb56a69d81caf6e5aa972ba755a4cc\": container with ID starting with ed825375d4afec1cd3ab7dcdd6ffee6b84eb56a69d81caf6e5aa972ba755a4cc not found: ID does not exist" containerID="ed825375d4afec1cd3ab7dcdd6ffee6b84eb56a69d81caf6e5aa972ba755a4cc"
Jul 07 00:30:06.155448 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.155422    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed825375d4afec1cd3ab7dcdd6ffee6b84eb56a69d81caf6e5aa972ba755a4cc"} err="failed to get container status \"ed825375d4afec1cd3ab7dcdd6ffee6b84eb56a69d81caf6e5aa972ba755a4cc\": rpc error: code = NotFound desc = could not find container \"ed825375d4afec1cd3ab7dcdd6ffee6b84eb56a69d81caf6e5aa972ba755a4cc\": container with ID starting with ed825375d4afec1cd3ab7dcdd6ffee6b84eb56a69d81caf6e5aa972ba755a4cc not found: ID does not exist"
Jul 07 00:30:06.166026 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.165989    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"]
Jul 07 00:30:06.169606 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.169571    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fced7e/rate-test-model-fced7e-kserve-65c794699-zftng"]
Jul 07 00:30:06.178012 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.177981    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-tls-certs\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:30:06.178012 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.178009    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-home\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:30:06.178012 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.178022    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-model-cache\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:30:06.178255 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.178046    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prgpf\" (UniqueName: \"kubernetes.io/projected/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-kube-api-access-prgpf\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:30:06.178255 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.178058    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-dshm\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:30:06.178255 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.178095    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37-tmp-dir\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:30:06.684394 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.684338    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp" podUID="d2e89957-8390-47f7-af75-eca0a72a12bb" containerName="main" containerID="cri-o://43a5aeeaf7c257ec7c8a6e0fcf0c36e1dc22e7789f00951601f568bcd4c04cef" gracePeriod=45
Jul 07 00:30:06.944531 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.944464    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:30:06.966057 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.966017    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ca7245b-8ddf-4ee8-adcc-28b3a349ca37" path="/var/lib/kubelet/pods/3ca7245b-8ddf-4ee8-adcc-28b3a349ca37/volumes"
Jul 07 00:30:06.986157 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.986114    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-tmp-dir\") pod \"d2e89957-8390-47f7-af75-eca0a72a12bb\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") "
Jul 07 00:30:06.986157 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.986161    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-model-cache\") pod \"d2e89957-8390-47f7-af75-eca0a72a12bb\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") "
Jul 07 00:30:06.986414 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.986270    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-dshm\") pod \"d2e89957-8390-47f7-af75-eca0a72a12bb\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") "
Jul 07 00:30:06.986414 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.986297    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-home\") pod \"d2e89957-8390-47f7-af75-eca0a72a12bb\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") "
Jul 07 00:30:06.986414 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.986321    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2e89957-8390-47f7-af75-eca0a72a12bb-tls-certs\") pod \"d2e89957-8390-47f7-af75-eca0a72a12bb\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") "
Jul 07 00:30:06.986414 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.986361    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pjth\" (UniqueName: \"kubernetes.io/projected/d2e89957-8390-47f7-af75-eca0a72a12bb-kube-api-access-2pjth\") pod \"d2e89957-8390-47f7-af75-eca0a72a12bb\" (UID: \"d2e89957-8390-47f7-af75-eca0a72a12bb\") "
Jul 07 00:30:06.986602 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.986403    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d2e89957-8390-47f7-af75-eca0a72a12bb" (UID: "d2e89957-8390-47f7-af75-eca0a72a12bb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:30:06.986602 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.986476    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-model-cache" (OuterVolumeSpecName: "model-cache") pod "d2e89957-8390-47f7-af75-eca0a72a12bb" (UID: "d2e89957-8390-47f7-af75-eca0a72a12bb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:30:06.986602 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.986537    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-home" (OuterVolumeSpecName: "home") pod "d2e89957-8390-47f7-af75-eca0a72a12bb" (UID: "d2e89957-8390-47f7-af75-eca0a72a12bb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:30:06.986717 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.986650    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-home\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:30:06.986717 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.986663    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-tmp-dir\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:30:06.986717 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.986673    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-model-cache\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:30:06.988673 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.988636    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-dshm" (OuterVolumeSpecName: "dshm") pod "d2e89957-8390-47f7-af75-eca0a72a12bb" (UID: "d2e89957-8390-47f7-af75-eca0a72a12bb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:30:06.988819 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.988637    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2e89957-8390-47f7-af75-eca0a72a12bb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d2e89957-8390-47f7-af75-eca0a72a12bb" (UID: "d2e89957-8390-47f7-af75-eca0a72a12bb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:30:06.988819 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:06.988711    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2e89957-8390-47f7-af75-eca0a72a12bb-kube-api-access-2pjth" (OuterVolumeSpecName: "kube-api-access-2pjth") pod "d2e89957-8390-47f7-af75-eca0a72a12bb" (UID: "d2e89957-8390-47f7-af75-eca0a72a12bb"). InnerVolumeSpecName "kube-api-access-2pjth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:30:07.087107 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:07.087071    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2e89957-8390-47f7-af75-eca0a72a12bb-dshm\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:30:07.087107 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:07.087106    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2e89957-8390-47f7-af75-eca0a72a12bb-tls-certs\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:30:07.087107 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:07.087117    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pjth\" (UniqueName: \"kubernetes.io/projected/d2e89957-8390-47f7-af75-eca0a72a12bb-kube-api-access-2pjth\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\""
Jul 07 00:30:07.152237 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:07.152203    2582 generic.go:356] "Generic (PLEG): container finished" podID="d2e89957-8390-47f7-af75-eca0a72a12bb" containerID="43a5aeeaf7c257ec7c8a6e0fcf0c36e1dc22e7789f00951601f568bcd4c04cef" exitCode=0
Jul 07 00:30:07.152426 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:07.152244    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"
Jul 07 00:30:07.152426 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:07.152295    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp" event={"ID":"d2e89957-8390-47f7-af75-eca0a72a12bb","Type":"ContainerDied","Data":"43a5aeeaf7c257ec7c8a6e0fcf0c36e1dc22e7789f00951601f568bcd4c04cef"}
Jul 07 00:30:07.152426 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:07.152333    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp" event={"ID":"d2e89957-8390-47f7-af75-eca0a72a12bb","Type":"ContainerDied","Data":"6a62248a4b3e90abfc7fba77f20bb81cfbab7f38d6d8ec0c2b3e1d8cb9757124"}
Jul 07 00:30:07.152426 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:07.152355    2582 scope.go:117] "RemoveContainer" containerID="43a5aeeaf7c257ec7c8a6e0fcf0c36e1dc22e7789f00951601f568bcd4c04cef"
Jul 07 00:30:07.161803 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:07.161781    2582 scope.go:117] "RemoveContainer" containerID="43a5aeeaf7c257ec7c8a6e0fcf0c36e1dc22e7789f00951601f568bcd4c04cef"
Jul 07 00:30:07.162114 ip-10-0-129-95 kubenswrapper[2582]: E0707 00:30:07.162095    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43a5aeeaf7c257ec7c8a6e0fcf0c36e1dc22e7789f00951601f568bcd4c04cef\": container with ID starting with 43a5aeeaf7c257ec7c8a6e0fcf0c36e1dc22e7789f00951601f568bcd4c04cef not found: ID does not exist" containerID="43a5aeeaf7c257ec7c8a6e0fcf0c36e1dc22e7789f00951601f568bcd4c04cef"
Jul 07 00:30:07.162186 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:07.162126    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43a5aeeaf7c257ec7c8a6e0fcf0c36e1dc22e7789f00951601f568bcd4c04cef"} err="failed to get container status \"43a5aeeaf7c257ec7c8a6e0fcf0c36e1dc22e7789f00951601f568bcd4c04cef\": rpc error: code = NotFound desc = could not find container \"43a5aeeaf7c257ec7c8a6e0fcf0c36e1dc22e7789f00951601f568bcd4c04cef\": container with ID starting with 43a5aeeaf7c257ec7c8a6e0fcf0c36e1dc22e7789f00951601f568bcd4c04cef not found: ID does not exist"
Jul 07 00:30:07.173888 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:07.173846    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"]
Jul 07 00:30:07.178075 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:07.178048    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-accfb9/rate-test-model-accfb9-kserve-6795d9c54c-s4lmp"]
Jul 07 00:30:08.963870 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:08.963833    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2e89957-8390-47f7-af75-eca0a72a12bb" path="/var/lib/kubelet/pods/d2e89957-8390-47f7-af75-eca0a72a12bb/volumes"
Jul 07 00:30:35.074663 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:35.074561    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:35.356261 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:35.356171    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:35.597617 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:35.597579    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:35.770568 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:35.770510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:36.256397 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:36.256356    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:36.357121 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:36.357081    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:36.458521 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:36.458484    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:36.564514 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:36.564411    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:41.984435 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:41.984387    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:42.087306 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:42.087245    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:42.285977 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:42.285852    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:42.510890 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:42.510845    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:42.970095 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:42.970056    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-756c6985b-rf8ss_aea9803f-4c6a-4522-8700-d9fec9108709/authorino/0.log"
Jul 07 00:30:48.899129 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:48.899100    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dg52h_44ae4a0a-38ad-46fb-80d6-2517a0633c8b/server/0.log"
Jul 07 00:30:49.035451 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:49.035399    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jxg7s_8d92df3b-a79c-4297-8a84-ae2c6ac03154/manager/0.log"
Jul 07 00:30:49.285824 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:49.285796    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bcdcfc745-sn6g6_7ca7948f-f124-4497-9ffe-05d83f0800da/copy-manifests/0.log"
Jul 07 00:30:49.293902 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:49.293870    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bcdcfc745-sn6g6_7ca7948f-f124-4497-9ffe-05d83f0800da/manager/0.log"
Jul 07 00:30:50.889259 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:50.889183    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-756c6985b-rf8ss_aea9803f-4c6a-4522-8700-d9fec9108709/authorino/0.log"
Jul 07 00:30:51.256012 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:51.255982    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6sxqm_682456ac-d8cc-46c4-8bc2-63cffd496bc6/kuadrant-console-plugin/0.log"
Jul 07 00:30:52.548798 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:52.548769    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dc8c455ff-wj47q_ed16ccfc-b542-433b-84c6-5ac26919538e/kube-auth-proxy/0.log"
Jul 07 00:30:53.449170 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:53.449136    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5shjw_8c5d16a6-344a-43e7-9237-fd1ab8a9db02/main/0.log"
Jul 07 00:30:53.568481 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:53.568448    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7q47w_f3841f22-dc16-4ed0-b526-6b2da532b303/main/0.log"
Jul 07 00:30:54.030213 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:54.030176    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-kw5fl_e67625ff-e529-4343-9d37-1ed198bf1d4a/main/0.log"
Jul 07 00:30:58.737366 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:58.737322    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:30:58.806694 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:30:58.806655    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log" limit=1024
Jul 07 00:31:01.754929 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:01.754896    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cllp6_55651bcb-05d0-4904-8609-c8c57720ad7f/global-pull-secret-syncer/0.log"
Jul 07 00:31:01.810630 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:01.810579    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5xx98_f6bcd6b2-9f4b-4cb0-a13b-50c0e55a4969/konnectivity-agent/0.log"
Jul 07 00:31:01.894612 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:01.894568    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-95.ec2.internal_eff5104d7452b5ed4a3bf2742a0cf695/haproxy/0.log"
Jul 07 00:31:06.511921 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:06.511873    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-756c6985b-rf8ss_aea9803f-4c6a-4522-8700-d9fec9108709/authorino/0.log"
Jul 07 00:31:06.634994 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:06.634961    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6sxqm_682456ac-d8cc-46c4-8bc2-63cffd496bc6/kuadrant-console-plugin/0.log"
Jul 07 00:31:08.636609 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:08.636579    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08cfb31e-3c39-4b15-87d1-4f1b1b9deef3/alertmanager/0.log"
Jul 07 00:31:08.658339 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:08.658307    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08cfb31e-3c39-4b15-87d1-4f1b1b9deef3/config-reloader/0.log"
Jul 07 00:31:08.680848 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:08.680815    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08cfb31e-3c39-4b15-87d1-4f1b1b9deef3/kube-rbac-proxy-web/0.log"
Jul 07 00:31:08.704251 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:08.704222    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08cfb31e-3c39-4b15-87d1-4f1b1b9deef3/kube-rbac-proxy/0.log"
Jul 07 00:31:08.726350 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:08.726323    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08cfb31e-3c39-4b15-87d1-4f1b1b9deef3/kube-rbac-proxy-metric/0.log"
Jul 07 00:31:08.748415 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:08.748383    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08cfb31e-3c39-4b15-87d1-4f1b1b9deef3/prom-label-proxy/0.log"
Jul 07 00:31:08.769974 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:08.769945    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08cfb31e-3c39-4b15-87d1-4f1b1b9deef3/init-config-reloader/0.log"
Jul 07 00:31:08.995580 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:08.995548    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gktbg_10788016-85e0-4461-9f66-a30efa4a3100/node-exporter/0.log"
Jul 07 00:31:09.016461 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:09.016431    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gktbg_10788016-85e0-4461-9f66-a30efa4a3100/kube-rbac-proxy/0.log"
Jul 07 00:31:09.037653 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:09.037620    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gktbg_10788016-85e0-4461-9f66-a30efa4a3100/init-textfile/0.log"
Jul 07 00:31:09.641449 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:09.641375    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56674b64fc-fr2j2_a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8/telemeter-client/0.log"
Jul 07 00:31:09.664211 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:09.664181    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56674b64fc-fr2j2_a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8/reload/0.log"
Jul 07 00:31:09.689619 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:09.689568    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56674b64fc-fr2j2_a2caf5d9-0b77-4780-8716-c5aa4bc7c2d8/kube-rbac-proxy/0.log"
Jul 07 00:31:12.461667 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.461633    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"]
Jul 07 00:31:12.462064 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.462042    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2e89957-8390-47f7-af75-eca0a72a12bb" containerName="main"
Jul 07 00:31:12.462064 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.462055    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2e89957-8390-47f7-af75-eca0a72a12bb" containerName="main"
Jul 07 00:31:12.462162 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.462068    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ca7245b-8ddf-4ee8-adcc-28b3a349ca37" containerName="main"
Jul 07 00:31:12.462162 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.462075    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ca7245b-8ddf-4ee8-adcc-28b3a349ca37" containerName="main"
Jul 07 00:31:12.462162 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.462122    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2e89957-8390-47f7-af75-eca0a72a12bb" containerName="main"
Jul 07 00:31:12.462162 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.462132    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ca7245b-8ddf-4ee8-adcc-28b3a349ca37" containerName="main"
Jul 07 00:31:12.465342 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.465323    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.467734 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.467705    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nrxzw\"/\"openshift-service-ca.crt\""
Jul 07 00:31:12.468679 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.468660    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nrxzw\"/\"default-dockercfg-68rc2\""
Jul 07 00:31:12.468763 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.468667    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nrxzw\"/\"kube-root-ca.crt\""
Jul 07 00:31:12.474768 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.474718    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"]
Jul 07 00:31:12.547446 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.547408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ldn8\" (UniqueName: \"kubernetes.io/projected/d59f2ea2-5ad5-417f-882e-a4ff584b0307-kube-api-access-5ldn8\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.547446 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.547451    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d59f2ea2-5ad5-417f-882e-a4ff584b0307-sys\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.547695 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.547467    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d59f2ea2-5ad5-417f-882e-a4ff584b0307-proc\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.547695 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.547590    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d59f2ea2-5ad5-417f-882e-a4ff584b0307-podres\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.547695 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.547632    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d59f2ea2-5ad5-417f-882e-a4ff584b0307-lib-modules\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.648773 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.648695    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ldn8\" (UniqueName: \"kubernetes.io/projected/d59f2ea2-5ad5-417f-882e-a4ff584b0307-kube-api-access-5ldn8\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.648773 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.648772    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d59f2ea2-5ad5-417f-882e-a4ff584b0307-sys\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.648995 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.648797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d59f2ea2-5ad5-417f-882e-a4ff584b0307-proc\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.648995 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.648885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d59f2ea2-5ad5-417f-882e-a4ff584b0307-podres\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.648995 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.648903    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d59f2ea2-5ad5-417f-882e-a4ff584b0307-sys\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.648995 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.648935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d59f2ea2-5ad5-417f-882e-a4ff584b0307-lib-modules\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.648995 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.648976    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d59f2ea2-5ad5-417f-882e-a4ff584b0307-proc\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.649189 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.649014    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d59f2ea2-5ad5-417f-882e-a4ff584b0307-podres\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.649189 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.649077    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d59f2ea2-5ad5-417f-882e-a4ff584b0307-lib-modules\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.657063 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.657032    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ldn8\" (UniqueName: \"kubernetes.io/projected/d59f2ea2-5ad5-417f-882e-a4ff584b0307-kube-api-access-5ldn8\") pod \"perf-node-gather-daemonset-wm2xt\" (UID: \"d59f2ea2-5ad5-417f-882e-a4ff584b0307\") " pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.776489 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.776395    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:12.916860 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:12.916815    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"]
Jul 07 00:31:12.919151 ip-10-0-129-95 kubenswrapper[2582]: W0707 00:31:12.919118    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd59f2ea2_5ad5_417f_882e_a4ff584b0307.slice/crio-1e599859a2600e612b66a101e402305ddc584d5f30a82ba4b21298382562762b WatchSource:0}: Error finding container 1e599859a2600e612b66a101e402305ddc584d5f30a82ba4b21298382562762b: Status 404 returned error can't find the container with id 1e599859a2600e612b66a101e402305ddc584d5f30a82ba4b21298382562762b
Jul 07 00:31:13.458692 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:13.458646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt" event={"ID":"d59f2ea2-5ad5-417f-882e-a4ff584b0307","Type":"ContainerStarted","Data":"60d8d74e639cb27bb445dfeab52b56b1f0d3064be3b7029f2a07a6e7dd9d8939"}
Jul 07 00:31:13.458896 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:13.458710    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt" event={"ID":"d59f2ea2-5ad5-417f-882e-a4ff584b0307","Type":"ContainerStarted","Data":"1e599859a2600e612b66a101e402305ddc584d5f30a82ba4b21298382562762b"}
Jul 07 00:31:13.458896 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:13.458780    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:13.477310 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:13.477250    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt" podStartSLOduration=1.477232094 podStartE2EDuration="1.477232094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 00:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:31:13.475998375 +0000 UTC m=+2553.083426388" watchObservedRunningTime="2026-07-07 00:31:13.477232094 +0000 UTC m=+2553.084660105"
Jul 07 00:31:14.118510 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:14.118475    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5z9g4_a0a04b79-602d-4281-a091-df937d4bcd99/dns/0.log"
Jul 07 00:31:14.139831 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:14.139803    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5z9g4_a0a04b79-602d-4281-a091-df937d4bcd99/kube-rbac-proxy/0.log"
Jul 07 00:31:14.388187 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:14.388106    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xcw84_28296891-3ba9-42dc-9f47-e0110ddcb960/dns-node-resolver/0.log"
Jul 07 00:31:15.026621 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:15.026583    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-79fgn_757798e0-4584-4a4c-98b5-29850f23a541/node-ca/0.log"
Jul 07 00:31:16.144956 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:16.144930    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dc8c455ff-wj47q_ed16ccfc-b542-433b-84c6-5ac26919538e/kube-auth-proxy/0.log"
Jul 07 00:31:17.021871 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:17.021825    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nn64h_473bd5f7-c628-4b4f-ae13-9ded79dda8c2/serve-healthcheck-canary/0.log"
Jul 07 00:31:17.626172 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:17.626136    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-skjhj_cb232c27-86d3-42c0-83c9-cc03f13fec17/kube-rbac-proxy/0.log"
Jul 07 00:31:17.649327 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:17.649289    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-skjhj_cb232c27-86d3-42c0-83c9-cc03f13fec17/exporter/0.log"
Jul 07 00:31:17.671708 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:17.671641    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-skjhj_cb232c27-86d3-42c0-83c9-cc03f13fec17/extractor/0.log"
Jul 07 00:31:19.473805 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:19.473776    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nrxzw/perf-node-gather-daemonset-wm2xt"
Jul 07 00:31:20.434162 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:20.434134    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dg52h_44ae4a0a-38ad-46fb-80d6-2517a0633c8b/server/0.log"
Jul 07 00:31:20.539353 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:20.539290    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jxg7s_8d92df3b-a79c-4297-8a84-ae2c6ac03154/manager/0.log"
Jul 07 00:31:20.621754 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:20.621717    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bcdcfc745-sn6g6_7ca7948f-f124-4497-9ffe-05d83f0800da/manager/0.log"
Jul 07 00:31:20.644417 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:20.644389    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bcdcfc745-sn6g6_7ca7948f-f124-4497-9ffe-05d83f0800da/copy-manifests/0.log"
Jul 07 00:31:22.273849 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:22.273817    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9d77cc8c4-tglqw_27e50a48-6c05-4b52-b1d9-8750e9c48e6d/manager/0.log"
Jul 07 00:31:22.339080 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:22.339047    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-hv2hr_20d21497-7272-4da5-bb32-e78064dd2b97/openshift-lws-operator/0.log"
Jul 07 00:31:22.774164 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:22.774124    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dc8c455ff-wj47q_ed16ccfc-b542-433b-84c6-5ac26919538e/kube-auth-proxy/0.log"
Jul 07 00:31:24.194293 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:24.194261    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dc8c455ff-wj47q_ed16ccfc-b542-433b-84c6-5ac26919538e/kube-auth-proxy/0.log"
Jul 07 00:31:27.255995 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:27.255951    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-gwkcq_e40ec2e1-7a54-4d1f-9df4-84cbc83edafa/migrator/0.log"
Jul 07 00:31:27.276696 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:27.276662    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-gwkcq_e40ec2e1-7a54-4d1f-9df4-84cbc83edafa/graceful-termination/0.log"
Jul 07 00:31:28.913016 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:28.912941    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms9ns_5caebe6e-6e44-4eee-b28b-ec5a139a61c0/kube-multus-additional-cni-plugins/0.log"
Jul 07 00:31:28.934868 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:28.934834    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms9ns_5caebe6e-6e44-4eee-b28b-ec5a139a61c0/egress-router-binary-copy/0.log"
Jul 07 00:31:28.956041 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:28.956014    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms9ns_5caebe6e-6e44-4eee-b28b-ec5a139a61c0/cni-plugins/0.log"
Jul 07 00:31:28.976957 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:28.976930    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms9ns_5caebe6e-6e44-4eee-b28b-ec5a139a61c0/bond-cni-plugin/0.log"
Jul 07 00:31:28.998441 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:28.998416    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms9ns_5caebe6e-6e44-4eee-b28b-ec5a139a61c0/routeoverride-cni/0.log"
Jul 07 00:31:29.019788 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:29.019759    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms9ns_5caebe6e-6e44-4eee-b28b-ec5a139a61c0/whereabouts-cni-bincopy/0.log"
Jul 07 00:31:29.041444 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:29.041413    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ms9ns_5caebe6e-6e44-4eee-b28b-ec5a139a61c0/whereabouts-cni/0.log"
Jul 07 00:31:29.081482 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:29.081451    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fmxjt_f03b751f-f0aa-4259-b5ca-0b3dafa918ce/kube-multus/0.log"
Jul 07 00:31:29.217931 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:29.217903    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sz2ws_b0393c1e-c38d-42ef-84b7-8961533ec21e/network-metrics-daemon/0.log"
Jul 07 00:31:29.238951 ip-10-0-129-95 kubenswrapper[2582]: I0707 00:31:29.238890    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sz2ws_b0393c1e-c38d-42ef-84b7-8961533ec21e/kube-rbac-proxy/0.log"