Jul 16 12:18:27.318802 ip-10-0-129-10 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 12:18:27.318815 ip-10-0-129-10 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 12:18:27.318867 ip-10-0-129-10 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 12:18:27.319226 ip-10-0-129-10 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 12:18:37.521052 ip-10-0-129-10 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 12:18:37.521071 ip-10-0-129-10 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot cb88b31d198f4425841f0031cb970aa5 --
Jul 16 12:20:34.792799 ip-10-0-129-10 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.158574    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164285    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164304    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164310    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164315    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164319    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164323    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164326    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 12:20:35.240781 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164329    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164332    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164335    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164341    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164344    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164347    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164349    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164352    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164356    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164359    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164363    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164366    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164369    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164371    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164374    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164377    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164382    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164384    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164387    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164390    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 12:20:35.245870 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164392    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164395    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164397    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164400    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164403    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164406    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164409    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164412    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164417    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164420    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164422    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164425    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164427    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164432    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164435    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164440    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164444    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164449    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164451    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164454    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 12:20:35.248032 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164458    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164464    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164467    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164472    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164475    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164478    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164481    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164483    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164486    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164489    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164492    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164494    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164497    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164502    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164505    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164508    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164511    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164513    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164528    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164531    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 12:20:35.249345 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164534    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164537    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164540    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164543    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164546    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164551    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164555    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164559    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164563    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164566    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164570    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164573    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164576    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164579    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164582    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164585    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164591    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164594    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164597    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 12:20:35.250967 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164599    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164602    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164606    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164609    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164612    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164615    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164618    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164621    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164624    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164626    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164631    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164634    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.164637    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165812    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165819    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165823    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165826    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165828    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165832    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 12:20:35.252241 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165834    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165837    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165840    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165843    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165846    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165848    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165854    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165857    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165860    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165863    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165866    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165869    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165872    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165875    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165877    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165880    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165883    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165886    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165892    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165895    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 12:20:35.254770 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165897    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165900    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165903    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165905    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165908    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165911    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165914    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165916    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165919    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165922    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165925    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165931    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165933    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165936    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165940    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165943    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165946    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165948    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165951    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165954    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 12:20:35.256827 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165956    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165959    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165963    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165970    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165973    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165977    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165981    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165985    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165988    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165990    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165993    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.165996    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166000    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166003    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166007    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166012    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166015    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166018    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166021    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 12:20:35.258020 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166024    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166027    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166029    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166032    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166035    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166038    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166040    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166043    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166049    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166054    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166057    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166059    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166062    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166065    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166067    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166070    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166073    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166075    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166079    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 12:20:35.259780 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166082    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166087    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166090    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166093    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166097    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166100    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166103    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166106    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166109    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166112    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166115    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166117    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166121    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166126    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166129    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166758    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166765    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166768    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166771    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166775    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 12:20:35.265423 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166778    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166780    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166783    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166786    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166790    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166794    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166797    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166800    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166803    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166810    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166817    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166821    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166824    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166826    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166830    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166832    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166835    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166838    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166841    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166843    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 12:20:35.266214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166846    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166851    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166855    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166858    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166861    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166863    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166866    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166869    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166872    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166874    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166877    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166880    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166882    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166885    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166890    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166894    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166898    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166901    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166904    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 12:20:35.267051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166907    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166910    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166913    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166917    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166920    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166924    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166927    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166932    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166935    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166938    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166941    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166944    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166946    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166949    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166951    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166955    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166958    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166961    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166963    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166969    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166971    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 12:20:35.268765 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166974    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166977    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166979    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166982    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166985    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166987    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166990    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166992    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166995    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.166998    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167000    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167006    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167009    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167012    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167016    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167019    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167022    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167025    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167027    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 12:20:35.269615 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167031    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167033    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167037    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167042    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167045    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167048    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167050    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167054    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167057    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167060    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167062    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167065    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167068    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167071    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.167073    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167471    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167491    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167500    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167505    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167510    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167513    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 12:20:35.270450 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167530    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167535    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167539    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167542    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167545    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167549    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167552    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167555    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167558    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167561    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167565    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167568    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167573    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167576    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167579    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167583    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167588    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167592    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167597    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167600    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167605    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167608    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167611    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167616    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 12:20:35.271861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167621    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167624    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167631    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167636    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167639    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167642    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167645    2581 flags.go:64] FLAG: --enable-server="true"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167649    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167655    2581 flags.go:64] FLAG: --event-burst="100"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167659    2581 flags.go:64] FLAG: --event-qps="50"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167662    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167665    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167668    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167677    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167680    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167683    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167686    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167689    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167692    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167698    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167701    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167704    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167707    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167710    2581 flags.go:64] FLAG: --feature-gates=""
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167714    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 12:20:35.272923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167717    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167720    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167723    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167726    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167729    2581 flags.go:64] FLAG: --help="false"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167732    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-129-10.ec2.internal"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167735    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167738    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167741    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167744    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167749    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167752    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167755    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167758    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167761    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167764    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167768    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167771    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167774    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167776    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167779    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167782    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167785    2581 flags.go:64] FLAG: --lock-file=""
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167788    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 12:20:35.274444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167791    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167794    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167800    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167804    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167807    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167810    2581 flags.go:64] FLAG: --logging-format="text"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167813    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167824    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167828    2581 flags.go:64] FLAG: --manifest-url=""
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167830    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167835    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167846    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167851    2581 flags.go:64] FLAG: --max-pods="110"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167854    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167857    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167860    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167863    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167866    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167871    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167874    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167883    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167886    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167889    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 12:20:35.275319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167892    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167895    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167900    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167903    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167906    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167909    2581 flags.go:64] FLAG: --port="10250"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167912    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167915    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c0e316cdab1a6329"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167918    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167921    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167924    2581 flags.go:64] FLAG: --register-node="true"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167928    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167933    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167936    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167939    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167942    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167946    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167949    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167952    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167955    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167957    2581 flags.go:64] FLAG: --runonce="false"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167960    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167963    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167966    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167969    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 12:20:35.276661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167972    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167975    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167980    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167983    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167986    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167988    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167991    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167994    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.167997    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168000    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168002    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168008    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168011    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168014    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168018    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168021    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168024    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168027    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168030    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168035    2581 flags.go:64] FLAG: --v="2"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168039    2581 flags.go:64] FLAG: --version="false"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168045    2581 flags.go:64] FLAG: --vmodule=""
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168048    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168052    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168205    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 12:20:35.277540 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168211    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168214    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168217    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168220    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168223    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168227    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168230    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168233    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168236    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168240    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168242    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168245    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168247    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168250    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168253    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168256    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168258    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168261    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168263    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168266    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 12:20:35.279343 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168268    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168271    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168273    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168277    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168281    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168285    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168289    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168292    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168295    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168299    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168302    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168305    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168307    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168310    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168313    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168316    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168318    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168321    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168323    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 12:20:35.280240 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168326    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168329    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168333    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168336    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168338    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168341    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168343    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168346    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168348    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168351    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168353    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168356    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168358    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168361    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168364    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168366    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168369    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168372    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168374    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168379    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 12:20:35.282003 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168381    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168384    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168386    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168390    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168392    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168395    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168398    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168400    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168403    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168405    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168408    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168411    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168414    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168416    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168420    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168423    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168425    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168428    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168431    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168433    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 12:20:35.282858 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168437    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168440    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168443    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168446    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168448    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168451    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168454    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168457    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168460    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168462    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168465    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168469    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168472    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168476    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168478    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168481    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168484    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168487    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 12:20:35.284178 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.168489    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.168967    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.176148    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.176167    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.176187    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.176193    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176248    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176253    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176256    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176259    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176262    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176264    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176267    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176272    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 12:20:35.285044 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176278    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176281    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176284    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176287    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176290    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176293    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176296    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176298    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176301    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176303    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176306    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176309    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176315    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176318    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176321    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176323    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176327    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176330    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176332    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176335    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 12:20:35.286376 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176337    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176340    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176343    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176345    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176348    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176351    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176355    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176358    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176360    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176363    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176365    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176368    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176372    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176375    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176377    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176380    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176382    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176385    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176388    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176390    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 12:20:35.287254 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176393    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176395    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176398    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176401    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176405    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176408    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176410    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176413    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176415    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176419    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176422    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176424    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176427    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176429    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176432    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176435    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176438    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176440    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176443    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176445    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 12:20:35.289463 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176448    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176450    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176453    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176455    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176459    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176462    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176464    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176467    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176469    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176472    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176474    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176477    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176479    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176481    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176484    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176487    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176491    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176493    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176496    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 12:20:35.290356 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176499    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176502    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176504    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176507    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176511    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176514    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176529    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176532    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176535    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176537    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176540    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176542    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.176548    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176680    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 12:20:35.292097 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176686    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176689    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176692    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176696    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176699    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176702    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176705    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176708    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176710    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176713    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176716    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176719    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176721    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176724    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176726    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176729    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176733    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176736    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176738    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 12:20:35.292574 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176741    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176743    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176746    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176749    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176752    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176754    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176756    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176759    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176762    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176764    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176767    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176769    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176771    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176774    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176776    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176779    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176783    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176787    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176790    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176793    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 12:20:35.293409 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176796    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176799    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176802    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176805    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176807    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176810    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176812    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176815    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176817    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176821    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176824    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176826    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176829    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176832    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176834    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176837    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176841    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176843    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176846    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176848    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 12:20:35.294291 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176851    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176853    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176856    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176859    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176861    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176864    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176866    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176870    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176874    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176877    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176880    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176882    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176885    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176887    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176890    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176892    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176896    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176900    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176903    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 12:20:35.401939 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176905    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176908    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176912    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176915    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176918    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176921    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176924    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176926    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176929    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176932    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176935    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176938    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176940    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176942    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176945    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176947    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176950    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176953    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176955    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 12:20:35.403163 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:35.176958    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 12:20:35.404921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.176962    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 12:20:35.404921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.177087    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 12:20:35.404921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.179248    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 12:20:35.404921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.180494    2581 server.go:1019] "Starting client certificate rotation"
Jul 16 12:20:35.404921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.180547    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 12:20:35.404921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.180585    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 12:20:35.404921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.182832    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 12:20:35.404921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.185734    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 12:20:35.404921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.194915    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 16 12:20:35.404921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.212904    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 12:20:35.404921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.234689    2581 log.go:25] "Validated CRI v1 image API"
Jul 16 12:20:35.404921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.236810    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 12:20:35.405342 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.241157    2581 fs.go:135] Filesystem UUIDs: map[3abb6f00-508f-41de-9268-86a8f0512a0a:/dev/nvme0n1p3 4431c879-3438-4e8b-8428-00b4089fe6ae:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 16 12:20:35.405342 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.241176    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.246162    2581 manager.go:216] Machine: {Timestamp:2026-07-16 12:20:35.245132101 +0000 UTC m=+0.349542875 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3113870 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b78969c17982902f2d4468990badb SystemUUID:ec2b7896-9c17-9829-02f2-d4468990badb BootID:cb88b31d-198f-4425-841f-0031cb970aa5 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c1:1e:e2:dc:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c1:1e:e2:dc:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:00:26:e2:6e:3f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.246278    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.246358    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.246852    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ljw87"
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.249200    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.249232    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-10.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.250532    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.250545    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.250552    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.251190    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.255150    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ljw87"
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.256738    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.263144    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.263282    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.263311    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.263322    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 12:20:35.417720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.263339    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.263352    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.263362    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.263773    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.263794    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.267140    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.269388    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.269427    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.269627    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.269644    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.269652    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.269661    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.269672    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.269680    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.270087    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.270095    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.270105    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.270113    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.270125    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.270137    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.270972    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.270986    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.277745    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.280225    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.284188    2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-10.ec2.internal" not found
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.301292    2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-10.ec2.internal" not found
Jul 16 12:20:35.419932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.361215    2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-10.ec2.internal" not found
Jul 16 12:20:35.531610 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.472239    2581 server.go:1268] "Started kubelet"
Jul 16 12:20:35.531610 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.472774    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 12:20:35.531610 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.474929    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 12:20:35.473213 ip-10-0-129-10 systemd[1]: Started Kubernetes Kubelet.
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.619038    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.619155    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.620709    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.623698    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.623702    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:35.623868    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-10.ec2.internal\" not found"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.624448    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.624629    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.624654    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.624851    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.624865    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:35.625816    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.625918    2581 factory.go:55] Registering systemd factory
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.625932    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.626137    2581 factory.go:153] Registering CRI-O factory
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.626151    2581 factory.go:223] Registration of the crio container factory successfully
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.626204    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.626230    2581 factory.go:103] Registering Raw factory
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.626259    2581 manager.go:1196] Started watching for new ooms in manager
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.626551    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.626886    2581 manager.go:349] Starting recovery of all containers
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.635183    2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-10.ec2.internal" not found
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:35.635222    2581 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-129-10.ec2.internal" not found
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.641654    2581 manager.go:354] Recovery completed
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:35.641690    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-10.ec2.internal\" not found" node="ip-10-0-129-10.ec2.internal"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.648270    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.650206    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.650236    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.650247    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientPID"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.650692    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.650700    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.650716    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 12:20:35.653030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.652861    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 12:20:35.654055 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.653593    2581 policy_none.go:49] "None policy: Start"
Jul 16 12:20:35.654055 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.653608    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 12:20:35.654055 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.653625    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 12:20:35.654055 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.653631    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 12:20:35.654055 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.653651    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 12:20:35.654055 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.653660    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientPID"
Jul 16 12:20:35.655053 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:35.654727    2581 policy_none.go:47] "Start"
Jul 16 12:20:37.122443 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:36.995919    2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-10.ec2.internal" not found
Jul 16 12:20:37.122443 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.014131    2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-10.ec2.internal" not found
Jul 16 12:20:37.122443 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.023921    2581 manager.go:337] "Starting Device Plugin manager"
Jul 16 12:20:37.122443 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.023944    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 12:20:37.122443 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.023952    2581 server.go:87] "Starting device plugin registration server"
Jul 16 12:20:37.122443 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.024126    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 12:20:37.122443 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.024146    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 12:20:37.122443 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.024317    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 12:20:37.122443 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.024406    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 12:20:37.122443 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.024415    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 12:20:37.122443 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.024676    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 12:20:37.122443 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.024717    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-10.ec2.internal\" not found"
Jul 16 12:20:37.122443 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.080267    2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-10.ec2.internal" not found
Jul 16 12:20:37.126698 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.124771    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 12:20:37.126698 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.125482    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 12:20:37.126698 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.125506    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 12:20:37.126698 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.125520    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeHasSufficientPID"
Jul 16 12:20:37.126698 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.125547    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.235060 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.134270    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.235060 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.134289    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-10.ec2.internal\": node \"ip-10-0-129-10.ec2.internal\" not found"
Jul 16 12:20:37.405817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.405797    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 12:20:37.406851 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.406832    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 12:20:37.406915 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.406882    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 12:20:37.406915 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.406906    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 12:20:37.406983 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.406943    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 12:20:37.409283 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.409264    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 12:20:37.504289 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.504264    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 12:20:37.504395 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.504371    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 12:20:37.504440 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.504409    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 12:20:37.504440 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.504413    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 12:20:37.506989 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.506971    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"]
Jul 16 12:20:37.509006 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.508988    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.509909 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.509893    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.532843 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.532825    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.536836 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.536824    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.544258 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.544245    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 12:20:37.547246 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.547234    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 12:20:37.585556 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.585510    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 12:15:36 +0000 UTC" deadline="2028-02-07 03:55:59.491341125 +0000 UTC"
Jul 16 12:20:37.585841 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.585552    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13695h35m21.905791491s"
Jul 16 12:20:37.589674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.589651    2581 apiserver.go:52] "Watching apiserver"
Jul 16 12:20:37.595727 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.595711    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 12:20:37.596662 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.596643    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-mw6lt","kube-system/konnectivity-agent-82k62","openshift-dns/node-resolver-g6rpx","openshift-multus/multus-additional-cni-plugins-k2q4w","openshift-multus/multus-scqpj","openshift-multus/network-metrics-daemon-k7jbr","openshift-network-diagnostics/network-check-target-hxfs9","openshift-ovn-kubernetes/ovnkube-node-9v2hh","kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8","openshift-cluster-node-tuning-operator/tuned-gqh7s","openshift-image-registry/node-ca-htnbf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal","openshift-network-operator/iptables-alerter-25j42"]
Jul 16 12:20:37.598423 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.598411    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:37.598472 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.598461    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:20:37.599749 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.599736    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-82k62"
Jul 16 12:20:37.600790 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.600770    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g6rpx"
Jul 16 12:20:37.601814 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.601800    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.601987 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.601971    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 12:20:37.601987 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.601981    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 12:20:37.602095 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.602062    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lnbmq\""
Jul 16 12:20:37.602802 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.602789    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lgbvl\""
Jul 16 12:20:37.602870 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.602805    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 12:20:37.602935 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.602916    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 12:20:37.603063 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.603050    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.603879 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.603866    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 12:20:37.604042 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.604031    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 12:20:37.604269 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.604255    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:37.604331 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.604312    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:20:37.604425 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.604407    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 12:20:37.604565 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.604551    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 12:20:37.604627 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.604573    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 12:20:37.604627 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.604598    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4hfhd\""
Jul 16 12:20:37.604935 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.604923    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 12:20:37.604976 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.604959    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gxd2m\""
Jul 16 12:20:37.605575 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.605561    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:37.605641 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.605622    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:20:37.606871 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.606856    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.608683 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.608667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fce4084c11c4e2c45206a9ce2b0dd5b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal\" (UID: \"fce4084c11c4e2c45206a9ce2b0dd5b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.608751 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.608691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fce4084c11c4e2c45206a9ce2b0dd5b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal\" (UID: \"fce4084c11c4e2c45206a9ce2b0dd5b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.608751 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.608706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0755975f4b2d3e701c655b70a8e50e7d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-10.ec2.internal\" (UID: \"0755975f4b2d3e701c655b70a8e50e7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.608998 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.608980    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 12:20:37.609127 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.609054    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 12:20:37.609127 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.609125    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 12:20:37.609275 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.609257    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 12:20:37.609949 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.609923    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zjbw5\""
Jul 16 12:20:37.610040 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.609978    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 12:20:37.610040 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.609988    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 12:20:37.612202 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.612184    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.613701 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.613687    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.614151 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.614133    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 12:20:37.614275 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.614159    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7zwbh\""
Jul 16 12:20:37.614331 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.614293    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 12:20:37.614420 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.614385    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 12:20:37.614821 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.614809    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-htnbf"
Jul 16 12:20:37.615668 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.615653    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 12:20:37.615794 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.615710    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 12:20:37.615903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.615892    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wzxrr\""
Jul 16 12:20:37.616036 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.616020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-25j42"
Jul 16 12:20:37.616747 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.616735    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 12:20:37.616804 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.616782    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 12:20:37.617142 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.617129    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mmgnz\""
Jul 16 12:20:37.617236 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.617135    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 12:20:37.617967 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.617950    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 12:20:37.618096 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.617991    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 12:20:37.618096 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.618024    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j79v6\""
Jul 16 12:20:37.618096 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.618062    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 12:20:37.649574 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.649561    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 12:20:37.709203 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709185    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-sys-fs\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.709316 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709210    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-var-lib-kubelet\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.709316 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709225    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.709316 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-node-log\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.709448 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709330    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0755975f4b2d3e701c655b70a8e50e7d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-10.ec2.internal\" (UID: \"0755975f4b2d3e701c655b70a8e50e7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.709448 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709385    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.709448 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709399    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0755975f4b2d3e701c655b70a8e50e7d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-10.ec2.internal\" (UID: \"0755975f4b2d3e701c655b70a8e50e7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.709448 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709402    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-device-dir\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.709580 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lskxw\" (UniqueName: \"kubernetes.io/projected/8d8b66dc-eb63-43aa-8627-f34262ddbe36-kube-api-access-lskxw\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.709580 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-kubelet\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.709580 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-etc-openvswitch\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.709580 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709550    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq2fj\" (UniqueName: \"kubernetes.io/projected/d62cac56-91fe-4b15-a7d8-43bb074b9d79-kube-api-access-qq2fj\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.709580 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-socket-dir\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.709712 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709596    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.709712 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.709712 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709659    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-run-netns\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.709712 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709681    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-lib-modules\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.709818 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d8b66dc-eb63-43aa-8627-f34262ddbe36-cni-binary-copy\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.709818 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709737    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-run-netns\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.709818 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-run-systemd\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.709818 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709766    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-log-socket\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.709818 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fce4084c11c4e2c45206a9ce2b0dd5b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal\" (UID: \"fce4084c11c4e2c45206a9ce2b0dd5b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.709953 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709824    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fce4084c11c4e2c45206a9ce2b0dd5b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal\" (UID: \"fce4084c11c4e2c45206a9ce2b0dd5b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.710204 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.709797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-registration-dir\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.710241 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-sysconfig\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.710241 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-kubernetes\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.710299 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710250    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9cb3771-2487-4422-80d4-c4ff92e3bf78-hosts-file\") pod \"node-resolver-g6rpx\" (UID: \"f9cb3771-2487-4422-80d4-c4ff92e3bf78\") " pod="openshift-dns/node-resolver-g6rpx"
Jul 16 12:20:37.710299 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710269    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-system-cni-dir\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.710299 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710284    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-cnibin\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.710415 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710312    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-slash\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.710415 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710335    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-system-cni-dir\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.710415 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-cnibin\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.710415 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmcs4\" (UniqueName: \"kubernetes.io/projected/fe588988-9e5b-45e5-8518-9da0271e9ae0-kube-api-access-fmcs4\") pod \"node-ca-htnbf\" (UID: \"fe588988-9e5b-45e5-8518-9da0271e9ae0\") " pod="openshift-image-registry/node-ca-htnbf"
Jul 16 12:20:37.710561 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9cb3771-2487-4422-80d4-c4ff92e3bf78-tmp-dir\") pod \"node-resolver-g6rpx\" (UID: \"f9cb3771-2487-4422-80d4-c4ff92e3bf78\") " pod="openshift-dns/node-resolver-g6rpx"
Jul 16 12:20:37.710561 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-run-ovn\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.710561 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-cni-bin\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.710561 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d62cac56-91fe-4b15-a7d8-43bb074b9d79-ovn-node-metrics-cert\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.710561 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/906cfebc-03a9-4253-8253-60c451c2f588-iptables-alerter-script\") pod \"iptables-alerter-25j42\" (UID: \"906cfebc-03a9-4253-8253-60c451c2f588\") " pod="openshift-network-operator/iptables-alerter-25j42"
Jul 16 12:20:37.710561 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-multus-socket-dir-parent\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.710561 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-var-lib-cni-multus\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.710561 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710555    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d8b66dc-eb63-43aa-8627-f34262ddbe36-multus-daemon-config\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-run-openvswitch\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-sys\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710631    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-cni-netd\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-tuned\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710658    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-var-lib-openvswitch\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-run-ovn-kubernetes\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d62cac56-91fe-4b15-a7d8-43bb074b9d79-ovnkube-config\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710729    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dffae1ce-4b17-400c-94d7-0656a5753abf-konnectivity-ca\") pod \"konnectivity-agent-82k62\" (UID: \"dffae1ce-4b17-400c-94d7-0656a5753abf\") " pod="kube-system/konnectivity-agent-82k62"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-os-release\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7ddx\" (UniqueName: \"kubernetes.io/projected/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-kube-api-access-f7ddx\") pod \"network-metrics-daemon-k7jbr\" (UID: \"b7d5b95e-f49a-4fcd-ae33-aa4540a18232\") " pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710775    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-sysctl-conf\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-run\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-multus-conf-dir\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.710817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710818    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-etc-kubernetes\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-var-lib-cni-bin\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-modprobe-d\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710868    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-sysctl-d\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710888    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-systemd\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/906cfebc-03a9-4253-8253-60c451c2f588-host-slash\") pod \"iptables-alerter-25j42\" (UID: \"906cfebc-03a9-4253-8253-60c451c2f588\") " pod="openshift-network-operator/iptables-alerter-25j42"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-os-release\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.710987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-var-lib-kubelet\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-run-multus-certs\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-run-k8s-cni-cncf-io\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkrn5\" (UniqueName: \"kubernetes.io/projected/ee691fbe-7789-45aa-a2b5-ac3d223870c4-kube-api-access-qkrn5\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711066    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe588988-9e5b-45e5-8518-9da0271e9ae0-host\") pod \"node-ca-htnbf\" (UID: \"fe588988-9e5b-45e5-8518-9da0271e9ae0\") " pod="openshift-image-registry/node-ca-htnbf"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d62cac56-91fe-4b15-a7d8-43bb074b9d79-env-overrides\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d62cac56-91fe-4b15-a7d8-43bb074b9d79-ovnkube-script-lib\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-multus-cni-dir\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711138    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fce4084c11c4e2c45206a9ce2b0dd5b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal\" (UID: \"fce4084c11c4e2c45206a9ce2b0dd5b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.711383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711153    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7phv\" (UniqueName: \"kubernetes.io/projected/efeb0bda-44b7-4f88-bc52-53f160656a8b-kube-api-access-n7phv\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09aca51a-379f-49af-bb70-476a85243914-kubelet-config\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4zmc\" (UniqueName: \"kubernetes.io/projected/906cfebc-03a9-4253-8253-60c451c2f588-kube-api-access-p4zmc\") pod \"iptables-alerter-25j42\" (UID: \"906cfebc-03a9-4253-8253-60c451c2f588\") " pod="openshift-network-operator/iptables-alerter-25j42"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711201    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fce4084c11c4e2c45206a9ce2b0dd5b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal\" (UID: \"fce4084c11c4e2c45206a9ce2b0dd5b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711221    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm92b\" (UniqueName: \"kubernetes.io/projected/f9cb3771-2487-4422-80d4-c4ff92e3bf78-kube-api-access-cm92b\") pod \"node-resolver-g6rpx\" (UID: \"f9cb3771-2487-4422-80d4-c4ff92e3bf78\") " pod="openshift-dns/node-resolver-g6rpx"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs\") pod \"network-metrics-daemon-k7jbr\" (UID: \"b7d5b95e-f49a-4fcd-ae33-aa4540a18232\") " pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsbjj\" (UniqueName: \"kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj\") pod \"network-check-target-hxfs9\" (UID: \"3b39c802-c316-4ba0-923e-8184cc16f3bf\") " pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711292    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711304    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee691fbe-7789-45aa-a2b5-ac3d223870c4-tmp\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711317    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-hostroot\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-systemd-units\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711413    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dffae1ce-4b17-400c-94d7-0656a5753abf-agent-certs\") pod \"konnectivity-agent-82k62\" (UID: \"dffae1ce-4b17-400c-94d7-0656a5753abf\") " pod="kube-system/konnectivity-agent-82k62"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-host\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09aca51a-379f-49af-bb70-476a85243914-dbus\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe588988-9e5b-45e5-8518-9da0271e9ae0-serviceca\") pod \"node-ca-htnbf\" (UID: \"fe588988-9e5b-45e5-8518-9da0271e9ae0\") " pod="openshift-image-registry/node-ca-htnbf"
Jul 16 12:20:37.711862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.711491    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spf4h\" (UniqueName: \"kubernetes.io/projected/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-kube-api-access-spf4h\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.812072 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d62cac56-91fe-4b15-a7d8-43bb074b9d79-ovnkube-config\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.812151 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dffae1ce-4b17-400c-94d7-0656a5753abf-konnectivity-ca\") pod \"konnectivity-agent-82k62\" (UID: \"dffae1ce-4b17-400c-94d7-0656a5753abf\") " pod="kube-system/konnectivity-agent-82k62"
Jul 16 12:20:37.812151 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-os-release\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.812151 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7ddx\" (UniqueName: \"kubernetes.io/projected/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-kube-api-access-f7ddx\") pod \"network-metrics-daemon-k7jbr\" (UID: \"b7d5b95e-f49a-4fcd-ae33-aa4540a18232\") " pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:37.812151 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-sysctl-conf\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.812151 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-run\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-multus-conf-dir\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812175    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-etc-kubernetes\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-var-lib-cni-bin\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812215    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-os-release\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-modprobe-d\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812242    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-multus-conf-dir\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812260    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-etc-kubernetes\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-sysctl-d\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-sysctl-conf\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812301    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-var-lib-cni-bin\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-systemd\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/906cfebc-03a9-4253-8253-60c451c2f588-host-slash\") pod \"iptables-alerter-25j42\" (UID: \"906cfebc-03a9-4253-8253-60c451c2f588\") " pod="openshift-network-operator/iptables-alerter-25j42"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812344    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-systemd\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812349    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-run\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-os-release\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812401    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/906cfebc-03a9-4253-8253-60c451c2f588-host-slash\") pod \"iptables-alerter-25j42\" (UID: \"906cfebc-03a9-4253-8253-60c451c2f588\") " pod="openshift-network-operator/iptables-alerter-25j42"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812406    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-var-lib-kubelet\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.812416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-run-multus-certs\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812430    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-sysctl-d\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-run-k8s-cni-cncf-io\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-os-release\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkrn5\" (UniqueName: \"kubernetes.io/projected/ee691fbe-7789-45aa-a2b5-ac3d223870c4-kube-api-access-qkrn5\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812487    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-var-lib-kubelet\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe588988-9e5b-45e5-8518-9da0271e9ae0-host\") pod \"node-ca-htnbf\" (UID: \"fe588988-9e5b-45e5-8518-9da0271e9ae0\") " pod="openshift-image-registry/node-ca-htnbf"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812475    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-modprobe-d\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-run-k8s-cni-cncf-io\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812504    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-run-multus-certs\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812561    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe588988-9e5b-45e5-8518-9da0271e9ae0-host\") pod \"node-ca-htnbf\" (UID: \"fe588988-9e5b-45e5-8518-9da0271e9ae0\") " pod="openshift-image-registry/node-ca-htnbf"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d62cac56-91fe-4b15-a7d8-43bb074b9d79-env-overrides\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812648    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d62cac56-91fe-4b15-a7d8-43bb074b9d79-ovnkube-script-lib\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-multus-cni-dir\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812693    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d62cac56-91fe-4b15-a7d8-43bb074b9d79-ovnkube-config\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7phv\" (UniqueName: \"kubernetes.io/projected/efeb0bda-44b7-4f88-bc52-53f160656a8b-kube-api-access-n7phv\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09aca51a-379f-49af-bb70-476a85243914-kubelet-config\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:37.813251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812791    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09aca51a-379f-49af-bb70-476a85243914-kubelet-config\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812847    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4zmc\" (UniqueName: \"kubernetes.io/projected/906cfebc-03a9-4253-8253-60c451c2f588-kube-api-access-p4zmc\") pod \"iptables-alerter-25j42\" (UID: \"906cfebc-03a9-4253-8253-60c451c2f588\") " pod="openshift-network-operator/iptables-alerter-25j42"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-multus-cni-dir\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm92b\" (UniqueName: \"kubernetes.io/projected/f9cb3771-2487-4422-80d4-c4ff92e3bf78-kube-api-access-cm92b\") pod \"node-resolver-g6rpx\" (UID: \"f9cb3771-2487-4422-80d4-c4ff92e3bf78\") " pod="openshift-dns/node-resolver-g6rpx"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs\") pod \"network-metrics-daemon-k7jbr\" (UID: \"b7d5b95e-f49a-4fcd-ae33-aa4540a18232\") " pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbjj\" (UniqueName: \"kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj\") pod \"network-check-target-hxfs9\" (UID: \"3b39c802-c316-4ba0-923e-8184cc16f3bf\") " pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812953    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.812982    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d62cac56-91fe-4b15-a7d8-43bb074b9d79-env-overrides\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.813013    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813041    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee691fbe-7789-45aa-a2b5-ac3d223870c4-tmp\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.813115    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs podName:b7d5b95e-f49a-4fcd-ae33-aa4540a18232 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:38.313095194 +0000 UTC m=+2.093669237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs") pod "network-metrics-daemon-k7jbr" (UID: "b7d5b95e-f49a-4fcd-ae33-aa4540a18232") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813137    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-hostroot\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-systemd-units\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813186    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d62cac56-91fe-4b15-a7d8-43bb074b9d79-ovnkube-script-lib\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813206    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-hostroot\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-systemd-units\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.813903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dffae1ce-4b17-400c-94d7-0656a5753abf-agent-certs\") pod \"konnectivity-agent-82k62\" (UID: \"dffae1ce-4b17-400c-94d7-0656a5753abf\") " pod="kube-system/konnectivity-agent-82k62"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-host\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09aca51a-379f-49af-bb70-476a85243914-dbus\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe588988-9e5b-45e5-8518-9da0271e9ae0-serviceca\") pod \"node-ca-htnbf\" (UID: \"fe588988-9e5b-45e5-8518-9da0271e9ae0\") " pod="openshift-image-registry/node-ca-htnbf"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813325    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813328    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spf4h\" (UniqueName: \"kubernetes.io/projected/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-kube-api-access-spf4h\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813369    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-host\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-sys-fs\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813398    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09aca51a-379f-49af-bb70-476a85243914-dbus\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-var-lib-kubelet\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813447    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-sys-fs\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813410    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dffae1ce-4b17-400c-94d7-0656a5753abf-konnectivity-ca\") pod \"konnectivity-agent-82k62\" (UID: \"dffae1ce-4b17-400c-94d7-0656a5753abf\") " pod="kube-system/konnectivity-agent-82k62"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-node-log\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813463    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-var-lib-kubelet\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.814674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-node-log\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-device-dir\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lskxw\" (UniqueName: \"kubernetes.io/projected/8d8b66dc-eb63-43aa-8627-f34262ddbe36-kube-api-access-lskxw\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813550    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813567    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-kubelet\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-device-dir\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813593    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-etc-openvswitch\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq2fj\" (UniqueName: \"kubernetes.io/projected/d62cac56-91fe-4b15-a7d8-43bb074b9d79-kube-api-access-qq2fj\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813626    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-kubelet\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-socket-dir\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813701    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-etc-openvswitch\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-run-netns\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-lib-modules\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813828    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe588988-9e5b-45e5-8518-9da0271e9ae0-serviceca\") pod \"node-ca-htnbf\" (UID: \"fe588988-9e5b-45e5-8518-9da0271e9ae0\") " pod="openshift-image-registry/node-ca-htnbf"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813844    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d8b66dc-eb63-43aa-8627-f34262ddbe36-cni-binary-copy\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.815408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-socket-dir\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-run-netns\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-run-systemd\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-log-socket\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-run-netns\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813994    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-registration-dir\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.813998    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-run-systemd\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-sysconfig\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814048    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-log-socket\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-kubernetes\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-run-netns\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814079    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/efeb0bda-44b7-4f88-bc52-53f160656a8b-registration-dir\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814109    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-sysconfig\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814120    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-kubernetes\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9cb3771-2487-4422-80d4-c4ff92e3bf78-hosts-file\") pod \"node-resolver-g6rpx\" (UID: \"f9cb3771-2487-4422-80d4-c4ff92e3bf78\") " pod="openshift-dns/node-resolver-g6rpx"
Jul 16 12:20:37.816194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-system-cni-dir\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814164    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-lib-modules\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-cnibin\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814217    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9cb3771-2487-4422-80d4-c4ff92e3bf78-hosts-file\") pod \"node-resolver-g6rpx\" (UID: \"f9cb3771-2487-4422-80d4-c4ff92e3bf78\") " pod="openshift-dns/node-resolver-g6rpx"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814225    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-system-cni-dir\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-slash\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-cnibin\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-system-cni-dir\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814288    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-slash\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-cnibin\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmcs4\" (UniqueName: \"kubernetes.io/projected/fe588988-9e5b-45e5-8518-9da0271e9ae0-kube-api-access-fmcs4\") pod \"node-ca-htnbf\" (UID: \"fe588988-9e5b-45e5-8518-9da0271e9ae0\") " pod="openshift-image-registry/node-ca-htnbf"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814350    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-system-cni-dir\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-cnibin\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9cb3771-2487-4422-80d4-c4ff92e3bf78-tmp-dir\") pod \"node-resolver-g6rpx\" (UID: \"f9cb3771-2487-4422-80d4-c4ff92e3bf78\") " pod="openshift-dns/node-resolver-g6rpx"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-run-ovn\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-cni-bin\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d62cac56-91fe-4b15-a7d8-43bb074b9d79-ovn-node-metrics-cert\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/906cfebc-03a9-4253-8253-60c451c2f588-iptables-alerter-script\") pod \"iptables-alerter-25j42\" (UID: \"906cfebc-03a9-4253-8253-60c451c2f588\") " pod="openshift-network-operator/iptables-alerter-25j42"
Jul 16 12:20:37.817038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-multus-socket-dir-parent\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814537    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-cni-bin\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-var-lib-cni-multus\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814420    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d8b66dc-eb63-43aa-8627-f34262ddbe36-multus-daemon-config\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814583    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-host-var-lib-cni-multus\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814592    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-run-ovn\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-run-openvswitch\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-sys\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814661    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9cb3771-2487-4422-80d4-c4ff92e3bf78-tmp-dir\") pod \"node-resolver-g6rpx\" (UID: \"f9cb3771-2487-4422-80d4-c4ff92e3bf78\") " pod="openshift-dns/node-resolver-g6rpx"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-cni-netd\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814724    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-cni-netd\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814737    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-run-openvswitch\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814736    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d8b66dc-eb63-43aa-8627-f34262ddbe36-cni-binary-copy\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814785    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d8b66dc-eb63-43aa-8627-f34262ddbe36-multus-socket-dir-parent\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.814806    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee691fbe-7789-45aa-a2b5-ac3d223870c4-sys\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.817653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-tuned\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.818148 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.814921    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret podName:09aca51a-379f-49af-bb70-476a85243914 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:38.314890901 +0000 UTC m=+2.095464936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret") pod "global-pull-secret-syncer-mw6lt" (UID: "09aca51a-379f-49af-bb70-476a85243914") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:20:37.818148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.814941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.818148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.815006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-var-lib-openvswitch\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.818148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.815061    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-run-ovn-kubernetes\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.818148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.815132    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/906cfebc-03a9-4253-8253-60c451c2f588-iptables-alerter-script\") pod \"iptables-alerter-25j42\" (UID: \"906cfebc-03a9-4253-8253-60c451c2f588\") " pod="openshift-network-operator/iptables-alerter-25j42"
Jul 16 12:20:37.818148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.815142    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-var-lib-openvswitch\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.818148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.815183    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d8b66dc-eb63-43aa-8627-f34262ddbe36-multus-daemon-config\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.818148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.815199    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d62cac56-91fe-4b15-a7d8-43bb074b9d79-host-run-ovn-kubernetes\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.818148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.815429    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.818148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.816699    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee691fbe-7789-45aa-a2b5-ac3d223870c4-tmp\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.818148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.816749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee691fbe-7789-45aa-a2b5-ac3d223870c4-etc-tuned\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.818148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.816857    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dffae1ce-4b17-400c-94d7-0656a5753abf-agent-certs\") pod \"konnectivity-agent-82k62\" (UID: \"dffae1ce-4b17-400c-94d7-0656a5753abf\") " pod="kube-system/konnectivity-agent-82k62"
Jul 16 12:20:37.818148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.817441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d62cac56-91fe-4b15-a7d8-43bb074b9d79-ovn-node-metrics-cert\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.823539 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.823522    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:20:37.823539 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.823541    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:20:37.823704 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.823549    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jsbjj for pod openshift-network-diagnostics/network-check-target-hxfs9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:20:37.823704 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:37.823590    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj podName:3b39c802-c316-4ba0-923e-8184cc16f3bf nodeName:}" failed. No retries permitted until 2026-07-16 12:20:38.323579323 +0000 UTC m=+2.104153371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jsbjj" (UniqueName: "kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj") pod "network-check-target-hxfs9" (UID: "3b39c802-c316-4ba0-923e-8184cc16f3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:20:37.825120 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.825094    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm92b\" (UniqueName: \"kubernetes.io/projected/f9cb3771-2487-4422-80d4-c4ff92e3bf78-kube-api-access-cm92b\") pod \"node-resolver-g6rpx\" (UID: \"f9cb3771-2487-4422-80d4-c4ff92e3bf78\") " pod="openshift-dns/node-resolver-g6rpx"
Jul 16 12:20:37.826266 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.826242    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4zmc\" (UniqueName: \"kubernetes.io/projected/906cfebc-03a9-4253-8253-60c451c2f588-kube-api-access-p4zmc\") pod \"iptables-alerter-25j42\" (UID: \"906cfebc-03a9-4253-8253-60c451c2f588\") " pod="openshift-network-operator/iptables-alerter-25j42"
Jul 16 12:20:37.826547 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.826528    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lskxw\" (UniqueName: \"kubernetes.io/projected/8d8b66dc-eb63-43aa-8627-f34262ddbe36-kube-api-access-lskxw\") pod \"multus-scqpj\" (UID: \"8d8b66dc-eb63-43aa-8627-f34262ddbe36\") " pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.826687 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.826668    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spf4h\" (UniqueName: \"kubernetes.io/projected/88017837-2cfd-4c0c-98f1-fe5ca6cff0e6-kube-api-access-spf4h\") pod \"multus-additional-cni-plugins-k2q4w\" (UID: \"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6\") " pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.827024 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.827001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7ddx\" (UniqueName: \"kubernetes.io/projected/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-kube-api-access-f7ddx\") pod \"network-metrics-daemon-k7jbr\" (UID: \"b7d5b95e-f49a-4fcd-ae33-aa4540a18232\") " pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:37.827101 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.827075    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7phv\" (UniqueName: \"kubernetes.io/projected/efeb0bda-44b7-4f88-bc52-53f160656a8b-kube-api-access-n7phv\") pod \"aws-ebs-csi-driver-node-gspm8\" (UID: \"efeb0bda-44b7-4f88-bc52-53f160656a8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:37.827284 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.827267    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkrn5\" (UniqueName: \"kubernetes.io/projected/ee691fbe-7789-45aa-a2b5-ac3d223870c4-kube-api-access-qkrn5\") pod \"tuned-gqh7s\" (UID: \"ee691fbe-7789-45aa-a2b5-ac3d223870c4\") " pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:37.828202 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.828182    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq2fj\" (UniqueName: \"kubernetes.io/projected/d62cac56-91fe-4b15-a7d8-43bb074b9d79-kube-api-access-qq2fj\") pod \"ovnkube-node-9v2hh\" (UID: \"d62cac56-91fe-4b15-a7d8-43bb074b9d79\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:37.828624 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.828607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmcs4\" (UniqueName: \"kubernetes.io/projected/fe588988-9e5b-45e5-8518-9da0271e9ae0-kube-api-access-fmcs4\") pod \"node-ca-htnbf\" (UID: \"fe588988-9e5b-45e5-8518-9da0271e9ae0\") " pod="openshift-image-registry/node-ca-htnbf"
Jul 16 12:20:37.847487 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.847473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.851278 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.851263    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal"
Jul 16 12:20:37.936128 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.936082    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-82k62"
Jul 16 12:20:37.948657 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.948642    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 12:20:37.949743 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.949731    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g6rpx"
Jul 16 12:20:37.960824 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.960803    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 12:20:37.963559 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.963544    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k2q4w"
Jul 16 12:20:37.980825 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.980803    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dn4cq"
Jul 16 12:20:37.984981 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.984966    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-scqpj"
Jul 16 12:20:37.989321 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.989308    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dn4cq"
Jul 16 12:20:37.991502 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:37.991488    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:20:38.023911 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.023894    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8"
Jul 16 12:20:38.044395 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.044379    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gqh7s"
Jul 16 12:20:38.055071 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.055053    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-htnbf"
Jul 16 12:20:38.060543 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.060528    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-25j42"
Jul 16 12:20:38.318846 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.318767    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:38.318846 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.318814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs\") pod \"network-metrics-daemon-k7jbr\" (UID: \"b7d5b95e-f49a-4fcd-ae33-aa4540a18232\") " pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:38.319147 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:38.318925    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:20:38.319147 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:38.318931    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:20:38.319147 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:38.318980    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs podName:b7d5b95e-f49a-4fcd-ae33-aa4540a18232 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:39.318967061 +0000 UTC m=+3.099541098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs") pod "network-metrics-daemon-k7jbr" (UID: "b7d5b95e-f49a-4fcd-ae33-aa4540a18232") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:20:38.319147 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:38.318994    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret podName:09aca51a-379f-49af-bb70-476a85243914 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:39.318988203 +0000 UTC m=+3.099562222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret") pod "global-pull-secret-syncer-mw6lt" (UID: "09aca51a-379f-49af-bb70-476a85243914") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:20:38.388066 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:38.388026    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe588988_9e5b_45e5_8518_9da0271e9ae0.slice/crio-7b408447e71ae8ee9b17b01e08c09a3e63beaa2811563861a76477778978ef6c WatchSource:0}: Error finding container 7b408447e71ae8ee9b17b01e08c09a3e63beaa2811563861a76477778978ef6c: Status 404 returned error can't find the container with id 7b408447e71ae8ee9b17b01e08c09a3e63beaa2811563861a76477778978ef6c
Jul 16 12:20:38.388512 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:38.388492    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee691fbe_7789_45aa_a2b5_ac3d223870c4.slice/crio-d6f9ce95290876ac7e1e32e0a5652ce90fb356904b26d8c19b72541a83479517 WatchSource:0}: Error finding container d6f9ce95290876ac7e1e32e0a5652ce90fb356904b26d8c19b72541a83479517: Status 404 returned error can't find the container with id d6f9ce95290876ac7e1e32e0a5652ce90fb356904b26d8c19b72541a83479517
Jul 16 12:20:38.389565 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:38.389549    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d8b66dc_eb63_43aa_8627_f34262ddbe36.slice/crio-0c6e30b76a3965a6c3463937657abbf94dbb378236fc9f3b49ffc39853abcaa9 WatchSource:0}: Error finding container 0c6e30b76a3965a6c3463937657abbf94dbb378236fc9f3b49ffc39853abcaa9: Status 404 returned error can't find the container with id 0c6e30b76a3965a6c3463937657abbf94dbb378236fc9f3b49ffc39853abcaa9
Jul 16 12:20:38.390884 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:38.390866    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0755975f4b2d3e701c655b70a8e50e7d.slice/crio-5350bc36f3a0cf58e5b49f90d607e98019807691870c72d84e865f18fd718d94 WatchSource:0}: Error finding container 5350bc36f3a0cf58e5b49f90d607e98019807691870c72d84e865f18fd718d94: Status 404 returned error can't find the container with id 5350bc36f3a0cf58e5b49f90d607e98019807691870c72d84e865f18fd718d94
Jul 16 12:20:38.394339 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.394322    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:20:38.410518 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.410467    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-htnbf" event={"ID":"fe588988-9e5b-45e5-8518-9da0271e9ae0","Type":"ContainerStarted","Data":"7b408447e71ae8ee9b17b01e08c09a3e63beaa2811563861a76477778978ef6c"}
Jul 16 12:20:38.412223 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.411942    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gqh7s" event={"ID":"ee691fbe-7789-45aa-a2b5-ac3d223870c4","Type":"ContainerStarted","Data":"d6f9ce95290876ac7e1e32e0a5652ce90fb356904b26d8c19b72541a83479517"}
Jul 16 12:20:38.414080 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.414048    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-scqpj" event={"ID":"8d8b66dc-eb63-43aa-8627-f34262ddbe36","Type":"ContainerStarted","Data":"0c6e30b76a3965a6c3463937657abbf94dbb378236fc9f3b49ffc39853abcaa9"}
Jul 16 12:20:38.414998 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.414978    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal" event={"ID":"0755975f4b2d3e701c655b70a8e50e7d","Type":"ContainerStarted","Data":"5350bc36f3a0cf58e5b49f90d607e98019807691870c72d84e865f18fd718d94"}
Jul 16 12:20:38.419087 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.419068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbjj\" (UniqueName: \"kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj\") pod \"network-check-target-hxfs9\" (UID: \"3b39c802-c316-4ba0-923e-8184cc16f3bf\") " pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:38.419183 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:38.419172    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:20:38.419224 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:38.419186    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:20:38.419224 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:38.419195    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jsbjj for pod openshift-network-diagnostics/network-check-target-hxfs9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:20:38.419296 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:38.419238    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj podName:3b39c802-c316-4ba0-923e-8184cc16f3bf nodeName:}" failed. No retries permitted until 2026-07-16 12:20:39.419227113 +0000 UTC m=+3.199801146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jsbjj" (UniqueName: "kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj") pod "network-check-target-hxfs9" (UID: "3b39c802-c316-4ba0-923e-8184cc16f3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:20:38.428349 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:38.428329    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62cac56_91fe_4b15_a7d8_43bb074b9d79.slice/crio-988a2d8a91e2b3c771b7bd39419e9bf2642b2dceca6e894ea5fb89be437e5936 WatchSource:0}: Error finding container 988a2d8a91e2b3c771b7bd39419e9bf2642b2dceca6e894ea5fb89be437e5936: Status 404 returned error can't find the container with id 988a2d8a91e2b3c771b7bd39419e9bf2642b2dceca6e894ea5fb89be437e5936
Jul 16 12:20:38.428941 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:38.428924    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefeb0bda_44b7_4f88_bc52_53f160656a8b.slice/crio-fbe262820da98712582e11b325bbd5c611bf5d3720bca1e14aaf315c75df87fe WatchSource:0}: Error finding container fbe262820da98712582e11b325bbd5c611bf5d3720bca1e14aaf315c75df87fe: Status 404 returned error can't find the container with id fbe262820da98712582e11b325bbd5c611bf5d3720bca1e14aaf315c75df87fe
Jul 16 12:20:38.451968 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:38.451947    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88017837_2cfd_4c0c_98f1_fe5ca6cff0e6.slice/crio-81333e1a06b90846cfb70f61fb1a097bf6bd45386da6719602fefeaa8dcf93e8 WatchSource:0}: Error finding container 81333e1a06b90846cfb70f61fb1a097bf6bd45386da6719602fefeaa8dcf93e8: Status 404 returned error can't find the container with id 81333e1a06b90846cfb70f61fb1a097bf6bd45386da6719602fefeaa8dcf93e8
Jul 16 12:20:38.461166 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:38.461147    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfce4084c11c4e2c45206a9ce2b0dd5b4.slice/crio-0c7efed774ba46c3a3c5227565ec6a89da386348e4ac3f1e3518530586a8cc61 WatchSource:0}: Error finding container 0c7efed774ba46c3a3c5227565ec6a89da386348e4ac3f1e3518530586a8cc61: Status 404 returned error can't find the container with id 0c7efed774ba46c3a3c5227565ec6a89da386348e4ac3f1e3518530586a8cc61
Jul 16 12:20:38.482422 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:38.482404    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddffae1ce_4b17_400c_94d7_0656a5753abf.slice/crio-97a5e60616157be7d8955e677995f8a5e4ff4378e62520e242fcc2c468348b95 WatchSource:0}: Error finding container 97a5e60616157be7d8955e677995f8a5e4ff4378e62520e242fcc2c468348b95: Status 404 returned error can't find the container with id 97a5e60616157be7d8955e677995f8a5e4ff4378e62520e242fcc2c468348b95
Jul 16 12:20:38.697208 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.697178    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 12:20:38.718054 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.718031    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 12:20:38.853191 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.853166    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 12:20:38.991569 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.991491    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 12:15:37 +0000 UTC" deadline="2028-02-21 01:42:56.461613319 +0000 UTC"
Jul 16 12:20:38.991569 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:38.991525    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14029h22m17.470092804s"
Jul 16 12:20:39.270285 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:20:39.270257    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906cfebc_03a9_4253_8253_60c451c2f588.slice/crio-f4ac35f3b10cc1d3fb60b16fc6f70ed7497388b1a9c1eeee8e5687d4496de446 WatchSource:0}: Error finding container f4ac35f3b10cc1d3fb60b16fc6f70ed7497388b1a9c1eeee8e5687d4496de446: Status 404 returned error can't find the container with id f4ac35f3b10cc1d3fb60b16fc6f70ed7497388b1a9c1eeee8e5687d4496de446
Jul 16 12:20:39.326058 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.326032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:39.326184 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.326090    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs\") pod \"network-metrics-daemon-k7jbr\" (UID: \"b7d5b95e-f49a-4fcd-ae33-aa4540a18232\") " pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:39.326248 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:39.326213    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:20:39.326302 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:39.326266    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs podName:b7d5b95e-f49a-4fcd-ae33-aa4540a18232 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:41.326248985 +0000 UTC m=+5.106823012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs") pod "network-metrics-daemon-k7jbr" (UID: "b7d5b95e-f49a-4fcd-ae33-aa4540a18232") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:20:39.326845 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:39.326633    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:20:39.326845 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:39.326683    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret podName:09aca51a-379f-49af-bb70-476a85243914 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:41.326669023 +0000 UTC m=+5.107243058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret") pod "global-pull-secret-syncer-mw6lt" (UID: "09aca51a-379f-49af-bb70-476a85243914") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:20:39.408322 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.407906    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:39.408322 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.407928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:39.408322 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.407917    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:39.408322 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:39.408026    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:20:39.408322 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:39.408086    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:20:39.408322 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:39.408152    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:20:39.426058 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.426001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g6rpx" event={"ID":"f9cb3771-2487-4422-80d4-c4ff92e3bf78","Type":"ContainerStarted","Data":"fa85096283375a7e3587a1c5394583b35f62ca99f644bebddaf2d8d2847f35d4"}
Jul 16 12:20:39.426827 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.426807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbjj\" (UniqueName: \"kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj\") pod \"network-check-target-hxfs9\" (UID: \"3b39c802-c316-4ba0-923e-8184cc16f3bf\") " pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:39.426999 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:39.426977    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:20:39.426999 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:39.427000    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:20:39.427128 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:39.427012    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jsbjj for pod openshift-network-diagnostics/network-check-target-hxfs9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:20:39.427128 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:39.427062    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj podName:3b39c802-c316-4ba0-923e-8184cc16f3bf nodeName:}" failed. No retries permitted until 2026-07-16 12:20:41.427046688 +0000 UTC m=+5.207620711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jsbjj" (UniqueName: "kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj") pod "network-check-target-hxfs9" (UID: "3b39c802-c316-4ba0-923e-8184cc16f3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:20:39.432741 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.432715    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-82k62" event={"ID":"dffae1ce-4b17-400c-94d7-0656a5753abf","Type":"ContainerStarted","Data":"97a5e60616157be7d8955e677995f8a5e4ff4378e62520e242fcc2c468348b95"}
Jul 16 12:20:39.436652 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.436628    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal" event={"ID":"fce4084c11c4e2c45206a9ce2b0dd5b4","Type":"ContainerStarted","Data":"0c7efed774ba46c3a3c5227565ec6a89da386348e4ac3f1e3518530586a8cc61"}
Jul 16 12:20:39.439519 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.439494    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-25j42" event={"ID":"906cfebc-03a9-4253-8253-60c451c2f588","Type":"ContainerStarted","Data":"f4ac35f3b10cc1d3fb60b16fc6f70ed7497388b1a9c1eeee8e5687d4496de446"}
Jul 16 12:20:39.442344 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.442315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2q4w" event={"ID":"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6","Type":"ContainerStarted","Data":"81333e1a06b90846cfb70f61fb1a097bf6bd45386da6719602fefeaa8dcf93e8"}
Jul 16 12:20:39.445583 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.445553    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8" event={"ID":"efeb0bda-44b7-4f88-bc52-53f160656a8b","Type":"ContainerStarted","Data":"fbe262820da98712582e11b325bbd5c611bf5d3720bca1e14aaf315c75df87fe"}
Jul 16 12:20:39.448205 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.448081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh" event={"ID":"d62cac56-91fe-4b15-a7d8-43bb074b9d79","Type":"ContainerStarted","Data":"988a2d8a91e2b3c771b7bd39419e9bf2642b2dceca6e894ea5fb89be437e5936"}
Jul 16 12:20:39.992448 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.992391    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 12:15:37 +0000 UTC" deadline="2028-03-29 03:04:00.642053642 +0000 UTC"
Jul 16 12:20:39.992448 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:39.992425    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14918h43m20.649633064s"
Jul 16 12:20:41.345407 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:41.345374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:41.346068 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:41.345438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs\") pod \"network-metrics-daemon-k7jbr\" (UID: \"b7d5b95e-f49a-4fcd-ae33-aa4540a18232\") " pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:41.346068 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:41.345558    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:20:41.346068 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:41.345608    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs podName:b7d5b95e-f49a-4fcd-ae33-aa4540a18232 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:45.34559151 +0000 UTC m=+9.126165534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs") pod "network-metrics-daemon-k7jbr" (UID: "b7d5b95e-f49a-4fcd-ae33-aa4540a18232") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:20:41.346068 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:41.345633    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:20:41.346068 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:41.345694    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret podName:09aca51a-379f-49af-bb70-476a85243914 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:45.34567697 +0000 UTC m=+9.126250999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret") pod "global-pull-secret-syncer-mw6lt" (UID: "09aca51a-379f-49af-bb70-476a85243914") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:20:41.407863 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:41.407835    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:41.408001 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:41.407960    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:20:41.408309 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:41.408287    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:41.408435 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:41.408415    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:20:41.408558 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:41.408467    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:41.408558 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:41.408530    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:20:41.446667 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:41.446641    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbjj\" (UniqueName: \"kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj\") pod \"network-check-target-hxfs9\" (UID: \"3b39c802-c316-4ba0-923e-8184cc16f3bf\") " pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:41.446829 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:41.446791    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:20:41.446902 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:41.446815    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:20:41.446902 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:41.446845    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jsbjj for pod openshift-network-diagnostics/network-check-target-hxfs9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:20:41.446902 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:41.446898    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj podName:3b39c802-c316-4ba0-923e-8184cc16f3bf nodeName:}" failed. No retries permitted until 2026-07-16 12:20:45.446879352 +0000 UTC m=+9.227453387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jsbjj" (UniqueName: "kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj") pod "network-check-target-hxfs9" (UID: "3b39c802-c316-4ba0-923e-8184cc16f3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:20:43.407808 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:43.407776    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:43.408260 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:43.407913    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:20:43.408260 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:43.407777    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:43.408260 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:43.407964    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:43.408260 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:43.408037    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:20:43.408260 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:43.408111    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:20:45.382055 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:45.381798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:45.382055 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:45.381870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs\") pod \"network-metrics-daemon-k7jbr\" (UID: \"b7d5b95e-f49a-4fcd-ae33-aa4540a18232\") " pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:45.382055 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:45.381926    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:20:45.382055 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:45.381998    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:20:45.382055 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:45.382006    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret podName:09aca51a-379f-49af-bb70-476a85243914 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:53.38198212 +0000 UTC m=+17.162556162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret") pod "global-pull-secret-syncer-mw6lt" (UID: "09aca51a-379f-49af-bb70-476a85243914") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:20:45.382055 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:45.382052    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs podName:b7d5b95e-f49a-4fcd-ae33-aa4540a18232 nodeName:}" failed. No retries permitted until 2026-07-16 12:20:53.382036339 +0000 UTC m=+17.162610361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs") pod "network-metrics-daemon-k7jbr" (UID: "b7d5b95e-f49a-4fcd-ae33-aa4540a18232") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:20:45.408233 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:45.407497    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:45.408233 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:45.407631    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:20:45.408233 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:45.407981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:45.408233 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:45.408088    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:20:45.408233 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:45.408134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:45.408233 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:45.408200    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:20:45.482644 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:45.482598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbjj\" (UniqueName: \"kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj\") pod \"network-check-target-hxfs9\" (UID: \"3b39c802-c316-4ba0-923e-8184cc16f3bf\") " pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:45.482820 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:45.482763    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:20:45.482820 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:45.482784    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:20:45.482820 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:45.482797    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jsbjj for pod openshift-network-diagnostics/network-check-target-hxfs9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:20:45.482983 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:45.482860    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj podName:3b39c802-c316-4ba0-923e-8184cc16f3bf nodeName:}" failed. No retries permitted until 2026-07-16 12:20:53.482838634 +0000 UTC m=+17.263412673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jsbjj" (UniqueName: "kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj") pod "network-check-target-hxfs9" (UID: "3b39c802-c316-4ba0-923e-8184cc16f3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:20:47.411534 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:47.411269    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:47.412040 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:47.411276    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:47.412040 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:47.411635    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:20:47.412040 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:47.411750    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:20:47.412040 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:47.411277    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:47.412040 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:47.411850    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:20:49.407912 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:49.407868    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:49.407912 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:49.407906    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:49.408312 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:49.407885    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:49.408312 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:49.407989    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:20:49.408312 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:49.408046    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:20:49.408312 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:49.408186    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:20:51.407583 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:51.407544    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:51.408060 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:51.407590    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:51.408060 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:51.407542    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:51.408060 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:51.407693    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:20:51.408819 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:51.408278    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:20:51.409042 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:51.409014    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:20:53.407685 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:53.407641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:53.408275 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:53.407795    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:20:53.408275 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:53.407641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:53.408275 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:53.407865    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:53.408275 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:53.407955    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:20:53.408275 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:53.408054    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:20:53.445903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:53.445872    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:53.446087 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:53.445932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs\") pod \"network-metrics-daemon-k7jbr\" (UID: \"b7d5b95e-f49a-4fcd-ae33-aa4540a18232\") " pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:53.446087 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:53.446034    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:20:53.446191 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:53.446101    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret podName:09aca51a-379f-49af-bb70-476a85243914 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:09.446081115 +0000 UTC m=+33.226655159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret") pod "global-pull-secret-syncer-mw6lt" (UID: "09aca51a-379f-49af-bb70-476a85243914") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:20:53.446191 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:53.446035    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:20:53.446191 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:53.446176    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs podName:b7d5b95e-f49a-4fcd-ae33-aa4540a18232 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:09.446162215 +0000 UTC m=+33.226736235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs") pod "network-metrics-daemon-k7jbr" (UID: "b7d5b95e-f49a-4fcd-ae33-aa4540a18232") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:20:53.546239 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:53.546196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbjj\" (UniqueName: \"kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj\") pod \"network-check-target-hxfs9\" (UID: \"3b39c802-c316-4ba0-923e-8184cc16f3bf\") " pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:53.546418 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:53.546351    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:20:53.546418 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:53.546391    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:20:53.546418 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:53.546403    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jsbjj for pod openshift-network-diagnostics/network-check-target-hxfs9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:20:53.546570 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:53.546467    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj podName:3b39c802-c316-4ba0-923e-8184cc16f3bf nodeName:}" failed. No retries permitted until 2026-07-16 12:21:09.546447196 +0000 UTC m=+33.327021236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jsbjj" (UniqueName: "kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj") pod "network-check-target-hxfs9" (UID: "3b39c802-c316-4ba0-923e-8184cc16f3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:20:55.407399 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:55.407349    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:55.407877 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:55.407370    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:55.407877 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:55.407502    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:20:55.407877 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:55.407370    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:55.407877 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:55.407624    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:20:55.407877 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:55.407715    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:20:57.408205 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:57.408185    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:57.408568 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:57.408333    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:57.408568 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:57.408380    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:20:57.408568 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:57.408421    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:20:57.408568 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:57.408449    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:57.408568 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:57.408527    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:20:58.497137 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:58.496647    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal" event={"ID":"0755975f4b2d3e701c655b70a8e50e7d","Type":"ContainerStarted","Data":"242fb61b38304b25971ef0b4470eb70924b09dd542913f0444fc178c19c0dfa2"}
Jul 16 12:20:58.500634 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:58.500519    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh" event={"ID":"d62cac56-91fe-4b15-a7d8-43bb074b9d79","Type":"ContainerStarted","Data":"384f957853ec450e89d14a9ec87df6a2b511277dc49082fd49fa067d4c03e6c8"}
Jul 16 12:20:58.502516 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:58.502481    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gqh7s" event={"ID":"ee691fbe-7789-45aa-a2b5-ac3d223870c4","Type":"ContainerStarted","Data":"8237f2dede0a67740ca5a6b57e1adbaee1783ca9fb9bfbfb8fe68f8a2f088da5"}
Jul 16 12:20:58.505513 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:58.505328    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-scqpj" event={"ID":"8d8b66dc-eb63-43aa-8627-f34262ddbe36","Type":"ContainerStarted","Data":"d7ae08a003da1dfcf2c3612621d83d7bba826a08174e5fe81391f145b5a91b0a"}
Jul 16 12:20:58.518016 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:58.517908    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-10.ec2.internal" podStartSLOduration=21.517821106 podStartE2EDuration="21.517821106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:58.516095272 +0000 UTC m=+22.296669317" watchObservedRunningTime="2026-07-16 12:20:58.517821106 +0000 UTC m=+22.298395152"
Jul 16 12:20:58.536084 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:58.536037    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-scqpj" podStartSLOduration=1.829785571 podStartE2EDuration="21.536021355s" totalImagesPullingTime="19.706235784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:58.535520068 +0000 UTC m=+22.316094111" watchObservedRunningTime="2026-07-16 12:20:58.536021355 +0000 UTC m=+22.316595406"
Jul 16 12:20:58.554986 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:58.554508    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gqh7s" podStartSLOduration=2.016359189 podStartE2EDuration="21.554484524s" totalImagesPullingTime="19.538125335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:58.553132747 +0000 UTC m=+22.333706790" watchObservedRunningTime="2026-07-16 12:20:58.554484524 +0000 UTC m=+22.335058568"
Jul 16 12:20:59.408097 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.407885    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:20:59.408283 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.407959    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:20:59.408283 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:59.408216    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:20:59.408283 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.408002    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:20:59.408463 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:59.408290    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:20:59.408463 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:20:59.408383    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:20:59.508841 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.508809    2581 generic.go:356] "Generic (PLEG): container finished" podID="fce4084c11c4e2c45206a9ce2b0dd5b4" containerID="72dda10558b4a1742e7b9c0414ab4a588798ada37721ba19f426008468611558" exitCode=0
Jul 16 12:20:59.509612 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.508895    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal" event={"ID":"fce4084c11c4e2c45206a9ce2b0dd5b4","Type":"ContainerDied","Data":"72dda10558b4a1742e7b9c0414ab4a588798ada37721ba19f426008468611558"}
Jul 16 12:20:59.510243 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.510215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-htnbf" event={"ID":"fe588988-9e5b-45e5-8518-9da0271e9ae0","Type":"ContainerStarted","Data":"e16eb8100564487c55bf0a0de364bcfb9fb74705d2fca162d16d56efc7af8d5f"}
Jul 16 12:20:59.514106 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.514085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-25j42" event={"ID":"906cfebc-03a9-4253-8253-60c451c2f588","Type":"ContainerStarted","Data":"136cfe602f32deabe79c5aadb5ef64476a41e78abbbf706daef2c3e42d70ac79"}
Jul 16 12:20:59.515455 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.515432    2581 generic.go:356] "Generic (PLEG): container finished" podID="88017837-2cfd-4c0c-98f1-fe5ca6cff0e6" containerID="cd27c79571be759dce1ed4fd7dd651fb3b8474c818aeaca0c94ce21dd5268fa9" exitCode=0
Jul 16 12:20:59.515539 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.515496    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2q4w" event={"ID":"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6","Type":"ContainerDied","Data":"cd27c79571be759dce1ed4fd7dd651fb3b8474c818aeaca0c94ce21dd5268fa9"}
Jul 16 12:20:59.516920 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.516895    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8" event={"ID":"efeb0bda-44b7-4f88-bc52-53f160656a8b","Type":"ContainerStarted","Data":"b3e9e429f1cb86ca95382972581d97ef878e727f2fd3e75b543a874aec6849e2"}
Jul 16 12:20:59.519471 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.519456    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:20:59.519784 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.519765    2581 generic.go:356] "Generic (PLEG): container finished" podID="d62cac56-91fe-4b15-a7d8-43bb074b9d79" containerID="2b670a72824d76ee1984d71bac6d01321e5f34b3a98af0f72b9936eb48e84ee8" exitCode=1
Jul 16 12:20:59.519875 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.519828    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh" event={"ID":"d62cac56-91fe-4b15-a7d8-43bb074b9d79","Type":"ContainerDied","Data":"2b670a72824d76ee1984d71bac6d01321e5f34b3a98af0f72b9936eb48e84ee8"}
Jul 16 12:20:59.519931 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.519888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh" event={"ID":"d62cac56-91fe-4b15-a7d8-43bb074b9d79","Type":"ContainerStarted","Data":"4f36312d7a4e68d04244415f4163bd95d0fb82aa05a3dc6b0f7e8a700630c583"}
Jul 16 12:20:59.519989 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.519933    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh" event={"ID":"d62cac56-91fe-4b15-a7d8-43bb074b9d79","Type":"ContainerStarted","Data":"cc14d6d55e437ab32019456e667a1269cea11b33b9eeea17e0b98648dfd90df8"}
Jul 16 12:20:59.519989 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.519967    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh" event={"ID":"d62cac56-91fe-4b15-a7d8-43bb074b9d79","Type":"ContainerStarted","Data":"8f497fb40588eb6abbd2a234642d14656d60af8374d18d5a56b96627011067c9"}
Jul 16 12:20:59.520087 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.519994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh" event={"ID":"d62cac56-91fe-4b15-a7d8-43bb074b9d79","Type":"ContainerStarted","Data":"25b555ce17fb888c170476016517ad6ad25f9588a231062f8672fd4fb544381d"}
Jul 16 12:20:59.521035 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.521011    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g6rpx" event={"ID":"f9cb3771-2487-4422-80d4-c4ff92e3bf78","Type":"ContainerStarted","Data":"28960e28302349dbf61c414dfa87d6573e8a0965d255daf8af525c097f624218"}
Jul 16 12:20:59.522212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.522189    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-82k62" event={"ID":"dffae1ce-4b17-400c-94d7-0656a5753abf","Type":"ContainerStarted","Data":"f42abe2934bbce2ee99d76aa136c548c48abe5cfd82bed34b077f0ba71449f8b"}
Jul 16 12:20:59.565489 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.565451    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-82k62" podStartSLOduration=2.919569738 podStartE2EDuration="22.565435179s" totalImagesPullingTime="19.645865441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:59.565080392 +0000 UTC m=+23.345654434" watchObservedRunningTime="2026-07-16 12:20:59.565435179 +0000 UTC m=+23.346009221"
Jul 16 12:20:59.584034 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.583989    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-g6rpx" podStartSLOduration=3.8723015480000003 podStartE2EDuration="22.583975174s" totalImagesPullingTime="18.711673626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:59.583959903 +0000 UTC m=+23.364533943" watchObservedRunningTime="2026-07-16 12:20:59.583975174 +0000 UTC m=+23.364549215"
Jul 16 12:20:59.608457 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.608425    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:59.615169 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.615128    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-htnbf" podStartSLOduration=3.107241604 podStartE2EDuration="22.615113878s" totalImagesPullingTime="19.507872274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:59.599459798 +0000 UTC m=+23.380033840" watchObservedRunningTime="2026-07-16 12:20:59.615113878 +0000 UTC m=+23.395687920"
Jul 16 12:20:59.615297 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.615221    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-25j42" podStartSLOduration=3.972440209 podStartE2EDuration="22.615215436s" totalImagesPullingTime="18.642775227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:59.614901041 +0000 UTC m=+23.395475085" watchObservedRunningTime="2026-07-16 12:20:59.615215436 +0000 UTC m=+23.395789522"
Jul 16 12:20:59.735803 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.735770    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:59.825038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.825008    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:59.951705 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.951679    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:59.992630 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:20:59.992608    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 12:21:00.036572 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:00.036478    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T12:20:59.992626603Z","UUID":"75c5731c-cab9-4634-a314-29d5e4f2ac27","Handler":null,"Name":"","Endpoint":""}
Jul 16 12:21:00.039631 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:00.039611    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 12:21:00.039760 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:00.039653    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 12:21:00.048212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:00.048187    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:00.148476 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:00.148437    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:00.527562 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:00.527526    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal" event={"ID":"fce4084c11c4e2c45206a9ce2b0dd5b4","Type":"ContainerStarted","Data":"45b8ace96c301615eb306a9b96414bf9a7f19c35466013efd5b17150b89c86af"}
Jul 16 12:21:00.530118 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:00.530084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8" event={"ID":"efeb0bda-44b7-4f88-bc52-53f160656a8b","Type":"ContainerStarted","Data":"76b2ce49898b02c21d4e24cb70645db3a4d8784d84c0cf8810b77a6ccd00a0c3"}
Jul 16 12:21:00.547489 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:00.547428    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-10.ec2.internal" podStartSLOduration=23.547404055 podStartE2EDuration="23.547404055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:00.547076438 +0000 UTC m=+24.327650481" watchObservedRunningTime="2026-07-16 12:21:00.547404055 +0000 UTC m=+24.327978098"
Jul 16 12:21:00.882144 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:00.882110    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:00.935547 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:00.935513    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-82k62"
Jul 16 12:21:00.936266 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:00.936237    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-82k62"
Jul 16 12:21:01.216892 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.216863    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:01.340899 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.340868    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:01.408042 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.408011    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:01.408216 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.408011    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:01.408216 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:01.408155    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:01.408216 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:01.408183    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:01.408216 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.408015    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:01.408450 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:01.408254    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:01.508755 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.508672    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:01.534540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.534469    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8" event={"ID":"efeb0bda-44b7-4f88-bc52-53f160656a8b","Type":"ContainerStarted","Data":"64647731785d1bcb1f5aa7a57cd3010d733e52bdb96e3b08569b4c466d1166b9"}
Jul 16 12:21:01.537757 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.537733    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:21:01.538205 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.538179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh" event={"ID":"d62cac56-91fe-4b15-a7d8-43bb074b9d79","Type":"ContainerStarted","Data":"f6766ad8ed1eea9461b3684983b5d4251c94e2a2697b159957840a9817bb74ff"}
Jul 16 12:21:01.538551 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.538531    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-82k62"
Jul 16 12:21:01.538879 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.538856    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-82k62"
Jul 16 12:21:01.555375 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.555293    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gspm8" podStartSLOduration=2.679620912 podStartE2EDuration="24.555274317s" totalImagesPullingTime="21.875653405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:01.554812808 +0000 UTC m=+25.335386849" watchObservedRunningTime="2026-07-16 12:21:01.555274317 +0000 UTC m=+25.335848360"
Jul 16 12:21:01.581045 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.581012    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:01.648712 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:01.648676    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:03.095283 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:03.095033    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:03.407342 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:03.407304    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:03.407506 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:03.407304    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:03.407506 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:03.407447    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:03.407606 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:03.407304    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:03.407606 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:03.407531    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:03.407682 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:03.407611    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:03.546649 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:03.546586    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:21:03.547030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:03.546958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh" event={"ID":"d62cac56-91fe-4b15-a7d8-43bb074b9d79","Type":"ContainerStarted","Data":"aec5b6f2abbf169f7ee91c81b26fc5d51553f302ccbd77dcd52de6812991d9fe"}
Jul 16 12:21:03.547759 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:03.547621    2581 scope.go:117] "RemoveContainer" containerID="2b670a72824d76ee1984d71bac6d01321e5f34b3a98af0f72b9936eb48e84ee8"
Jul 16 12:21:03.890798 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:03.890608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:03.962507 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:03.962388    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:04.135452 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.135422    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:04.516928 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.516893    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:04.551349 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.551316    2581 generic.go:356] "Generic (PLEG): container finished" podID="88017837-2cfd-4c0c-98f1-fe5ca6cff0e6" containerID="11ef8ba3512e6c9417799f3e8008d0cf94009e89ec78ed8f15e2f7cb9e7dc41b" exitCode=0
Jul 16 12:21:04.551544 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.551398    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2q4w" event={"ID":"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6","Type":"ContainerDied","Data":"11ef8ba3512e6c9417799f3e8008d0cf94009e89ec78ed8f15e2f7cb9e7dc41b"}
Jul 16 12:21:04.555480 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.555458    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:21:04.555863 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.555837    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh" event={"ID":"d62cac56-91fe-4b15-a7d8-43bb074b9d79","Type":"ContainerStarted","Data":"9836a4878a13da6a88fdf041263e14835579ce38b24436b27900b3d27a176b1f"}
Jul 16 12:21:04.556072 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.556056    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:21:04.556156 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.556141    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:21:04.556224 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.556197    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:21:04.571973 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.571948    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:21:04.574808 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.574790    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:21:04.620992 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.620936    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh" podStartSLOduration=7.736084002 podStartE2EDuration="27.620919102s" totalImagesPullingTime="19.8848351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:04.620317934 +0000 UTC m=+28.400891976" watchObservedRunningTime="2026-07-16 12:21:04.620919102 +0000 UTC m=+28.401493144"
Jul 16 12:21:04.721589 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.721511    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:04.927013 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:04.926934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:05.323657 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:05.323624    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:05.407626 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:05.407589    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:05.407626 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:05.407626    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:05.407845 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:05.407589    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:05.407845 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:05.407733    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:05.407845 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:05.407838    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:05.407965 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:05.407909    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:06.130175 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:06.130135    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:06.260400 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:06.260352    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:06.361322 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:06.361294    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:06.468901 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:06.468808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:06.563008 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:06.562978    2581 generic.go:356] "Generic (PLEG): container finished" podID="88017837-2cfd-4c0c-98f1-fe5ca6cff0e6" containerID="25b645eaf8406506cf88324c7c924c5de2f264d7bfebaa169086c57400c03ed0" exitCode=0
Jul 16 12:21:06.563167 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:06.563060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2q4w" event={"ID":"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6","Type":"ContainerDied","Data":"25b645eaf8406506cf88324c7c924c5de2f264d7bfebaa169086c57400c03ed0"}
Jul 16 12:21:06.590260 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:06.590229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:06.689368 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:06.689338    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:06.750234 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:06.750127    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:06.931278 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:06.931242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:07.408391 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:07.408343    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:07.408847 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:07.408473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:07.408847 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:07.408472    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:07.408847 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:07.408492    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:07.408847 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:07.408567    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:07.408847 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:07.408643    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:07.517849 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:07.517810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:08.117190 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:08.117106    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:08.321166 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:08.321134    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:08.517340 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:08.517307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:08.569315 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:08.569282    2581 generic.go:356] "Generic (PLEG): container finished" podID="88017837-2cfd-4c0c-98f1-fe5ca6cff0e6" containerID="c9e39ef1b9279f63dc061516989d19a8b7353e4091ceeca5f60826d23a1b0b16" exitCode=0
Jul 16 12:21:08.569482 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:08.569342    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2q4w" event={"ID":"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6","Type":"ContainerDied","Data":"c9e39ef1b9279f63dc061516989d19a8b7353e4091ceeca5f60826d23a1b0b16"}
Jul 16 12:21:08.717911 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:08.717884    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:09.186137 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:09.186100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:09.407287 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:09.407256    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:09.407481 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:09.407300    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:09.407481 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:09.407256    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:09.407481 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:09.407420    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:09.407651 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:09.407564    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:09.407717 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:09.407643    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:09.464485 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:09.464409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:09.464485 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:09.464467    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs\") pod \"network-metrics-daemon-k7jbr\" (UID: \"b7d5b95e-f49a-4fcd-ae33-aa4540a18232\") " pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:09.464699 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:09.464555    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 12:21:09.464699 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:09.464595    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:21:09.464699 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:09.464626    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret podName:09aca51a-379f-49af-bb70-476a85243914 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:41.464607224 +0000 UTC m=+65.245181260 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret") pod "global-pull-secret-syncer-mw6lt" (UID: "09aca51a-379f-49af-bb70-476a85243914") : object "kube-system"/"original-pull-secret" not registered
Jul 16 12:21:09.464699 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:09.464655    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs podName:b7d5b95e-f49a-4fcd-ae33-aa4540a18232 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:41.464637257 +0000 UTC m=+65.245211282 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs") pod "network-metrics-daemon-k7jbr" (UID: "b7d5b95e-f49a-4fcd-ae33-aa4540a18232") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 12:21:09.564950 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:09.564907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbjj\" (UniqueName: \"kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj\") pod \"network-check-target-hxfs9\" (UID: \"3b39c802-c316-4ba0-923e-8184cc16f3bf\") " pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:09.565340 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:09.565071    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 12:21:09.565340 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:09.565094    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 12:21:09.565340 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:09.565106    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jsbjj for pod openshift-network-diagnostics/network-check-target-hxfs9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:21:09.565340 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:09.565167    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj podName:3b39c802-c316-4ba0-923e-8184cc16f3bf nodeName:}" failed. No retries permitted until 2026-07-16 12:21:41.565153443 +0000 UTC m=+65.345727462 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jsbjj" (UniqueName: "kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj") pod "network-check-target-hxfs9" (UID: "3b39c802-c316-4ba0-923e-8184cc16f3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 12:21:09.717657 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:09.717569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:10.124961 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:10.124876    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:10.324842 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:10.324804    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:10.531608 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:10.531573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:10.926770 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:10.926736    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:11.411264 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:11.411233    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:11.411463 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:11.411365    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:11.411463 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:11.411380    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:11.411463 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:11.411380    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:11.411625 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:11.411482    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:11.411625 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:11.411584    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:11.734976 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:11.734895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:11.927615 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:11.927571    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:12.328707 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:12.328675    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:12.522348 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:12.522310    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:12.796221 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:12.796193    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:12.896214 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:12.896186    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:12.988662 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:12.988630    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:13.089052 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:13.089016    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:13.280311 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:13.280228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:13.381898 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:13.381871    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:13.408141 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:13.408114    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:13.408141 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:13.408139    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:13.408313 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:13.408118    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:13.408313 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:13.408239    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:13.408437 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:13.408309    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:13.408494 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:13.408422    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:13.445552 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:13.445524    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:13.515954 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:13.515924    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:13.584262 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:13.584190    2581 generic.go:356] "Generic (PLEG): container finished" podID="88017837-2cfd-4c0c-98f1-fe5ca6cff0e6" containerID="a324b8ae9f4d617197952969f8f9204d4af6c2b177240e7beac42199beac9dd3" exitCode=0
Jul 16 12:21:13.584262 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:13.584246    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2q4w" event={"ID":"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6","Type":"ContainerDied","Data":"a324b8ae9f4d617197952969f8f9204d4af6c2b177240e7beac42199beac9dd3"}
Jul 16 12:21:13.674954 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:13.674925    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:13.928433 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:13.928404    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:13.990332 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:13.990306    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:14.591178 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:14.591143    2581 generic.go:356] "Generic (PLEG): container finished" podID="88017837-2cfd-4c0c-98f1-fe5ca6cff0e6" containerID="9849c58c16c8db3dabf63d30bc601527c4f4b81b0d64a9b52348b8fb2ec75e1b" exitCode=0
Jul 16 12:21:14.591350 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:14.591194    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2q4w" event={"ID":"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6","Type":"ContainerDied","Data":"9849c58c16c8db3dabf63d30bc601527c4f4b81b0d64a9b52348b8fb2ec75e1b"}
Jul 16 12:21:15.060860 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:15.060822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:15.117396 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:15.117351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:15.407611 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:15.407576    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:15.407794 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:15.407576    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:15.407794 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:15.407688    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:15.407869 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:15.407791    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:15.407869 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:15.407585    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:15.407928 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:15.407888    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:15.477248 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:15.477201    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:15.535551 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:15.535519    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:15.596470 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:15.596429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2q4w" event={"ID":"88017837-2cfd-4c0c-98f1-fe5ca6cff0e6","Type":"ContainerStarted","Data":"608714fb4b965f4d47b7c507dc9ec84a3e0887e7843d381a746ada6b3b36d310"}
Jul 16 12:21:15.622016 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:15.621969    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k2q4w" podStartSLOduration=8.833245808000001 podStartE2EDuration="38.621954759s" totalImagesPullingTime="29.788708951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:15.621830872 +0000 UTC m=+39.402404915" watchObservedRunningTime="2026-07-16 12:21:15.621954759 +0000 UTC m=+39.402528800"
Jul 16 12:21:17.257803 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:17.257630    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:17.316253 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:17.316224    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:17.407884 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:17.407855    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:17.408036 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:17.407943    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:17.408093 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:17.408031    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:17.408132 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:17.408113    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:17.408202 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:17.408189    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:17.408259 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:17.408246    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:18.964280 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:18.964235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:19.063460 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:19.063433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:19.178333 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:19.178308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:19.407315 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:19.407283    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:19.407315 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:19.407303    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:19.407518 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:19.407289    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:19.407518 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:19.407425    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:19.407588 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:19.407514    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:19.407624 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:19.407603    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:19.625336 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:19.625300    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:21.407859 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:21.407824    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:21.408423 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:21.407829    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:21.408423 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:21.407965    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:21.408423 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:21.407958    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:21.408423 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:21.408031    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:21.408423 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:21.408128    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:21.459829 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:21.459796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:21.514747 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:21.514719    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:22.993088 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:22.993057    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:23.084259 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:23.084229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:23.183177 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:23.183145    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:23.273675 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:23.273610    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:23.407300 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:23.407265    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:23.407490 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:23.407276    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:23.407490 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:23.407405    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:23.407490 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:23.407424    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:23.407646 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:23.407531    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:23.407713 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:23.407685    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:23.617238 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:23.617162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:24.565877 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:24.565837    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mw6lt"]
Jul 16 12:21:24.566687 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:24.565961    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:24.566687 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:24.566073    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:24.568328 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:24.568302    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxfs9"]
Jul 16 12:21:24.568481 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:24.568430    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:24.568566 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:24.568534    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:24.576472 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:24.576443    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k7jbr"]
Jul 16 12:21:24.576625 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:24.576558    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:24.576703 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:24.576681    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:24.905942 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:24.905905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:25.012992 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:25.012965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:26.408130 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:26.408088    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:26.408661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:26.408088    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:26.408661 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:26.408210    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:26.408661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:26.408088    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:26.408661 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:26.408276    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:26.408661 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:26.408388    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:28.407775 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:28.407735    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:28.407775 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:28.407771    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:28.408207 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:28.407853    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:28.408207 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:28.407872    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mw6lt" podUID="09aca51a-379f-49af-bb70-476a85243914"
Jul 16 12:21:28.408207 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:28.407920    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxfs9" podUID="3b39c802-c316-4ba0-923e-8184cc16f3bf"
Jul 16 12:21:28.408207 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:28.408012    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7jbr" podUID="b7d5b95e-f49a-4fcd-ae33-aa4540a18232"
Jul 16 12:21:28.748275 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:28.748064    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:28.827655 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:28.827608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:28.998477 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:28.998409    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-10.ec2.internal" event="NodeReady"
Jul 16 12:21:28.998611 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:28.998527    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 12:21:29.050476 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.050434    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7srpq"]
Jul 16 12:21:29.076349 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.076311    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pnnbx"]
Jul 16 12:21:29.076532 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.076478    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.079011 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.078973    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-drvvw\""
Jul 16 12:21:29.079011 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.079007    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 12:21:29.079385 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.079350    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 12:21:29.092127 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.092099    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7srpq"]
Jul 16 12:21:29.092253 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.092136    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-flrd4"]
Jul 16 12:21:29.092253 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.092230    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pnnbx"
Jul 16 12:21:29.095088 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.095067    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-khcsh\""
Jul 16 12:21:29.095200 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.095066    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 12:21:29.095200 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.095117    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 12:21:29.095200 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.095128    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 12:21:29.110442 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.110416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pnnbx"]
Jul 16 12:21:29.110442 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.110449    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-flrd4"]
Jul 16 12:21:29.110727 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.110553    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.113565 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.113543    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 12:21:29.113565 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.113564    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5tkvf\""
Jul 16 12:21:29.113754 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.113552    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 12:21:29.113754 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.113582    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 12:21:29.113951 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.113937    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 12:21:29.211779 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.211740    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d94d4702-5f0d-45c0-a0a1-cb6a52535262-metrics-tls\") pod \"dns-default-7srpq\" (UID: \"d94d4702-5f0d-45c0-a0a1-cb6a52535262\") " pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.211779 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.211784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6c792c7-1144-48eb-b763-1a907863cdcd-data-volume\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.212006 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.211828    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d94d4702-5f0d-45c0-a0a1-cb6a52535262-config-volume\") pod \"dns-default-7srpq\" (UID: \"d94d4702-5f0d-45c0-a0a1-cb6a52535262\") " pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.212006 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.211852    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d94d4702-5f0d-45c0-a0a1-cb6a52535262-tmp-dir\") pod \"dns-default-7srpq\" (UID: \"d94d4702-5f0d-45c0-a0a1-cb6a52535262\") " pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.212006 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.211874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92bbv\" (UniqueName: \"kubernetes.io/projected/d94d4702-5f0d-45c0-a0a1-cb6a52535262-kube-api-access-92bbv\") pod \"dns-default-7srpq\" (UID: \"d94d4702-5f0d-45c0-a0a1-cb6a52535262\") " pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.212006 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.211969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6c792c7-1144-48eb-b763-1a907863cdcd-crio-socket\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.212006 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.212003    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt2pc\" (UniqueName: \"kubernetes.io/projected/e6c792c7-1144-48eb-b763-1a907863cdcd-kube-api-access-gt2pc\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.212216 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.212070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0313a4b2-2982-4888-b15f-a1f28ef35fda-cert\") pod \"ingress-canary-pnnbx\" (UID: \"0313a4b2-2982-4888-b15f-a1f28ef35fda\") " pod="openshift-ingress-canary/ingress-canary-pnnbx"
Jul 16 12:21:29.212216 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.212089    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlcs8\" (UniqueName: \"kubernetes.io/projected/0313a4b2-2982-4888-b15f-a1f28ef35fda-kube-api-access-qlcs8\") pod \"ingress-canary-pnnbx\" (UID: \"0313a4b2-2982-4888-b15f-a1f28ef35fda\") " pod="openshift-ingress-canary/ingress-canary-pnnbx"
Jul 16 12:21:29.212216 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.212105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6c792c7-1144-48eb-b763-1a907863cdcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.212216 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.212175    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6c792c7-1144-48eb-b763-1a907863cdcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.227760 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.227731    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:29.313473 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.313310    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0313a4b2-2982-4888-b15f-a1f28ef35fda-cert\") pod \"ingress-canary-pnnbx\" (UID: \"0313a4b2-2982-4888-b15f-a1f28ef35fda\") " pod="openshift-ingress-canary/ingress-canary-pnnbx"
Jul 16 12:21:29.313473 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.313379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlcs8\" (UniqueName: \"kubernetes.io/projected/0313a4b2-2982-4888-b15f-a1f28ef35fda-kube-api-access-qlcs8\") pod \"ingress-canary-pnnbx\" (UID: \"0313a4b2-2982-4888-b15f-a1f28ef35fda\") " pod="openshift-ingress-canary/ingress-canary-pnnbx"
Jul 16 12:21:29.313473 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.313407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6c792c7-1144-48eb-b763-1a907863cdcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.313473 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.313431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6c792c7-1144-48eb-b763-1a907863cdcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.313473 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.313462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d94d4702-5f0d-45c0-a0a1-cb6a52535262-metrics-tls\") pod \"dns-default-7srpq\" (UID: \"d94d4702-5f0d-45c0-a0a1-cb6a52535262\") " pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.313833 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.313488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6c792c7-1144-48eb-b763-1a907863cdcd-data-volume\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.313833 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.313519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d94d4702-5f0d-45c0-a0a1-cb6a52535262-config-volume\") pod \"dns-default-7srpq\" (UID: \"d94d4702-5f0d-45c0-a0a1-cb6a52535262\") " pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.313833 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.313539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d94d4702-5f0d-45c0-a0a1-cb6a52535262-tmp-dir\") pod \"dns-default-7srpq\" (UID: \"d94d4702-5f0d-45c0-a0a1-cb6a52535262\") " pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.313833 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.313559    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92bbv\" (UniqueName: \"kubernetes.io/projected/d94d4702-5f0d-45c0-a0a1-cb6a52535262-kube-api-access-92bbv\") pod \"dns-default-7srpq\" (UID: \"d94d4702-5f0d-45c0-a0a1-cb6a52535262\") " pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.313833 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.313601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6c792c7-1144-48eb-b763-1a907863cdcd-crio-socket\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.313833 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.313626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt2pc\" (UniqueName: \"kubernetes.io/projected/e6c792c7-1144-48eb-b763-1a907863cdcd-kube-api-access-gt2pc\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.314192 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.314060    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6c792c7-1144-48eb-b763-1a907863cdcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.314192 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.314088    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d94d4702-5f0d-45c0-a0a1-cb6a52535262-config-volume\") pod \"dns-default-7srpq\" (UID: \"d94d4702-5f0d-45c0-a0a1-cb6a52535262\") " pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.314192 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.314104    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6c792c7-1144-48eb-b763-1a907863cdcd-crio-socket\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.314192 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.314117    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d94d4702-5f0d-45c0-a0a1-cb6a52535262-tmp-dir\") pod \"dns-default-7srpq\" (UID: \"d94d4702-5f0d-45c0-a0a1-cb6a52535262\") " pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.314408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.314388    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6c792c7-1144-48eb-b763-1a907863cdcd-data-volume\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.317402 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.317378    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d94d4702-5f0d-45c0-a0a1-cb6a52535262-metrics-tls\") pod \"dns-default-7srpq\" (UID: \"d94d4702-5f0d-45c0-a0a1-cb6a52535262\") " pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.317517 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.317441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6c792c7-1144-48eb-b763-1a907863cdcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.317581 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.317527    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0313a4b2-2982-4888-b15f-a1f28ef35fda-cert\") pod \"ingress-canary-pnnbx\" (UID: \"0313a4b2-2982-4888-b15f-a1f28ef35fda\") " pod="openshift-ingress-canary/ingress-canary-pnnbx"
Jul 16 12:21:29.322141 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.322112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt2pc\" (UniqueName: \"kubernetes.io/projected/e6c792c7-1144-48eb-b763-1a907863cdcd-kube-api-access-gt2pc\") pod \"insights-runtime-extractor-flrd4\" (UID: \"e6c792c7-1144-48eb-b763-1a907863cdcd\") " pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.322286 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.322261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92bbv\" (UniqueName: \"kubernetes.io/projected/d94d4702-5f0d-45c0-a0a1-cb6a52535262-kube-api-access-92bbv\") pod \"dns-default-7srpq\" (UID: \"d94d4702-5f0d-45c0-a0a1-cb6a52535262\") " pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.323336 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.323317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlcs8\" (UniqueName: \"kubernetes.io/projected/0313a4b2-2982-4888-b15f-a1f28ef35fda-kube-api-access-qlcs8\") pod \"ingress-canary-pnnbx\" (UID: \"0313a4b2-2982-4888-b15f-a1f28ef35fda\") " pod="openshift-ingress-canary/ingress-canary-pnnbx"
Jul 16 12:21:29.334681 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.334629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:29.386858 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.386827    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:29.401870 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.401842    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pnnbx"
Jul 16 12:21:29.419106 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.419083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-flrd4"
Jul 16 12:21:29.583406 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.583313    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pnnbx"]
Jul 16 12:21:29.587996 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:21:29.587968    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0313a4b2_2982_4888_b15f_a1f28ef35fda.slice/crio-f54edcc86e3cd44d5799fcc6323ade3c229263e9a3bc4f7b10437f98c54980b3 WatchSource:0}: Error finding container f54edcc86e3cd44d5799fcc6323ade3c229263e9a3bc4f7b10437f98c54980b3: Status 404 returned error can't find the container with id f54edcc86e3cd44d5799fcc6323ade3c229263e9a3bc4f7b10437f98c54980b3
Jul 16 12:21:29.597299 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.597278    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7srpq"]
Jul 16 12:21:29.601178 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.601157    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-flrd4"]
Jul 16 12:21:29.601869 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:21:29.601842    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94d4702_5f0d_45c0_a0a1_cb6a52535262.slice/crio-8dca84878b68677d7a20a33461af13855545ef56a2e63f4680d91bbf23bef877 WatchSource:0}: Error finding container 8dca84878b68677d7a20a33461af13855545ef56a2e63f4680d91bbf23bef877: Status 404 returned error can't find the container with id 8dca84878b68677d7a20a33461af13855545ef56a2e63f4680d91bbf23bef877
Jul 16 12:21:29.604096 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:21:29.604078    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c792c7_1144_48eb_b763_1a907863cdcd.slice/crio-4182791aa811cc7322a9ca010a138c81d3869c21eb96c3e1c8c7e9c1fbb7574b WatchSource:0}: Error finding container 4182791aa811cc7322a9ca010a138c81d3869c21eb96c3e1c8c7e9c1fbb7574b: Status 404 returned error can't find the container with id 4182791aa811cc7322a9ca010a138c81d3869c21eb96c3e1c8c7e9c1fbb7574b
Jul 16 12:21:29.628169 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.628132    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flrd4" event={"ID":"e6c792c7-1144-48eb-b763-1a907863cdcd","Type":"ContainerStarted","Data":"4182791aa811cc7322a9ca010a138c81d3869c21eb96c3e1c8c7e9c1fbb7574b"}
Jul 16 12:21:29.629206 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.629184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pnnbx" event={"ID":"0313a4b2-2982-4888-b15f-a1f28ef35fda","Type":"ContainerStarted","Data":"f54edcc86e3cd44d5799fcc6323ade3c229263e9a3bc4f7b10437f98c54980b3"}
Jul 16 12:21:29.630167 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:29.630148    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7srpq" event={"ID":"d94d4702-5f0d-45c0-a0a1-cb6a52535262","Type":"ContainerStarted","Data":"8dca84878b68677d7a20a33461af13855545ef56a2e63f4680d91bbf23bef877"}
Jul 16 12:21:30.407317 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.407271    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:30.408895 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.407753    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:30.408895 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.408175    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:30.413021 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.412339    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 12:21:30.413021 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.412522    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qp65q\""
Jul 16 12:21:30.413021 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.412684    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 12:21:30.413021 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.412712    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 12:21:30.413021 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.412879    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6rr4c\""
Jul 16 12:21:30.413021 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.412932    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 12:21:30.737613 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.737528    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:30.755738 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.755703    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66cb9dfc5-qvshf"]
Jul 16 12:21:30.759025 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.757801    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.761439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.760807    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 12:21:30.761439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.761060    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 12:21:30.761439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.761253    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 12:21:30.761439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.761258    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 12:21:30.762497 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.762263    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 12:21:30.762497 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.762445    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 12:21:30.764401 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.762502    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 12:21:30.764838 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.764702    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-snwwc\""
Jul 16 12:21:30.768970 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.768950    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 16 12:21:30.771166 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.771128    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66cb9dfc5-qvshf"]
Jul 16 12:21:30.805137 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.805104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:30.828702 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.828661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-trusted-ca-bundle\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.828884 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.828721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f666a519-c2c3-4b2a-9378-4d981947936b-console-serving-cert\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.828884 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.828803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-oauth-serving-cert\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.828884 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.828829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl977\" (UniqueName: \"kubernetes.io/projected/f666a519-c2c3-4b2a-9378-4d981947936b-kube-api-access-jl977\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.828884 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.828861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f666a519-c2c3-4b2a-9378-4d981947936b-console-oauth-config\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.829082 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.828895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-service-ca\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.829082 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.828992    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-console-config\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.929452 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.929413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-trusted-ca-bundle\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.929656 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.929469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f666a519-c2c3-4b2a-9378-4d981947936b-console-serving-cert\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.929656 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.929629    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-oauth-serving-cert\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.929656 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.929652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl977\" (UniqueName: \"kubernetes.io/projected/f666a519-c2c3-4b2a-9378-4d981947936b-kube-api-access-jl977\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.929826 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.929672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f666a519-c2c3-4b2a-9378-4d981947936b-console-oauth-config\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.929826 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.929695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-service-ca\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.929826 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.929742    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-console-config\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.930425 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.930352    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-oauth-serving-cert\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.930425 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.930403    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-console-config\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.930605 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.930454    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-trusted-ca-bundle\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.930736 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.930712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-service-ca\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.936809 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.936755    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f666a519-c2c3-4b2a-9378-4d981947936b-console-oauth-config\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.936953 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.936822    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f666a519-c2c3-4b2a-9378-4d981947936b-console-serving-cert\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:30.941780 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:30.941749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl977\" (UniqueName: \"kubernetes.io/projected/f666a519-c2c3-4b2a-9378-4d981947936b-kube-api-access-jl977\") pod \"console-66cb9dfc5-qvshf\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") " pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:31.071782 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:31.071678    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:31.247045 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:31.246826    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66cb9dfc5-qvshf"]
Jul 16 12:21:31.725395 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:21:31.725337    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf666a519_c2c3_4b2a_9378_4d981947936b.slice/crio-a4f39e5ca217a7f495861c8751d31c9a4c2c407c604669c2f581a637dc7c9da9 WatchSource:0}: Error finding container a4f39e5ca217a7f495861c8751d31c9a4c2c407c604669c2f581a637dc7c9da9: Status 404 returned error can't find the container with id a4f39e5ca217a7f495861c8751d31c9a4c2c407c604669c2f581a637dc7c9da9
Jul 16 12:21:32.639951 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:32.639915    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cb9dfc5-qvshf" event={"ID":"f666a519-c2c3-4b2a-9378-4d981947936b","Type":"ContainerStarted","Data":"a4f39e5ca217a7f495861c8751d31c9a4c2c407c604669c2f581a637dc7c9da9"}
Jul 16 12:21:32.888043 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:32.888005    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:32.950521 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:32.950436    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:34.604258 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:34.604219    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:34.704199 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:34.704164    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:35.183474 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.183402    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:35.235521 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.235481    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-cxcpk"]
Jul 16 12:21:35.237806 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.237772    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:35.241518 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.241447    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 16 12:21:35.241846 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.241823    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 12:21:35.242741 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.242509    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-22cx2\""
Jul 16 12:21:35.242741 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.242546    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 16 12:21:35.243552 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.243410    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 12:21:35.243552 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.243455    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 12:21:35.248574 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.248422    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-cxcpk"]
Jul 16 12:21:35.257941 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.257905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:35.367432 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.367346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cded6c1-c905-4edd-9436-c97e20f18158-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:35.367594 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.367520    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cded6c1-c905-4edd-9436-c97e20f18158-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:35.367594 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.367555    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cded6c1-c905-4edd-9436-c97e20f18158-metrics-client-ca\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:35.367594 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.367587    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfnrs\" (UniqueName: \"kubernetes.io/projected/3cded6c1-c905-4edd-9436-c97e20f18158-kube-api-access-jfnrs\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:35.422118 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.422009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:35.469515 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.468572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cded6c1-c905-4edd-9436-c97e20f18158-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:35.469515 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.468622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cded6c1-c905-4edd-9436-c97e20f18158-metrics-client-ca\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:35.469515 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.468660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnrs\" (UniqueName: \"kubernetes.io/projected/3cded6c1-c905-4edd-9436-c97e20f18158-kube-api-access-jfnrs\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:35.469515 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.468720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cded6c1-c905-4edd-9436-c97e20f18158-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:35.469515 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:35.468890    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 16 12:21:35.469515 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:35.468949    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cded6c1-c905-4edd-9436-c97e20f18158-prometheus-operator-tls podName:3cded6c1-c905-4edd-9436-c97e20f18158 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:35.968931123 +0000 UTC m=+59.749505147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/3cded6c1-c905-4edd-9436-c97e20f18158-prometheus-operator-tls") pod "prometheus-operator-64785b6675-cxcpk" (UID: "3cded6c1-c905-4edd-9436-c97e20f18158") : secret "prometheus-operator-tls" not found
Jul 16 12:21:35.470568 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.470196    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cded6c1-c905-4edd-9436-c97e20f18158-metrics-client-ca\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:35.472372 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.472301    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cded6c1-c905-4edd-9436-c97e20f18158-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:35.478499 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.478440    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfnrs\" (UniqueName: \"kubernetes.io/projected/3cded6c1-c905-4edd-9436-c97e20f18158-kube-api-access-jfnrs\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:35.519264 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.519199    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:35.650560 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.650527    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flrd4" event={"ID":"e6c792c7-1144-48eb-b763-1a907863cdcd","Type":"ContainerStarted","Data":"0142e82ea9b04a9bab1a001cf0dfd8549287a3d2aac5ad5f11295ee9fec777fc"}
Jul 16 12:21:35.652647 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.652563    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7srpq" event={"ID":"d94d4702-5f0d-45c0-a0a1-cb6a52535262","Type":"ContainerStarted","Data":"2fc3d464e2ae38095ace5fe024a666f1428bf2bd91c061a103c36cd44ad7a435"}
Jul 16 12:21:35.652647 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.652614    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7srpq" event={"ID":"d94d4702-5f0d-45c0-a0a1-cb6a52535262","Type":"ContainerStarted","Data":"9625df1ece7f0ff9bed6545c41c58b4cdf4f97a6fd0ea62580ae402c92b52215"}
Jul 16 12:21:35.652844 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.652676    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:35.654323 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.654300    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pnnbx" event={"ID":"0313a4b2-2982-4888-b15f-a1f28ef35fda","Type":"ContainerStarted","Data":"c353669fd7ffc1fbf1410522b247c72c7d5799e306470627cdfb1fe1f07554b5"}
Jul 16 12:21:35.684224 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.684166    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7srpq" podStartSLOduration=0.995463786 podStartE2EDuration="6.684118933s" totalImagesPullingTime="5.688655147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:35.682878327 +0000 UTC m=+59.463452369" watchObservedRunningTime="2026-07-16 12:21:35.684118933 +0000 UTC m=+59.464692974"
Jul 16 12:21:35.713872 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.713801    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pnnbx" podStartSLOduration=1.011087569 podStartE2EDuration="6.713776791s" totalImagesPullingTime="5.702689222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:35.712939118 +0000 UTC m=+59.493513165" watchObservedRunningTime="2026-07-16 12:21:35.713776791 +0000 UTC m=+59.494350835"
Jul 16 12:21:35.974143 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:35.974102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cded6c1-c905-4edd-9436-c97e20f18158-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:35.974338 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:35.974256    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 16 12:21:35.974338 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:35.974331    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cded6c1-c905-4edd-9436-c97e20f18158-prometheus-operator-tls podName:3cded6c1-c905-4edd-9436-c97e20f18158 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:36.97430891 +0000 UTC m=+60.754882945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/3cded6c1-c905-4edd-9436-c97e20f18158-prometheus-operator-tls") pod "prometheus-operator-64785b6675-cxcpk" (UID: "3cded6c1-c905-4edd-9436-c97e20f18158") : secret "prometheus-operator-tls" not found
Jul 16 12:21:36.384009 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:36.383971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:36.443894 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:36.443853    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:36.579941 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:36.579908    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9v2hh"
Jul 16 12:21:36.743154 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:36.743068    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:36.799494 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:36.799459    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:36.983215 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:36.983183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cded6c1-c905-4edd-9436-c97e20f18158-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:36.985622 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:36.985590    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cded6c1-c905-4edd-9436-c97e20f18158-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-cxcpk\" (UID: \"3cded6c1-c905-4edd-9436-c97e20f18158\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:37.055873 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:37.055795    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-22cx2\""
Jul 16 12:21:37.064257 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:37.064227    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk"
Jul 16 12:21:37.227300 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:37.227266    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-cxcpk"]
Jul 16 12:21:37.382007 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:21:37.381766    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cded6c1_c905_4edd_9436_c97e20f18158.slice/crio-8d08952b01f3eda63ed4001830377811fe119e9efcdc649b660f090a7ff9134e WatchSource:0}: Error finding container 8d08952b01f3eda63ed4001830377811fe119e9efcdc649b660f090a7ff9134e: Status 404 returned error can't find the container with id 8d08952b01f3eda63ed4001830377811fe119e9efcdc649b660f090a7ff9134e
Jul 16 12:21:37.662700 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:37.662611    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk" event={"ID":"3cded6c1-c905-4edd-9436-c97e20f18158","Type":"ContainerStarted","Data":"8d08952b01f3eda63ed4001830377811fe119e9efcdc649b660f090a7ff9134e"}
Jul 16 12:21:37.664663 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:37.664630    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cb9dfc5-qvshf" event={"ID":"f666a519-c2c3-4b2a-9378-4d981947936b","Type":"ContainerStarted","Data":"ffe771e789dd8e2f867d527a2a2168e7e6e17937793a193da1c1db7e43faa2a0"}
Jul 16 12:21:37.686133 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:37.685963    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66cb9dfc5-qvshf" podStartSLOduration=2.004142345 podStartE2EDuration="7.685941816s" totalImagesPullingTime="5.681799471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:37.685912199 +0000 UTC m=+61.466486242" watchObservedRunningTime="2026-07-16 12:21:37.685941816 +0000 UTC m=+61.466515859"
Jul 16 12:21:38.912120 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:38.912063    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:39.485444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:39.485405    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:39.546613 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:39.546573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:41.063882 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.063792    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:41.072778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.072756    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:41.072903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.072808    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:41.077896 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.077873    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:41.522224 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.522179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:41.522450 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.522248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs\") pod \"network-metrics-daemon-k7jbr\" (UID: \"b7d5b95e-f49a-4fcd-ae33-aa4540a18232\") " pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:41.525051 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.524988    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 12:21:41.525051 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.525022    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 12:21:41.535740 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.535710    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09aca51a-379f-49af-bb70-476a85243914-original-pull-secret\") pod \"global-pull-secret-syncer-mw6lt\" (UID: \"09aca51a-379f-49af-bb70-476a85243914\") " pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:41.535872 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.535788    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7d5b95e-f49a-4fcd-ae33-aa4540a18232-metrics-certs\") pod \"network-metrics-daemon-k7jbr\" (UID: \"b7d5b95e-f49a-4fcd-ae33-aa4540a18232\") " pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:41.542822 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.542794    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mw6lt"
Jul 16 12:21:41.553167 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.553126    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6rr4c\""
Jul 16 12:21:41.561879 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.561854    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7jbr"
Jul 16 12:21:41.624928 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.623655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbjj\" (UniqueName: \"kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj\") pod \"network-check-target-hxfs9\" (UID: \"3b39c802-c316-4ba0-923e-8184cc16f3bf\") " pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:41.626483 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.626451    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 12:21:41.637343 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.637315    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 12:21:41.649012 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.648949    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsbjj\" (UniqueName: \"kubernetes.io/projected/3b39c802-c316-4ba0-923e-8184cc16f3bf-kube-api-access-jsbjj\") pod \"network-check-target-hxfs9\" (UID: \"3b39c802-c316-4ba0-923e-8184cc16f3bf\") " pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:41.682058 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.682014    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flrd4" event={"ID":"e6c792c7-1144-48eb-b763-1a907863cdcd","Type":"ContainerStarted","Data":"5b0afca87faec9e4616fd52ad315a5cfd69b7fe44297f24aabd77797c9910f10"}
Jul 16 12:21:41.685306 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.685198    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk" event={"ID":"3cded6c1-c905-4edd-9436-c97e20f18158","Type":"ContainerStarted","Data":"2d09aebae0554f29c69fa171070f596044bd3c16ee1e47adc83ce6be5d67aafe"}
Jul 16 12:21:41.685306 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.685272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk" event={"ID":"3cded6c1-c905-4edd-9436-c97e20f18158","Type":"ContainerStarted","Data":"c3ea4d3a39f95bc78866695fd6079e67424164143c4363447b07440a3ac25013"}
Jul 16 12:21:41.696698 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.696627    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:21:41.699756 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.699727    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mw6lt"]
Jul 16 12:21:41.702420 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:21:41.702392    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09aca51a_379f_49af_bb70_476a85243914.slice/crio-78ac2840fe2b4668c2f73e9ef6285c9a0cb06a000e1397555840d6ac99f7da56 WatchSource:0}: Error finding container 78ac2840fe2b4668c2f73e9ef6285c9a0cb06a000e1397555840d6ac99f7da56: Status 404 returned error can't find the container with id 78ac2840fe2b4668c2f73e9ef6285c9a0cb06a000e1397555840d6ac99f7da56
Jul 16 12:21:41.704351 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.704294    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-cxcpk" podStartSLOduration=3.343984388 podStartE2EDuration="6.704275721s" totalImagesPullingTime="3.360291333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:41.70348242 +0000 UTC m=+65.484056462" watchObservedRunningTime="2026-07-16 12:21:41.704275721 +0000 UTC m=+65.484849764"
Jul 16 12:21:41.728170 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.728049    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k7jbr"]
Jul 16 12:21:41.731953 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:21:41.731918    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d5b95e_f49a_4fcd_ae33_aa4540a18232.slice/crio-ce260ffda005002c7916bc13325cff759fc08d1be1893e780da9320896a31d98 WatchSource:0}: Error finding container ce260ffda005002c7916bc13325cff759fc08d1be1893e780da9320896a31d98: Status 404 returned error can't find the container with id ce260ffda005002c7916bc13325cff759fc08d1be1893e780da9320896a31d98
Jul 16 12:21:41.825549 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.825467    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qp65q\""
Jul 16 12:21:41.833459 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.833431    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:41.864077 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.864021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:41.982401 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:41.982180    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxfs9"]
Jul 16 12:21:41.986214 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:21:41.986182    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b39c802_c316_4ba0_923e_8184cc16f3bf.slice/crio-751278e12add3a08e4857ff0a36da23cc83770e5f60ac695d1d8f9ce1adac85f WatchSource:0}: Error finding container 751278e12add3a08e4857ff0a36da23cc83770e5f60ac695d1d8f9ce1adac85f: Status 404 returned error can't find the container with id 751278e12add3a08e4857ff0a36da23cc83770e5f60ac695d1d8f9ce1adac85f
Jul 16 12:21:42.262929 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:42.262886    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:42.330148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:42.330023    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:42.691337 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:42.691244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxfs9" event={"ID":"3b39c802-c316-4ba0-923e-8184cc16f3bf","Type":"ContainerStarted","Data":"751278e12add3a08e4857ff0a36da23cc83770e5f60ac695d1d8f9ce1adac85f"}
Jul 16 12:21:42.693109 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:42.693010    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k7jbr" event={"ID":"b7d5b95e-f49a-4fcd-ae33-aa4540a18232","Type":"ContainerStarted","Data":"ce260ffda005002c7916bc13325cff759fc08d1be1893e780da9320896a31d98"}
Jul 16 12:21:42.695651 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:42.695465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mw6lt" event={"ID":"09aca51a-379f-49af-bb70-476a85243914","Type":"ContainerStarted","Data":"78ac2840fe2b4668c2f73e9ef6285c9a0cb06a000e1397555840d6ac99f7da56"}
Jul 16 12:21:43.645018 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.644927    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:43.727014 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.726900    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:43.749338 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.748445    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"]
Jul 16 12:21:43.828951 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.828914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:43.853939 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.853908    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"]
Jul 16 12:21:43.854125 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.853964    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nct6s"]
Jul 16 12:21:43.854800 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.854776    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:43.857609 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.857329    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 16 12:21:43.857609 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.857449    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-t7pfs\""
Jul 16 12:21:43.857751 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.857658    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 16 12:21:43.871967 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.871885    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"]
Jul 16 12:21:43.872123 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.871987    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:43.874976 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.874711    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5n6tr\""
Jul 16 12:21:43.875587 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.875547    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 12:21:43.876437 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.876290    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 12:21:43.876819 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.876619    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 12:21:43.893637 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.893610    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"]
Jul 16 12:21:43.893805 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.893726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:43.896453 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.896352    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 16 12:21:43.896815 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.896794    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 16 12:21:43.896979 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.896924    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 16 12:21:43.896979 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.896948    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5crxs\""
Jul 16 12:21:43.904099 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.904055    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:43.945501 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.945246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a75c9ff5-480e-49dc-a951-1c419d3db66d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-fnjnf\" (UID: \"a75c9ff5-480e-49dc-a951-1c419d3db66d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:43.945501 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.945313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk45k\" (UniqueName: \"kubernetes.io/projected/a75c9ff5-480e-49dc-a951-1c419d3db66d-kube-api-access-rk45k\") pod \"openshift-state-metrics-84bd68b896-fnjnf\" (UID: \"a75c9ff5-480e-49dc-a951-1c419d3db66d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:43.945501 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.945348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a75c9ff5-480e-49dc-a951-1c419d3db66d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fnjnf\" (UID: \"a75c9ff5-480e-49dc-a951-1c419d3db66d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:43.945501 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.945393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a75c9ff5-480e-49dc-a951-1c419d3db66d-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-fnjnf\" (UID: \"a75c9ff5-480e-49dc-a951-1c419d3db66d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:43.977994 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:43.977931    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:44.046728 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.046695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7472d7b2-e452-4e88-a38d-0889c3bcff95-sys\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.046728 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.046733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrtm9\" (UniqueName: \"kubernetes.io/projected/7472d7b2-e452-4e88-a38d-0889c3bcff95-kube-api-access-vrtm9\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.046972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.046761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a75c9ff5-480e-49dc-a951-1c419d3db66d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-fnjnf\" (UID: \"a75c9ff5-480e-49dc-a951-1c419d3db66d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:44.046972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.046780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-wtmp\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.046972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.046801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.046972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.046820    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7472d7b2-e452-4e88-a38d-0889c3bcff95-metrics-client-ca\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.046972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.046836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-tls\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.046972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.046853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk45k\" (UniqueName: \"kubernetes.io/projected/a75c9ff5-480e-49dc-a951-1c419d3db66d-kube-api-access-rk45k\") pod \"openshift-state-metrics-84bd68b896-fnjnf\" (UID: \"a75c9ff5-480e-49dc-a951-1c419d3db66d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:44.046972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.046884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7472d7b2-e452-4e88-a38d-0889c3bcff95-root\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.046972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.046909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39345e6d-4056-4547-895e-1869784d43d3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.046972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.046945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/39345e6d-4056-4547-895e-1869784d43d3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.046972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.046971    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-accelerators-collector-config\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.047485 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.046990    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-textfile\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.047485 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.047006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/39345e6d-4056-4547-895e-1869784d43d3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.047485 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.047024    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39345e6d-4056-4547-895e-1869784d43d3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.047485 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.047048    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39345e6d-4056-4547-895e-1869784d43d3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.047485 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.047078    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a75c9ff5-480e-49dc-a951-1c419d3db66d-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-fnjnf\" (UID: \"a75c9ff5-480e-49dc-a951-1c419d3db66d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:44.047485 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.047105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a75c9ff5-480e-49dc-a951-1c419d3db66d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fnjnf\" (UID: \"a75c9ff5-480e-49dc-a951-1c419d3db66d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:44.047485 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.047140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvhwd\" (UniqueName: \"kubernetes.io/projected/39345e6d-4056-4547-895e-1869784d43d3-kube-api-access-cvhwd\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.048220 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:44.048198    2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 16 12:21:44.048291 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:44.048271    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a75c9ff5-480e-49dc-a951-1c419d3db66d-openshift-state-metrics-tls podName:a75c9ff5-480e-49dc-a951-1c419d3db66d nodeName:}" failed. No retries permitted until 2026-07-16 12:21:44.548249805 +0000 UTC m=+68.328823831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a75c9ff5-480e-49dc-a951-1c419d3db66d-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-fnjnf" (UID: "a75c9ff5-480e-49dc-a951-1c419d3db66d") : secret "openshift-state-metrics-tls" not found
Jul 16 12:21:44.048840 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.048739    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a75c9ff5-480e-49dc-a951-1c419d3db66d-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-fnjnf\" (UID: \"a75c9ff5-480e-49dc-a951-1c419d3db66d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:44.051137 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.051110    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a75c9ff5-480e-49dc-a951-1c419d3db66d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-fnjnf\" (UID: \"a75c9ff5-480e-49dc-a951-1c419d3db66d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:44.058849 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.058798    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk45k\" (UniqueName: \"kubernetes.io/projected/a75c9ff5-480e-49dc-a951-1c419d3db66d-kube-api-access-rk45k\") pod \"openshift-state-metrics-84bd68b896-fnjnf\" (UID: \"a75c9ff5-480e-49dc-a951-1c419d3db66d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:44.078471 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.078409    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:44.147972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.147884    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvhwd\" (UniqueName: \"kubernetes.io/projected/39345e6d-4056-4547-895e-1869784d43d3-kube-api-access-cvhwd\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.147972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.147931    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7472d7b2-e452-4e88-a38d-0889c3bcff95-sys\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.147972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.147964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrtm9\" (UniqueName: \"kubernetes.io/projected/7472d7b2-e452-4e88-a38d-0889c3bcff95-kube-api-access-vrtm9\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.148235 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.147992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-wtmp\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.148235 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.148077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7472d7b2-e452-4e88-a38d-0889c3bcff95-sys\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.149277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.148329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.149277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.148390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7472d7b2-e452-4e88-a38d-0889c3bcff95-metrics-client-ca\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.149277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.148421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-tls\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.149277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.148471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7472d7b2-e452-4e88-a38d-0889c3bcff95-root\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.149277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.148511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39345e6d-4056-4547-895e-1869784d43d3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.149277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.148541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/39345e6d-4056-4547-895e-1869784d43d3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.149277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.148572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-accelerators-collector-config\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.149277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.148602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-textfile\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.149277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.148626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/39345e6d-4056-4547-895e-1869784d43d3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.149277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.148658    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39345e6d-4056-4547-895e-1869784d43d3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.149277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.148683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39345e6d-4056-4547-895e-1869784d43d3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.149277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.148921    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-wtmp\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.149277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.149245    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/39345e6d-4056-4547-895e-1869784d43d3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.150013 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.149389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-textfile\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.150013 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.149427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7472d7b2-e452-4e88-a38d-0889c3bcff95-root\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.150013 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.149783    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7472d7b2-e452-4e88-a38d-0889c3bcff95-metrics-client-ca\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.150013 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.149865    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-accelerators-collector-config\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.150725 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.150394    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39345e6d-4056-4547-895e-1869784d43d3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.150725 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.150488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/39345e6d-4056-4547-895e-1869784d43d3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.151771 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.151726    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.154684 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.154629    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7472d7b2-e452-4e88-a38d-0889c3bcff95-node-exporter-tls\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.154809 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.154708    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39345e6d-4056-4547-895e-1869784d43d3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.157933 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.155124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39345e6d-4056-4547-895e-1869784d43d3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.170134 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.170102    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrtm9\" (UniqueName: \"kubernetes.io/projected/7472d7b2-e452-4e88-a38d-0889c3bcff95-kube-api-access-vrtm9\") pod \"node-exporter-nct6s\" (UID: \"7472d7b2-e452-4e88-a38d-0889c3bcff95\") " pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.170822 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.170801    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvhwd\" (UniqueName: \"kubernetes.io/projected/39345e6d-4056-4547-895e-1869784d43d3-kube-api-access-cvhwd\") pod \"kube-state-metrics-785778ff74-tv7xb\" (UID: \"39345e6d-4056-4547-895e-1869784d43d3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.182126 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.182007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:44.185618 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.185594    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nct6s"
Jul 16 12:21:44.209265 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.209198    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"
Jul 16 12:21:44.308144 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.308104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:44.553219 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.553134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a75c9ff5-480e-49dc-a951-1c419d3db66d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fnjnf\" (UID: \"a75c9ff5-480e-49dc-a951-1c419d3db66d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:44.556071 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.556044    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a75c9ff5-480e-49dc-a951-1c419d3db66d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-fnjnf\" (UID: \"a75c9ff5-480e-49dc-a951-1c419d3db66d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:44.573859 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.573808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:44.676519 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.676462    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:44.743715 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.743620    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:21:44.752061 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.752031    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.754862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.754618    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 16 12:21:44.754862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.754635    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-54rzf\""
Jul 16 12:21:44.754862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.754681    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 16 12:21:44.754862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.754623    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 16 12:21:44.754862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.754756    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 16 12:21:44.755287 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.754999    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 16 12:21:44.755287 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.755139    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 16 12:21:44.755287 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.755239    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 16 12:21:44.755531 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.755510    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 16 12:21:44.761683 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.761639    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 16 12:21:44.770026 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.769802    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"
Jul 16 12:21:44.771350 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.771243    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:21:44.776416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.776388    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:44.855300 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.855209    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.855300 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.855258    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.855300 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.855289    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.855585 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.855334    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.855585 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.855381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98455eb-6454-47a2-b303-8bb29c3f1db6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.855585 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.855413    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98455eb-6454-47a2-b303-8bb29c3f1db6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.855585 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.855437    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjzst\" (UniqueName: \"kubernetes.io/projected/c98455eb-6454-47a2-b303-8bb29c3f1db6-kube-api-access-jjzst\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.855585 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.855462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c98455eb-6454-47a2-b303-8bb29c3f1db6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.855585 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.855487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c98455eb-6454-47a2-b303-8bb29c3f1db6-config-out\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.855585 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.855527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-config-volume\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.855585 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.855550    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c98455eb-6454-47a2-b303-8bb29c3f1db6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.855585 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.855587    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-web-config\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.856023 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.855618    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.956646 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.956557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98455eb-6454-47a2-b303-8bb29c3f1db6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.956826 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.956685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjzst\" (UniqueName: \"kubernetes.io/projected/c98455eb-6454-47a2-b303-8bb29c3f1db6-kube-api-access-jjzst\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.956826 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.956719    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c98455eb-6454-47a2-b303-8bb29c3f1db6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.956826 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.956747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c98455eb-6454-47a2-b303-8bb29c3f1db6-config-out\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.956826 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.956788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-config-volume\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.956826 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.956807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c98455eb-6454-47a2-b303-8bb29c3f1db6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.957082 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.956839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-web-config\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.957082 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.956870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.957082 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.956911    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.957082 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.956940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.957082 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.956971    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.957082 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.957018    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.957082 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.957053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98455eb-6454-47a2-b303-8bb29c3f1db6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.957552 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.957521    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98455eb-6454-47a2-b303-8bb29c3f1db6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.958450 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.957746    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98455eb-6454-47a2-b303-8bb29c3f1db6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.958450 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:44.957866    2581 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 16 12:21:44.958450 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:21:44.957922    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-main-tls podName:c98455eb-6454-47a2-b303-8bb29c3f1db6 nodeName:}" failed. No retries permitted until 2026-07-16 12:21:45.457903278 +0000 UTC m=+69.238477300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6") : secret "alertmanager-main-tls" not found
Jul 16 12:21:44.958450 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.958011    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c98455eb-6454-47a2-b303-8bb29c3f1db6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.961507 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.961483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c98455eb-6454-47a2-b303-8bb29c3f1db6-config-out\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.962116 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.961663    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-web-config\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.962116 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.961938    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c98455eb-6454-47a2-b303-8bb29c3f1db6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.962116 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.962070    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-config-volume\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.962317 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.962218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.963174 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.963030    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.963680 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.963660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.964868 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.964821    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:44.965985 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:44.965965    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjzst\" (UniqueName: \"kubernetes.io/projected/c98455eb-6454-47a2-b303-8bb29c3f1db6-kube-api-access-jjzst\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:45.040701 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:45.040644    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:45.106736 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:45.106643    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:45.199976 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:45.199931    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:45.462064 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:45.462033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:45.464824 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:45.464790    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:45.659762 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:45.659736    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7srpq"
Jul 16 12:21:45.664864 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:45.664841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:21:46.645411 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:46.645375    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:46.752916 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:46.752874    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:47.259825 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.259785    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:47.362599 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.362559    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:47.630702 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.630168    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:21:47.648346 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.648318    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-tv7xb"]
Jul 16 12:21:47.653416 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:21:47.653299    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39345e6d_4056_4547_895e_1869784d43d3.slice/crio-9d23086f1f4677c699af6d3d03444be115c80a3f1fbc92ef2ad299603dc6e415 WatchSource:0}: Error finding container 9d23086f1f4677c699af6d3d03444be115c80a3f1fbc92ef2ad299603dc6e415: Status 404 returned error can't find the container with id 9d23086f1f4677c699af6d3d03444be115c80a3f1fbc92ef2ad299603dc6e415
Jul 16 12:21:47.653655 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.653633    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf"]
Jul 16 12:21:47.670614 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:21:47.670581    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75c9ff5_480e_49dc_a951_1c419d3db66d.slice/crio-b6cd65c21f1b05c2f5e7c2a265ad78111b1f4419b34fefdbdc14b2297fff11cf WatchSource:0}: Error finding container b6cd65c21f1b05c2f5e7c2a265ad78111b1f4419b34fefdbdc14b2297fff11cf: Status 404 returned error can't find the container with id b6cd65c21f1b05c2f5e7c2a265ad78111b1f4419b34fefdbdc14b2297fff11cf
Jul 16 12:21:47.717759 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.717727    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxfs9" event={"ID":"3b39c802-c316-4ba0-923e-8184cc16f3bf","Type":"ContainerStarted","Data":"35b37c4a19b8db17734d96b72c6c17880fc0e3e485c2c2e3dfd5edd2846eb91f"}
Jul 16 12:21:47.718027 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.717945    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:21:47.721227 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.721201    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf" event={"ID":"a75c9ff5-480e-49dc-a951-1c419d3db66d","Type":"ContainerStarted","Data":"b6cd65c21f1b05c2f5e7c2a265ad78111b1f4419b34fefdbdc14b2297fff11cf"}
Jul 16 12:21:47.723539 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.723514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerStarted","Data":"b56739ddeda7088a3f2b71fd207222e7a5d6b07c76dd045c9c9f4e2ca4cbe44e"}
Jul 16 12:21:47.727397 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.726112    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k7jbr" event={"ID":"b7d5b95e-f49a-4fcd-ae33-aa4540a18232","Type":"ContainerStarted","Data":"d2c8d80249cd67957fc3889ddca79c0f3c4d01a6a62fa4dba08184efdff0a88b"}
Jul 16 12:21:47.727397 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.726156    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k7jbr" event={"ID":"b7d5b95e-f49a-4fcd-ae33-aa4540a18232","Type":"ContainerStarted","Data":"10bb9667f61425ed2f824f8a4c484972f0d0abc5df6979705942a20a72150f84"}
Jul 16 12:21:47.728003 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.727978    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mw6lt" event={"ID":"09aca51a-379f-49af-bb70-476a85243914","Type":"ContainerStarted","Data":"5f9e0b743e5d137ff2088695d5c7509ea14ad17ed2b57a94e9fcf890e117c3a1"}
Jul 16 12:21:47.729523 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.729499    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nct6s" event={"ID":"7472d7b2-e452-4e88-a38d-0889c3bcff95","Type":"ContainerStarted","Data":"322f345de0cf7dbbde7c91439ba8c291631023d2c0f8a6bd5aae91c19b88c8de"}
Jul 16 12:21:47.731500 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.731463    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb" event={"ID":"39345e6d-4056-4547-895e-1869784d43d3","Type":"ContainerStarted","Data":"9d23086f1f4677c699af6d3d03444be115c80a3f1fbc92ef2ad299603dc6e415"}
Jul 16 12:21:47.735419 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.734699    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flrd4" event={"ID":"e6c792c7-1144-48eb-b763-1a907863cdcd","Type":"ContainerStarted","Data":"d4afd2be5dc57b8231b4373a9a27c51fcf8d433b00412c68e211cdb29c2c19a6"}
Jul 16 12:21:47.744418 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.744348    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hxfs9" podStartSLOduration=65.28666343 podStartE2EDuration="1m10.744328991s" totalImagesPullingTime="5.457665561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:47.743612618 +0000 UTC m=+71.524186661" watchObservedRunningTime="2026-07-16 12:21:47.744328991 +0000 UTC m=+71.524903033"
Jul 16 12:21:47.763121 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.763062    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k7jbr" podStartSLOduration=65.091367614 podStartE2EDuration="1m10.763040873s" totalImagesPullingTime="5.671673259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:47.762388228 +0000 UTC m=+71.542962270" watchObservedRunningTime="2026-07-16 12:21:47.763040873 +0000 UTC m=+71.543614915"
Jul 16 12:21:47.782874 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.782793    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-flrd4" podStartSLOduration=1.11594347 podStartE2EDuration="18.782772076s" totalImagesPullingTime="17.666828606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:21:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:47.782133676 +0000 UTC m=+71.562707719" watchObservedRunningTime="2026-07-16 12:21:47.782772076 +0000 UTC m=+71.563346118"
Jul 16 12:21:47.798814 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.798757    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mw6lt" podStartSLOduration=65.08439845 podStartE2EDuration="1m10.798739928s" totalImagesPullingTime="5.714341478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:47.797277972 +0000 UTC m=+71.577852017" watchObservedRunningTime="2026-07-16 12:21:47.798739928 +0000 UTC m=+71.579313948"
Jul 16 12:21:47.862279 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.862244    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:47.965919 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:47.965883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:48.062414 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.062322    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:48.187804 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.187775    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:48.276761 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.276725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:48.414032 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.413998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:48.488351 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.488315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:48.741635 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.741547    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf" event={"ID":"a75c9ff5-480e-49dc-a951-1c419d3db66d","Type":"ContainerStarted","Data":"d6e6025bc78ebe27bcc166059b0e038fdb85942629f828d6e2c68351aab1eeb5"}
Jul 16 12:21:48.741635 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.741625    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf" event={"ID":"a75c9ff5-480e-49dc-a951-1c419d3db66d","Type":"ContainerStarted","Data":"d482ff8ef621647276ef8522571203240ab6e27519c251fed615e16972584048"}
Jul 16 12:21:48.902397 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.902341    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"]
Jul 16 12:21:48.905999 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.905974    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:48.908775 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.908736    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 16 12:21:48.908913 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.908801    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 16 12:21:48.908913 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.908909    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-69csv\""
Jul 16 12:21:48.909033 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.908920    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 16 12:21:48.909476 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.909456    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 16 12:21:48.909689 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.909637    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 16 12:21:48.915167 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.915144    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 16 12:21:48.919674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.919625    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"]
Jul 16 12:21:48.998988 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.998903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/961b0be8-3985-47c8-a33f-c84f1678a7f8-metrics-client-ca\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:48.998988 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.998954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/961b0be8-3985-47c8-a33f-c84f1678a7f8-telemeter-client-tls\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:48.999207 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.998992    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/961b0be8-3985-47c8-a33f-c84f1678a7f8-secret-telemeter-client\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:48.999207 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.999093    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/961b0be8-3985-47c8-a33f-c84f1678a7f8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:48.999207 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.999127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t2r9\" (UniqueName: \"kubernetes.io/projected/961b0be8-3985-47c8-a33f-c84f1678a7f8-kube-api-access-9t2r9\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:48.999207 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.999159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/961b0be8-3985-47c8-a33f-c84f1678a7f8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:48.999207 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.999193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/961b0be8-3985-47c8-a33f-c84f1678a7f8-federate-client-tls\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:48.999511 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:48.999251    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/961b0be8-3985-47c8-a33f-c84f1678a7f8-serving-certs-ca-bundle\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.099825 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.099785    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/961b0be8-3985-47c8-a33f-c84f1678a7f8-federate-client-tls\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.100019 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.099848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/961b0be8-3985-47c8-a33f-c84f1678a7f8-serving-certs-ca-bundle\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.100019 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.099886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/961b0be8-3985-47c8-a33f-c84f1678a7f8-metrics-client-ca\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.100019 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.099923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/961b0be8-3985-47c8-a33f-c84f1678a7f8-telemeter-client-tls\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.100019 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.099953    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/961b0be8-3985-47c8-a33f-c84f1678a7f8-secret-telemeter-client\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.100019 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.100006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/961b0be8-3985-47c8-a33f-c84f1678a7f8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.100271 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.100030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t2r9\" (UniqueName: \"kubernetes.io/projected/961b0be8-3985-47c8-a33f-c84f1678a7f8-kube-api-access-9t2r9\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.100271 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.100056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/961b0be8-3985-47c8-a33f-c84f1678a7f8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.101671 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.100778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/961b0be8-3985-47c8-a33f-c84f1678a7f8-serving-certs-ca-bundle\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.101671 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.100824    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/961b0be8-3985-47c8-a33f-c84f1678a7f8-metrics-client-ca\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.101671 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.101562    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/961b0be8-3985-47c8-a33f-c84f1678a7f8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.103714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.103550    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/961b0be8-3985-47c8-a33f-c84f1678a7f8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.103714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.103666    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/961b0be8-3985-47c8-a33f-c84f1678a7f8-telemeter-client-tls\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.103869 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.103843    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/961b0be8-3985-47c8-a33f-c84f1678a7f8-secret-telemeter-client\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.104186 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.104163    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/961b0be8-3985-47c8-a33f-c84f1678a7f8-federate-client-tls\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.110343 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.110318    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t2r9\" (UniqueName: \"kubernetes.io/projected/961b0be8-3985-47c8-a33f-c84f1678a7f8-kube-api-access-9t2r9\") pod \"telemeter-client-7fb9cbb74b-4pck6\" (UID: \"961b0be8-3985-47c8-a33f-c84f1678a7f8\") " pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.217862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.217673    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"
Jul 16 12:21:49.418942 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.418585    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6"]
Jul 16 12:21:49.652736 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:21:49.652702    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961b0be8_3985_47c8_a33f_c84f1678a7f8.slice/crio-bb4ff9bf7da486f426c896341c7c16fa8c501f3554607fa467663ef0ca0e1c7c WatchSource:0}: Error finding container bb4ff9bf7da486f426c896341c7c16fa8c501f3554607fa467663ef0ca0e1c7c: Status 404 returned error can't find the container with id bb4ff9bf7da486f426c896341c7c16fa8c501f3554607fa467663ef0ca0e1c7c
Jul 16 12:21:49.670773 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.670743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:49.748500 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.748465    2581 generic.go:356] "Generic (PLEG): container finished" podID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerID="414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7" exitCode=0
Jul 16 12:21:49.748971 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.748570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerDied","Data":"414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7"}
Jul 16 12:21:49.751394 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.751273    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb" event={"ID":"39345e6d-4056-4547-895e-1869784d43d3","Type":"ContainerStarted","Data":"0365a2f1454910f910639c28d5ecd4992c2aebcb3f40478dfeda5c0f3ade61a5"}
Jul 16 12:21:49.752867 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.752819    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6" event={"ID":"961b0be8-3985-47c8-a33f-c84f1678a7f8","Type":"ContainerStarted","Data":"bb4ff9bf7da486f426c896341c7c16fa8c501f3554607fa467663ef0ca0e1c7c"}
Jul 16 12:21:49.771829 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.771791    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:49.967224 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.967180    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:49.973414 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.973297    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 12:21:49.986117 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.986026    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:49.991238 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.991212    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 16 12:21:49.991445 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.991340    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 16 12:21:49.991445 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.991350    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 16 12:21:49.991567 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.991463    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 16 12:21:49.991567 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.991524    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 16 12:21:49.991567 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.991467    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 16 12:21:49.991704 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.991662    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cbemav8nbte7\""
Jul 16 12:21:49.991704 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.991690    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 16 12:21:49.991807 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.991794    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 16 12:21:49.991859 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.991797    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 12:21:49.991859 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.991855    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-k68sd\""
Jul 16 12:21:49.991961 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.991920    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 16 12:21:49.992012 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.991966    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 16 12:21:49.992012 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.992000    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 16 12:21:49.992530 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.992503    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 16 12:21:49.999507 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.997458    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 12:21:50.000138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:49.999867    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 16 12:21:50.000689 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.000670    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 16 12:21:50.010514 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.010491    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.010602 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.010553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.010602 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.010583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.010693 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.010605    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.010693 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.010624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.010787 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.010699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.010787 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.010748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.010890 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.010834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.010943 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.010912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.010996 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.010953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.011052 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.010993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.011052 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.011019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.011052 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.011046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-config\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.011194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.011073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v59sw\" (UniqueName: \"kubernetes.io/projected/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-kube-api-access-v59sw\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.011194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.011104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.011194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.011128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-web-config\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.011194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.011173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.011407 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.011200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.011407 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.011232    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-config-out\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.011407 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.011256    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.112696 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.112696 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.112696 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.112696 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112844    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-config\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v59sw\" (UniqueName: \"kubernetes.io/projected/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-kube-api-access-v59sw\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112899    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-web-config\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-config-out\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.112990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.113212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.113017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.114105 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.113752    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.114455 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.114431    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.118385 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.115103    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.118385 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.116617    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.118385 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.117109    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.118385 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.117542    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.118660 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.118635    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.118660 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.118652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-config-out\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.118888 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.118846    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.120348 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.120189    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-config\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.120348 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.120314    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.121392 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.120614    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.121392 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.121245    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.122062 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.121635    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-web-config\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.122062 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.121675    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.122062 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.121773    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.122062 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.121803    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.122456 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.122158    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.122819 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.122795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.124440 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.124418    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v59sw\" (UniqueName: \"kubernetes.io/projected/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-kube-api-access-v59sw\") pod \"prometheus-k8s-0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.338466 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.338107    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:21:50.521453 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.521312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 12:21:50.524184 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:21:50.524155    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a8fc74f_b3b7_4c56_be93_778c4f9247f0.slice/crio-e55c3a6f84175a022a534d9e9195e616fca25aff5cccaa9ebd98624a14cec809 WatchSource:0}: Error finding container e55c3a6f84175a022a534d9e9195e616fca25aff5cccaa9ebd98624a14cec809: Status 404 returned error can't find the container with id e55c3a6f84175a022a534d9e9195e616fca25aff5cccaa9ebd98624a14cec809
Jul 16 12:21:50.760745 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.760503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf" event={"ID":"a75c9ff5-480e-49dc-a951-1c419d3db66d","Type":"ContainerStarted","Data":"e94d9a79b81461fe9a419b84cbcc076f5995e7f5ef1ed752a55ea0d0dcfeb5ed"}
Jul 16 12:21:50.762403 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.762376    2581 generic.go:356] "Generic (PLEG): container finished" podID="7472d7b2-e452-4e88-a38d-0889c3bcff95" containerID="c2262f487dc98f79dfdbdd26389d9b37f2bac222eee8fc71d277d4205a2c29e6" exitCode=0
Jul 16 12:21:50.762524 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.762456    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nct6s" event={"ID":"7472d7b2-e452-4e88-a38d-0889c3bcff95","Type":"ContainerDied","Data":"c2262f487dc98f79dfdbdd26389d9b37f2bac222eee8fc71d277d4205a2c29e6"}
Jul 16 12:21:50.764929 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.764879    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb" event={"ID":"39345e6d-4056-4547-895e-1869784d43d3","Type":"ContainerStarted","Data":"758b67933a8039898bb6d6f39d782eee82d1faa956405fcc653795227d97b9df"}
Jul 16 12:21:50.765037 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.764933    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb" event={"ID":"39345e6d-4056-4547-895e-1869784d43d3","Type":"ContainerStarted","Data":"2c6c93fc9cab1274efc446938fd118bf5b1fb366ad69d612a70e7358c6a00120"}
Jul 16 12:21:50.766701 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.766679    2581 generic.go:356] "Generic (PLEG): container finished" podID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerID="1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397" exitCode=0
Jul 16 12:21:50.766811 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.766711    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerDied","Data":"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"}
Jul 16 12:21:50.766811 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.766770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerStarted","Data":"e55c3a6f84175a022a534d9e9195e616fca25aff5cccaa9ebd98624a14cec809"}
Jul 16 12:21:50.783215 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.783166    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-fnjnf" podStartSLOduration=5.586832479 podStartE2EDuration="7.783147768s" totalImagesPullingTime="2.196315289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:50.782589037 +0000 UTC m=+74.563163080" watchObservedRunningTime="2026-07-16 12:21:50.783147768 +0000 UTC m=+74.563721811"
Jul 16 12:21:50.803174 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:50.803120    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-tv7xb" podStartSLOduration=6.243710097 podStartE2EDuration="7.803101074s" totalImagesPullingTime="1.559390977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:50.801442456 +0000 UTC m=+74.582016501" watchObservedRunningTime="2026-07-16 12:21:50.803101074 +0000 UTC m=+74.583675117"
Jul 16 12:21:51.007766 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:51.007723    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:51.108866 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:51.108781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:51.460757 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:51.460717    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:51.562553 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:51.562483    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:51.775950 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:51.775861    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nct6s" event={"ID":"7472d7b2-e452-4e88-a38d-0889c3bcff95","Type":"ContainerStarted","Data":"c5e121105242f2b383273defd126e2ed5d732b6b46a0d904e8ae9f71eb5b885e"}
Jul 16 12:21:51.775950 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:51.775934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nct6s" event={"ID":"7472d7b2-e452-4e88-a38d-0889c3bcff95","Type":"ContainerStarted","Data":"92c1d68c6d6d89bcf09d608d989497f6b0a0c1c3eb6b343c2da424b480d155eb"}
Jul 16 12:21:51.797636 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:51.797581    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nct6s" podStartSLOduration=6.17083868 podStartE2EDuration="8.797563093s" totalImagesPullingTime="2.542774802s" totalInitContainerRuntime="83.949611ms" isStatefulPod=true podCreationTimestamp="2026-07-16 12:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:51.79575374 +0000 UTC m=+75.576327795" watchObservedRunningTime="2026-07-16 12:21:51.797563093 +0000 UTC m=+75.578137182"
Jul 16 12:21:52.797254 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:52.797054    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerStarted","Data":"c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0"}
Jul 16 12:21:52.797254 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:52.797195    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerStarted","Data":"8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1"}
Jul 16 12:21:52.797254 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:52.797238    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerStarted","Data":"034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a"}
Jul 16 12:21:52.797865 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:52.797270    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerStarted","Data":"2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384"}
Jul 16 12:21:52.797865 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:52.797303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerStarted","Data":"34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9"}
Jul 16 12:21:52.802547 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:52.802513    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:52.802880 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:52.802784    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6" event={"ID":"961b0be8-3985-47c8-a33f-c84f1678a7f8","Type":"ContainerStarted","Data":"03de8f091086e659a2ef6bb9d09fc599eb252b874688e3ac4788a987cbb0e334"}
Jul 16 12:21:52.803090 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:52.803072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6" event={"ID":"961b0be8-3985-47c8-a33f-c84f1678a7f8","Type":"ContainerStarted","Data":"5378176fcab8c0145b7244b6da08494fe9d4db75152ea58bd0f6929022dea1c6"}
Jul 16 12:21:52.803228 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:52.803211    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6" event={"ID":"961b0be8-3985-47c8-a33f-c84f1678a7f8","Type":"ContainerStarted","Data":"281e3c729a1fa5719608f19f7789df087b91507d98e895f226580020e46f9be2"}
Jul 16 12:21:52.831558 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:52.830628    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7fb9cbb74b-4pck6" podStartSLOduration=2.633757085 podStartE2EDuration="4.83060295s" totalImagesPullingTime="2.196845865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:52.828101595 +0000 UTC m=+76.608675638" watchObservedRunningTime="2026-07-16 12:21:52.83060295 +0000 UTC m=+76.611176994"
Jul 16 12:21:52.906017 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:52.905976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:53.811366 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:53.811324    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerStarted","Data":"1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720"}
Jul 16 12:21:54.001188 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:54.001150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:54.098883 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:54.098801    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:54.499676 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:54.499611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:54.823975 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:54.823936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerStarted","Data":"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"}
Jul 16 12:21:55.832031 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:55.831994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerStarted","Data":"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"}
Jul 16 12:21:57.843913 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:57.843872    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerStarted","Data":"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"}
Jul 16 12:21:57.844277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:57.843956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerStarted","Data":"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"}
Jul 16 12:21:57.844277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:57.843994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerStarted","Data":"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"}
Jul 16 12:21:57.844277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:57.844037    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerStarted","Data":"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"}
Jul 16 12:21:57.879762 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:57.879683    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.367696113 podStartE2EDuration="13.879624358s" totalImagesPullingTime="4.488027476s" totalInitContainerRuntime="23.900769ms" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:53.861450498 +0000 UTC m=+77.642024541" watchObservedRunningTime="2026-07-16 12:21:57.879624358 +0000 UTC m=+81.660198400"
Jul 16 12:21:57.881109 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:57.881069    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.831896657 podStartE2EDuration="8.881051426s" totalImagesPullingTime="6.028758525s" totalInitContainerRuntime="20.396244ms" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:57.878497572 +0000 UTC m=+81.659071614" watchObservedRunningTime="2026-07-16 12:21:57.881051426 +0000 UTC m=+81.661625468"
Jul 16 12:21:58.845438 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:58.845268    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:58.943600 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:58.943568    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:59.010555 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:21:59.010527    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:00.026797 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:00.026759    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:00.126769 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:00.126721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:00.339022 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:00.338934    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:22:04.079942 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:04.079904    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66cb9dfc5-qvshf"]
Jul 16 12:22:04.239760 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:04.239727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:04.336030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:04.335947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:04.398952 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:04.398920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:06.464516 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:06.464483    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:06.521932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:06.521896    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:18.744404 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:18.744349    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hxfs9"
Jul 16 12:22:29.099943 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.099876    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66cb9dfc5-qvshf" podUID="f666a519-c2c3-4b2a-9378-4d981947936b" containerName="console" containerID="cri-o://ffe771e789dd8e2f867d527a2a2168e7e6e17937793a193da1c1db7e43faa2a0" gracePeriod=15
Jul 16 12:22:29.369894 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.369863    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:22:29.560099 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560062    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-oauth-serving-cert\") pod \"f666a519-c2c3-4b2a-9378-4d981947936b\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") "
Jul 16 12:22:29.560296 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560112    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-service-ca\") pod \"f666a519-c2c3-4b2a-9378-4d981947936b\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") "
Jul 16 12:22:29.560296 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560148    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-console-config\") pod \"f666a519-c2c3-4b2a-9378-4d981947936b\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") "
Jul 16 12:22:29.560296 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560174    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f666a519-c2c3-4b2a-9378-4d981947936b-console-oauth-config\") pod \"f666a519-c2c3-4b2a-9378-4d981947936b\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") "
Jul 16 12:22:29.560296 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560207    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f666a519-c2c3-4b2a-9378-4d981947936b-console-serving-cert\") pod \"f666a519-c2c3-4b2a-9378-4d981947936b\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") "
Jul 16 12:22:29.560296 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560229    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl977\" (UniqueName: \"kubernetes.io/projected/f666a519-c2c3-4b2a-9378-4d981947936b-kube-api-access-jl977\") pod \"f666a519-c2c3-4b2a-9378-4d981947936b\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") "
Jul 16 12:22:29.560579 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560375    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-trusted-ca-bundle\") pod \"f666a519-c2c3-4b2a-9378-4d981947936b\" (UID: \"f666a519-c2c3-4b2a-9378-4d981947936b\") "
Jul 16 12:22:29.560579 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560500    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f666a519-c2c3-4b2a-9378-4d981947936b" (UID: "f666a519-c2c3-4b2a-9378-4d981947936b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:22:29.560694 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560577    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-console-config" (OuterVolumeSpecName: "console-config") pod "f666a519-c2c3-4b2a-9378-4d981947936b" (UID: "f666a519-c2c3-4b2a-9378-4d981947936b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:22:29.560694 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560627    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-service-ca" (OuterVolumeSpecName: "service-ca") pod "f666a519-c2c3-4b2a-9378-4d981947936b" (UID: "f666a519-c2c3-4b2a-9378-4d981947936b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:22:29.560789 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560769    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-oauth-serving-cert\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:22:29.560789 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560786    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-service-ca\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:22:29.560882 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560795    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-console-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:22:29.560996 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.560877    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f666a519-c2c3-4b2a-9378-4d981947936b" (UID: "f666a519-c2c3-4b2a-9378-4d981947936b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:22:29.562859 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.562823    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f666a519-c2c3-4b2a-9378-4d981947936b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f666a519-c2c3-4b2a-9378-4d981947936b" (UID: "f666a519-c2c3-4b2a-9378-4d981947936b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:22:29.562966 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.562830    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f666a519-c2c3-4b2a-9378-4d981947936b-kube-api-access-jl977" (OuterVolumeSpecName: "kube-api-access-jl977") pod "f666a519-c2c3-4b2a-9378-4d981947936b" (UID: "f666a519-c2c3-4b2a-9378-4d981947936b"). InnerVolumeSpecName "kube-api-access-jl977". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:22:29.562966 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.562864    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f666a519-c2c3-4b2a-9378-4d981947936b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f666a519-c2c3-4b2a-9378-4d981947936b" (UID: "f666a519-c2c3-4b2a-9378-4d981947936b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:22:29.662142 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.662106    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f666a519-c2c3-4b2a-9378-4d981947936b-console-oauth-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:22:29.662142 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.662139    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f666a519-c2c3-4b2a-9378-4d981947936b-console-serving-cert\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:22:29.662142 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.662148    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl977\" (UniqueName: \"kubernetes.io/projected/f666a519-c2c3-4b2a-9378-4d981947936b-kube-api-access-jl977\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:22:29.662405 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.662158    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f666a519-c2c3-4b2a-9378-4d981947936b-trusted-ca-bundle\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:22:29.974234 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.974151    2581 generic.go:356] "Generic (PLEG): container finished" podID="f666a519-c2c3-4b2a-9378-4d981947936b" containerID="ffe771e789dd8e2f867d527a2a2168e7e6e17937793a193da1c1db7e43faa2a0" exitCode=0
Jul 16 12:22:29.974234 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.974195    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66cb9dfc5-qvshf"
Jul 16 12:22:29.974234 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.974218    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cb9dfc5-qvshf" event={"ID":"f666a519-c2c3-4b2a-9378-4d981947936b","Type":"ContainerDied","Data":"ffe771e789dd8e2f867d527a2a2168e7e6e17937793a193da1c1db7e43faa2a0"}
Jul 16 12:22:29.974468 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.974264    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66cb9dfc5-qvshf" event={"ID":"f666a519-c2c3-4b2a-9378-4d981947936b","Type":"ContainerDied","Data":"a4f39e5ca217a7f495861c8751d31c9a4c2c407c604669c2f581a637dc7c9da9"}
Jul 16 12:22:29.974468 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.974288    2581 scope.go:117] "RemoveContainer" containerID="ffe771e789dd8e2f867d527a2a2168e7e6e17937793a193da1c1db7e43faa2a0"
Jul 16 12:22:29.983568 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.983547    2581 scope.go:117] "RemoveContainer" containerID="ffe771e789dd8e2f867d527a2a2168e7e6e17937793a193da1c1db7e43faa2a0"
Jul 16 12:22:29.983844 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:22:29.983820    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe771e789dd8e2f867d527a2a2168e7e6e17937793a193da1c1db7e43faa2a0\": container with ID starting with ffe771e789dd8e2f867d527a2a2168e7e6e17937793a193da1c1db7e43faa2a0 not found: ID does not exist" containerID="ffe771e789dd8e2f867d527a2a2168e7e6e17937793a193da1c1db7e43faa2a0"
Jul 16 12:22:29.983910 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.983852    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe771e789dd8e2f867d527a2a2168e7e6e17937793a193da1c1db7e43faa2a0"} err="failed to get container status \"ffe771e789dd8e2f867d527a2a2168e7e6e17937793a193da1c1db7e43faa2a0\": rpc error: code = NotFound desc = could not find container \"ffe771e789dd8e2f867d527a2a2168e7e6e17937793a193da1c1db7e43faa2a0\": container with ID starting with ffe771e789dd8e2f867d527a2a2168e7e6e17937793a193da1c1db7e43faa2a0 not found: ID does not exist"
Jul 16 12:22:29.997027 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:29.996996    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66cb9dfc5-qvshf"]
Jul 16 12:22:30.001401 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:30.001377    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66cb9dfc5-qvshf"]
Jul 16 12:22:31.412156 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:31.412126    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f666a519-c2c3-4b2a-9378-4d981947936b" path="/var/lib/kubelet/pods/f666a519-c2c3-4b2a-9378-4d981947936b/volumes"
Jul 16 12:22:50.338576 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:50.338527    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:22:50.358015 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:50.357986    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:22:51.069006 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:51.068979    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:22:59.829971 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:59.829933    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:59.912135 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:22:59.912100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:04.126768 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:04.126732    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:23:04.127169 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:04.127040    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="alertmanager" containerID="cri-o://34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9" gracePeriod=120
Jul 16 12:23:04.127169 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:04.127100    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="kube-rbac-proxy-metric" containerID="cri-o://c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0" gracePeriod=120
Jul 16 12:23:04.127294 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:04.127153    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="prom-label-proxy" containerID="cri-o://1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720" gracePeriod=120
Jul 16 12:23:04.127294 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:04.127201    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="config-reloader" containerID="cri-o://2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384" gracePeriod=120
Jul 16 12:23:04.127294 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:04.127199    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="kube-rbac-proxy-web" containerID="cri-o://034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a" gracePeriod=120
Jul 16 12:23:04.127453 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:04.127196    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="kube-rbac-proxy" containerID="cri-o://8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1" gracePeriod=120
Jul 16 12:23:05.107072 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.107036    2581 generic.go:356] "Generic (PLEG): container finished" podID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerID="1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720" exitCode=0
Jul 16 12:23:05.107072 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.107064    2581 generic.go:356] "Generic (PLEG): container finished" podID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerID="8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1" exitCode=0
Jul 16 12:23:05.107072 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.107070    2581 generic.go:356] "Generic (PLEG): container finished" podID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerID="2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384" exitCode=0
Jul 16 12:23:05.107072 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.107075    2581 generic.go:356] "Generic (PLEG): container finished" podID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerID="34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9" exitCode=0
Jul 16 12:23:05.107343 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.107103    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerDied","Data":"1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720"}
Jul 16 12:23:05.107343 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.107165    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerDied","Data":"8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1"}
Jul 16 12:23:05.107343 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.107191    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerDied","Data":"2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384"}
Jul 16 12:23:05.107343 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.107217    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerDied","Data":"34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9"}
Jul 16 12:23:05.373863 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.373837    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:05.453039 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.452999    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98455eb-6454-47a2-b303-8bb29c3f1db6-metrics-client-ca\") pod \"c98455eb-6454-47a2-b303-8bb29c3f1db6\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") "
Jul 16 12:23:05.453039 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453032    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjzst\" (UniqueName: \"kubernetes.io/projected/c98455eb-6454-47a2-b303-8bb29c3f1db6-kube-api-access-jjzst\") pod \"c98455eb-6454-47a2-b303-8bb29c3f1db6\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") "
Jul 16 12:23:05.453291 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453052    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-cluster-tls-config\") pod \"c98455eb-6454-47a2-b303-8bb29c3f1db6\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") "
Jul 16 12:23:05.453291 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453101    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c98455eb-6454-47a2-b303-8bb29c3f1db6\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") "
Jul 16 12:23:05.453291 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453129    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c98455eb-6454-47a2-b303-8bb29c3f1db6-config-out\") pod \"c98455eb-6454-47a2-b303-8bb29c3f1db6\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") "
Jul 16 12:23:05.453291 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453154    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy\") pod \"c98455eb-6454-47a2-b303-8bb29c3f1db6\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") "
Jul 16 12:23:05.453291 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453222    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-config-volume\") pod \"c98455eb-6454-47a2-b303-8bb29c3f1db6\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") "
Jul 16 12:23:05.453291 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453254    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c98455eb-6454-47a2-b303-8bb29c3f1db6-tls-assets\") pod \"c98455eb-6454-47a2-b303-8bb29c3f1db6\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") "
Jul 16 12:23:05.453291 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453284    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-main-tls\") pod \"c98455eb-6454-47a2-b303-8bb29c3f1db6\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") "
Jul 16 12:23:05.453676 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453313    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-web-config\") pod \"c98455eb-6454-47a2-b303-8bb29c3f1db6\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") "
Jul 16 12:23:05.453676 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453345    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98455eb-6454-47a2-b303-8bb29c3f1db6-alertmanager-trusted-ca-bundle\") pod \"c98455eb-6454-47a2-b303-8bb29c3f1db6\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") "
Jul 16 12:23:05.453676 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453393    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c98455eb-6454-47a2-b303-8bb29c3f1db6-alertmanager-main-db\") pod \"c98455eb-6454-47a2-b303-8bb29c3f1db6\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") "
Jul 16 12:23:05.453676 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453422    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy-web\") pod \"c98455eb-6454-47a2-b303-8bb29c3f1db6\" (UID: \"c98455eb-6454-47a2-b303-8bb29c3f1db6\") "
Jul 16 12:23:05.453676 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453460    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c98455eb-6454-47a2-b303-8bb29c3f1db6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c98455eb-6454-47a2-b303-8bb29c3f1db6" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:23:05.453923 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.453733    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98455eb-6454-47a2-b303-8bb29c3f1db6-metrics-client-ca\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:05.454647 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.454597    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98455eb-6454-47a2-b303-8bb29c3f1db6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c98455eb-6454-47a2-b303-8bb29c3f1db6" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:23:05.455006 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.454972    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c98455eb-6454-47a2-b303-8bb29c3f1db6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c98455eb-6454-47a2-b303-8bb29c3f1db6" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:23:05.457077 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.457055    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98455eb-6454-47a2-b303-8bb29c3f1db6-config-out" (OuterVolumeSpecName: "config-out") pod "c98455eb-6454-47a2-b303-8bb29c3f1db6" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:23:05.457165 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.457115    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c98455eb-6454-47a2-b303-8bb29c3f1db6-kube-api-access-jjzst" (OuterVolumeSpecName: "kube-api-access-jjzst") pod "c98455eb-6454-47a2-b303-8bb29c3f1db6" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6"). InnerVolumeSpecName "kube-api-access-jjzst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:23:05.457770 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.457740    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c98455eb-6454-47a2-b303-8bb29c3f1db6" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:05.457858 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.457821    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c98455eb-6454-47a2-b303-8bb29c3f1db6" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:05.458069 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.458025    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c98455eb-6454-47a2-b303-8bb29c3f1db6" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:05.458184 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.458141    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-config-volume" (OuterVolumeSpecName: "config-volume") pod "c98455eb-6454-47a2-b303-8bb29c3f1db6" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:05.458396 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.458346    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c98455eb-6454-47a2-b303-8bb29c3f1db6" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:05.458487 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.458438    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c98455eb-6454-47a2-b303-8bb29c3f1db6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c98455eb-6454-47a2-b303-8bb29c3f1db6" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:23:05.461763 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.461738    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c98455eb-6454-47a2-b303-8bb29c3f1db6" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:05.468677 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.468650    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-web-config" (OuterVolumeSpecName: "web-config") pod "c98455eb-6454-47a2-b303-8bb29c3f1db6" (UID: "c98455eb-6454-47a2-b303-8bb29c3f1db6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:05.554104 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.554067    2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-config-volume\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:05.554104 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.554098    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c98455eb-6454-47a2-b303-8bb29c3f1db6-tls-assets\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:05.554104 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.554107    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-main-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:05.554309 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.554117    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-web-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:05.554309 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.554126    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98455eb-6454-47a2-b303-8bb29c3f1db6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:05.554309 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.554135    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c98455eb-6454-47a2-b303-8bb29c3f1db6-alertmanager-main-db\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:05.554309 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.554144    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:05.554309 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.554152    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjzst\" (UniqueName: \"kubernetes.io/projected/c98455eb-6454-47a2-b303-8bb29c3f1db6-kube-api-access-jjzst\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:05.554309 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.554160    2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-cluster-tls-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:05.554309 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.554168    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:05.554309 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.554176    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c98455eb-6454-47a2-b303-8bb29c3f1db6-config-out\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:05.554309 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:05.554184    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c98455eb-6454-47a2-b303-8bb29c3f1db6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:06.113738 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.113707    2581 generic.go:356] "Generic (PLEG): container finished" podID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerID="c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0" exitCode=0
Jul 16 12:23:06.113738 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.113733    2581 generic.go:356] "Generic (PLEG): container finished" podID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerID="034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a" exitCode=0
Jul 16 12:23:06.113939 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.113782    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerDied","Data":"c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0"}
Jul 16 12:23:06.113939 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.113793    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.113939 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.113853    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerDied","Data":"034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a"}
Jul 16 12:23:06.113939 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.113881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c98455eb-6454-47a2-b303-8bb29c3f1db6","Type":"ContainerDied","Data":"b56739ddeda7088a3f2b71fd207222e7a5d6b07c76dd045c9c9f4e2ca4cbe44e"}
Jul 16 12:23:06.113939 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.113920    2581 scope.go:117] "RemoveContainer" containerID="1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720"
Jul 16 12:23:06.122216 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.122195    2581 scope.go:117] "RemoveContainer" containerID="c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0"
Jul 16 12:23:06.129840 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.129822    2581 scope.go:117] "RemoveContainer" containerID="8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1"
Jul 16 12:23:06.136443 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.136426    2581 scope.go:117] "RemoveContainer" containerID="034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a"
Jul 16 12:23:06.141606 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.141580    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:23:06.144437 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.144416    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:23:06.144844 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.144813    2581 scope.go:117] "RemoveContainer" containerID="2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384"
Jul 16 12:23:06.151245 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.151225    2581 scope.go:117] "RemoveContainer" containerID="34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9"
Jul 16 12:23:06.157898 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.157879    2581 scope.go:117] "RemoveContainer" containerID="414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7"
Jul 16 12:23:06.164392 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.164377    2581 scope.go:117] "RemoveContainer" containerID="1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720"
Jul 16 12:23:06.164644 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:06.164626    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720\": container with ID starting with 1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720 not found: ID does not exist" containerID="1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720"
Jul 16 12:23:06.164691 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.164653    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720"} err="failed to get container status \"1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720\": rpc error: code = NotFound desc = could not find container \"1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720\": container with ID starting with 1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720 not found: ID does not exist"
Jul 16 12:23:06.164691 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.164671    2581 scope.go:117] "RemoveContainer" containerID="c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0"
Jul 16 12:23:06.164931 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:06.164914    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0\": container with ID starting with c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0 not found: ID does not exist" containerID="c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0"
Jul 16 12:23:06.164974 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.164936    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0"} err="failed to get container status \"c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0\": rpc error: code = NotFound desc = could not find container \"c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0\": container with ID starting with c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0 not found: ID does not exist"
Jul 16 12:23:06.164974 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.164952    2581 scope.go:117] "RemoveContainer" containerID="8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1"
Jul 16 12:23:06.165185 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:06.165170    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1\": container with ID starting with 8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1 not found: ID does not exist" containerID="8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1"
Jul 16 12:23:06.165224 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.165188    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1"} err="failed to get container status \"8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1\": rpc error: code = NotFound desc = could not find container \"8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1\": container with ID starting with 8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1 not found: ID does not exist"
Jul 16 12:23:06.165224 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.165202    2581 scope.go:117] "RemoveContainer" containerID="034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a"
Jul 16 12:23:06.165488 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:06.165468    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a\": container with ID starting with 034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a not found: ID does not exist" containerID="034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a"
Jul 16 12:23:06.165565 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.165494    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a"} err="failed to get container status \"034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a\": rpc error: code = NotFound desc = could not find container \"034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a\": container with ID starting with 034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a not found: ID does not exist"
Jul 16 12:23:06.165565 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.165516    2581 scope.go:117] "RemoveContainer" containerID="2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384"
Jul 16 12:23:06.165753 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:06.165736    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384\": container with ID starting with 2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384 not found: ID does not exist" containerID="2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384"
Jul 16 12:23:06.165794 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.165758    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384"} err="failed to get container status \"2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384\": rpc error: code = NotFound desc = could not find container \"2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384\": container with ID starting with 2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384 not found: ID does not exist"
Jul 16 12:23:06.165794 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.165774    2581 scope.go:117] "RemoveContainer" containerID="34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9"
Jul 16 12:23:06.165978 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:06.165962    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9\": container with ID starting with 34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9 not found: ID does not exist" containerID="34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9"
Jul 16 12:23:06.166026 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.165981    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9"} err="failed to get container status \"34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9\": rpc error: code = NotFound desc = could not find container \"34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9\": container with ID starting with 34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9 not found: ID does not exist"
Jul 16 12:23:06.166026 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.165992    2581 scope.go:117] "RemoveContainer" containerID="414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7"
Jul 16 12:23:06.166211 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:06.166195    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7\": container with ID starting with 414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7 not found: ID does not exist" containerID="414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7"
Jul 16 12:23:06.166276 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.166218    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7"} err="failed to get container status \"414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7\": rpc error: code = NotFound desc = could not find container \"414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7\": container with ID starting with 414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7 not found: ID does not exist"
Jul 16 12:23:06.166276 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.166239    2581 scope.go:117] "RemoveContainer" containerID="1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720"
Jul 16 12:23:06.166470 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.166455    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720"} err="failed to get container status \"1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720\": rpc error: code = NotFound desc = could not find container \"1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720\": container with ID starting with 1619b91e1d1d2589d17b78b729f384bceb41e2077669fea269038e1f69177720 not found: ID does not exist"
Jul 16 12:23:06.166470 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.166469    2581 scope.go:117] "RemoveContainer" containerID="c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0"
Jul 16 12:23:06.166650 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.166627    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0"} err="failed to get container status \"c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0\": rpc error: code = NotFound desc = could not find container \"c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0\": container with ID starting with c947eab0a3a5eff75980fa9e0dafdf77e250c3a07e547ba47f0c535d2e6d45c0 not found: ID does not exist"
Jul 16 12:23:06.166650 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.166647    2581 scope.go:117] "RemoveContainer" containerID="8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1"
Jul 16 12:23:06.166857 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.166842    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1"} err="failed to get container status \"8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1\": rpc error: code = NotFound desc = could not find container \"8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1\": container with ID starting with 8899d248a1689e2ca8c608c29dc88c964515d8ccc10b8d72ad90e41236075ff1 not found: ID does not exist"
Jul 16 12:23:06.166903 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.166857    2581 scope.go:117] "RemoveContainer" containerID="034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a"
Jul 16 12:23:06.167043 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.167029    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a"} err="failed to get container status \"034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a\": rpc error: code = NotFound desc = could not find container \"034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a\": container with ID starting with 034aa898c02b776b9c609fe269d770f223a11910d6ac8307514d234575b73f7a not found: ID does not exist"
Jul 16 12:23:06.167043 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.167042    2581 scope.go:117] "RemoveContainer" containerID="2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384"
Jul 16 12:23:06.167214 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.167200    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384"} err="failed to get container status \"2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384\": rpc error: code = NotFound desc = could not find container \"2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384\": container with ID starting with 2a38b7244fea1b229067e3a1646c00a78c3a1cab164848b3c76a0f4ae95a5384 not found: ID does not exist"
Jul 16 12:23:06.167264 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.167215    2581 scope.go:117] "RemoveContainer" containerID="34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9"
Jul 16 12:23:06.167411 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.167396    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9"} err="failed to get container status \"34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9\": rpc error: code = NotFound desc = could not find container \"34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9\": container with ID starting with 34a1c0270df7658dc9075cd2b410036053d36b5795a2dde785c3694466dc47a9 not found: ID does not exist"
Jul 16 12:23:06.167464 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.167411    2581 scope.go:117] "RemoveContainer" containerID="414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7"
Jul 16 12:23:06.167599 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.167580    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7"} err="failed to get container status \"414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7\": rpc error: code = NotFound desc = could not find container \"414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7\": container with ID starting with 414327f5bffb081c3be42e8723d365cabeaba7c4dbc430edc40e26368062afb7 not found: ID does not exist"
Jul 16 12:23:06.184975 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.184950    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:23:06.185276 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185260    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="kube-rbac-proxy"
Jul 16 12:23:06.185384 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185279    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="kube-rbac-proxy"
Jul 16 12:23:06.185384 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185291    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="prom-label-proxy"
Jul 16 12:23:06.185384 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185299    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="prom-label-proxy"
Jul 16 12:23:06.185384 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185313    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="alertmanager"
Jul 16 12:23:06.185384 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185322    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="alertmanager"
Jul 16 12:23:06.185384 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185333    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="init-config-reloader"
Jul 16 12:23:06.185384 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185342    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="init-config-reloader"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185396    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f666a519-c2c3-4b2a-9378-4d981947936b" containerName="console"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185404    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f666a519-c2c3-4b2a-9378-4d981947936b" containerName="console"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185415    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="kube-rbac-proxy-web"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185424    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="kube-rbac-proxy-web"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185435    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="kube-rbac-proxy-metric"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185443    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="kube-rbac-proxy-metric"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185465    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="config-reloader"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185473    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="config-reloader"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185541    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="kube-rbac-proxy"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185554    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="prom-label-proxy"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185563    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="kube-rbac-proxy-web"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185572    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f666a519-c2c3-4b2a-9378-4d981947936b" containerName="console"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185581    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="kube-rbac-proxy-metric"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185591    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="config-reloader"
Jul 16 12:23:06.185714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.185601    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" containerName="alertmanager"
Jul 16 12:23:06.189989 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.189970    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.192490 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.192471    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 16 12:23:06.192985 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.192958    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-54rzf\""
Jul 16 12:23:06.192985 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.192972    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 16 12:23:06.193133 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.192984    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 16 12:23:06.193133 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.192993    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 16 12:23:06.193133 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.193022    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 16 12:23:06.193133 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.192958    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 16 12:23:06.193133 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.193023    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 16 12:23:06.193335 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.193142    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 16 12:23:06.198221 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.198206    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 16 12:23:06.201826 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.201808    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:23:06.261078 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.261044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.261233 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.261090    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-config-volume\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.261233 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.261108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c5qc\" (UniqueName: \"kubernetes.io/projected/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-kube-api-access-2c5qc\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.261233 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.261158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.261233 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.261195    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-web-config\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.261233 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.261214    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.261411 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.261259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.261411 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.261275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.261411 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.261297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.261411 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.261320    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.261411 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.261345    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-config-out\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.261411 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.261407    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.261594 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.261439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.362500 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362463    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.362500 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.362725 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.362725 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.362725 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-config-out\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.362725 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.362725 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.362725 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.362725 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-config-volume\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.363048 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c5qc\" (UniqueName: \"kubernetes.io/projected/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-kube-api-access-2c5qc\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.363048 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.363048 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-web-config\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.363048 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.363048 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.362970    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.363818 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.363410    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.363818 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.363534    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.365572 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.365547    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.366123 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.365660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.366123 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.365775    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.366123 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.365775    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.366123 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.365975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-config-out\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.366123 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.365997    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.366416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.366151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-web-config\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.366587 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.366570    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.367404 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.367387    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-config-volume\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.372117 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.372096    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c5qc\" (UniqueName: \"kubernetes.io/projected/1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262-kube-api-access-2c5qc\") pod \"alertmanager-main-0\" (UID: \"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.499275 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.499227    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 12:23:06.642167 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:06.642135    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 12:23:06.645051 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:23:06.645027    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cae8db7_b06c_4d33_bd7f_cc6ea8ab3262.slice/crio-72a4972301a8d282d81d66ebaf2c6ef1f9bd980c13af42da81e0f02f6c953040 WatchSource:0}: Error finding container 72a4972301a8d282d81d66ebaf2c6ef1f9bd980c13af42da81e0f02f6c953040: Status 404 returned error can't find the container with id 72a4972301a8d282d81d66ebaf2c6ef1f9bd980c13af42da81e0f02f6c953040
Jul 16 12:23:07.118571 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:07.118503    2581 generic.go:356] "Generic (PLEG): container finished" podID="1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262" containerID="fb9fde1f3833540536f5613531f636c18fa833e5a58e7a7ece0d32ee2a2e8915" exitCode=0
Jul 16 12:23:07.118571 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:07.118537    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262","Type":"ContainerDied","Data":"fb9fde1f3833540536f5613531f636c18fa833e5a58e7a7ece0d32ee2a2e8915"}
Jul 16 12:23:07.118752 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:07.118602    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262","Type":"ContainerStarted","Data":"72a4972301a8d282d81d66ebaf2c6ef1f9bd980c13af42da81e0f02f6c953040"}
Jul 16 12:23:07.411886 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:07.411736    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c98455eb-6454-47a2-b303-8bb29c3f1db6" path="/var/lib/kubelet/pods/c98455eb-6454-47a2-b303-8bb29c3f1db6/volumes"
Jul 16 12:23:08.126684 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.126650    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262","Type":"ContainerStarted","Data":"2c2c7fbfbad4c84ba6581a274f773476c66897c100dc1ab48b854904c492cec7"}
Jul 16 12:23:08.127053 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.126715    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262","Type":"ContainerStarted","Data":"fc8d7369fc5d7a9ffa0fa02f020691d8f01c58c51ba170d85a86339c87ead89a"}
Jul 16 12:23:08.127053 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.126742    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262","Type":"ContainerStarted","Data":"d4f6660c8257f42775073ddb2aea612aed76eb76efddc227d9bdec991fda8f22"}
Jul 16 12:23:08.127053 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.126767    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262","Type":"ContainerStarted","Data":"01e03e63230166c73d628fb14abe1ba03796d53e0112abb3c34209a8c6ef4eb8"}
Jul 16 12:23:08.127053 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.126792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262","Type":"ContainerStarted","Data":"4cbbd0a3e582dc6642518b54c0de044b5e46032ba0bc3f8f5b8c13b5d06e298d"}
Jul 16 12:23:08.127053 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.126815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262","Type":"ContainerStarted","Data":"39e2c19cc8ac0345fb1eac205c773474f60c9b8e61710ba0ee16a7d42e576498"}
Jul 16 12:23:08.162513 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.162418    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.143513231 podStartE2EDuration="2.162339389s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.826158ms" isStatefulPod=false podCreationTimestamp="2026-07-16 12:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:23:08.161022614 +0000 UTC m=+151.941596690" watchObservedRunningTime="2026-07-16 12:23:08.162339389 +0000 UTC m=+151.942913430"
Jul 16 12:23:08.387930 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.387850    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 12:23:08.388169 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.388141    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="prometheus" containerID="cri-o://997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01" gracePeriod=600
Jul 16 12:23:08.388247 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.388159    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="kube-rbac-proxy-web" containerID="cri-o://a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f" gracePeriod=600
Jul 16 12:23:08.388305 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.388218    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="kube-rbac-proxy" containerID="cri-o://9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4" gracePeriod=600
Jul 16 12:23:08.388305 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.388228    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="config-reloader" containerID="cri-o://a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a" gracePeriod=600
Jul 16 12:23:08.388417 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.388234    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="thanos-sidecar" containerID="cri-o://8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce" gracePeriod=600
Jul 16 12:23:08.388417 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.388150    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6" gracePeriod=600
Jul 16 12:23:08.638859 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.638803    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:08.786202 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786177    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-1\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786202 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786205    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-0\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786478 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786225    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-web-config\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786478 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786252    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-grpc-tls\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786478 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786271    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-trusted-ca-bundle\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786478 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786349    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-kube-rbac-proxy\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786478 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786440    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-serving-certs-ca-bundle\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786478 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786470    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-metrics-client-certs\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786505    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-thanos-prometheus-http-client-file\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786534    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-kubelet-serving-ca-bundle\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786569    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786573    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:23:08.786778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786601    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-tls\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786637    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-db\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786661    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786702    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-metrics-client-ca\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786732    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-config-out\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.786778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786760    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-2\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.787241 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786785    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-config\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.787241 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786810    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v59sw\" (UniqueName: \"kubernetes.io/projected/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-kube-api-access-v59sw\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.787241 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786855    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-tls-assets\") pod \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\" (UID: \"1a8fc74f-b3b7-4c56-be93-778c4f9247f0\") "
Jul 16 12:23:08.787241 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786907    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:23:08.787241 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.786967    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:23:08.787241 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.787128    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.787241 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.787147    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.787583 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.787262    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.787583 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.787320    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:23:08.787829 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.787729    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:23:08.788441 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.788139    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:23:08.788441 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.788314    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:23:08.788758 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.788729    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:08.789149 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.789114    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:23:08.789367 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.789332    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:23:08.789778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.789750    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:08.790650 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.790600    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:08.790747 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.790715    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:08.790921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.790882    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:08.790921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.790894    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-kube-api-access-v59sw" (OuterVolumeSpecName: "kube-api-access-v59sw") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "kube-api-access-v59sw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:23:08.791126 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.790977    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:08.791498 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.791476    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-config" (OuterVolumeSpecName: "config") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:08.791865 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.791845    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:08.791943 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.791912    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-config-out" (OuterVolumeSpecName: "config-out") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:23:08.799632 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.799614    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-web-config" (OuterVolumeSpecName: "web-config") pod "1a8fc74f-b3b7-4c56-be93-778c4f9247f0" (UID: "1a8fc74f-b3b7-4c56-be93-778c4f9247f0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:08.887528 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887509    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887528 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887528    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-web-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887631 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887538    2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-grpc-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887631 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887547    2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-kube-rbac-proxy\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887631 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887557    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887631 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887566    2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-metrics-client-certs\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887631 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887574    2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887631 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887584    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887631 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887592    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887631 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887601    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-db\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887631 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887612    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887631 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887620    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-configmap-metrics-client-ca\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887631 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887631    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-config-out\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887952 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887640    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887952 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887647    2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-config\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887952 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887655    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v59sw\" (UniqueName: \"kubernetes.io/projected/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-kube-api-access-v59sw\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:08.887952 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:08.887664    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a8fc74f-b3b7-4c56-be93-778c4f9247f0-tls-assets\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:23:09.134172 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134147    2581 generic.go:356] "Generic (PLEG): container finished" podID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerID="bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6" exitCode=0
Jul 16 12:23:09.134172 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134171    2581 generic.go:356] "Generic (PLEG): container finished" podID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerID="9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4" exitCode=0
Jul 16 12:23:09.134614 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134181    2581 generic.go:356] "Generic (PLEG): container finished" podID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerID="a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f" exitCode=0
Jul 16 12:23:09.134614 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134188    2581 generic.go:356] "Generic (PLEG): container finished" podID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerID="8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce" exitCode=0
Jul 16 12:23:09.134614 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134196    2581 generic.go:356] "Generic (PLEG): container finished" podID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerID="a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a" exitCode=0
Jul 16 12:23:09.134614 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134204    2581 generic.go:356] "Generic (PLEG): container finished" podID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerID="997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01" exitCode=0
Jul 16 12:23:09.134614 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134224    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerDied","Data":"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"}
Jul 16 12:23:09.134614 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134242    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.134614 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerDied","Data":"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"}
Jul 16 12:23:09.134614 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134383    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerDied","Data":"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"}
Jul 16 12:23:09.134614 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134391    2581 scope.go:117] "RemoveContainer" containerID="bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"
Jul 16 12:23:09.134614 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerDied","Data":"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"}
Jul 16 12:23:09.134614 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134472    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerDied","Data":"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"}
Jul 16 12:23:09.134614 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerDied","Data":"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"}
Jul 16 12:23:09.134614 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.134553    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a8fc74f-b3b7-4c56-be93-778c4f9247f0","Type":"ContainerDied","Data":"e55c3a6f84175a022a534d9e9195e616fca25aff5cccaa9ebd98624a14cec809"}
Jul 16 12:23:09.141533 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.141511    2581 scope.go:117] "RemoveContainer" containerID="9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"
Jul 16 12:23:09.148205 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.148186    2581 scope.go:117] "RemoveContainer" containerID="a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"
Jul 16 12:23:09.154857 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.154842    2581 scope.go:117] "RemoveContainer" containerID="8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"
Jul 16 12:23:09.160022 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.160003    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 12:23:09.161634 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.161619    2581 scope.go:117] "RemoveContainer" containerID="a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"
Jul 16 12:23:09.168820 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.168792    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 12:23:09.171012 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.170993    2581 scope.go:117] "RemoveContainer" containerID="997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"
Jul 16 12:23:09.177669 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.177654    2581 scope.go:117] "RemoveContainer" containerID="1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"
Jul 16 12:23:09.183915 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.183901    2581 scope.go:117] "RemoveContainer" containerID="bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"
Jul 16 12:23:09.184136 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:09.184121    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6\": container with ID starting with bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6 not found: ID does not exist" containerID="bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"
Jul 16 12:23:09.184192 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.184142    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"} err="failed to get container status \"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6\": rpc error: code = NotFound desc = could not find container \"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6\": container with ID starting with bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6 not found: ID does not exist"
Jul 16 12:23:09.184192 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.184158    2581 scope.go:117] "RemoveContainer" containerID="9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"
Jul 16 12:23:09.184473 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:09.184456    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4\": container with ID starting with 9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4 not found: ID does not exist" containerID="9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"
Jul 16 12:23:09.184516 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.184478    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"} err="failed to get container status \"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4\": rpc error: code = NotFound desc = could not find container \"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4\": container with ID starting with 9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4 not found: ID does not exist"
Jul 16 12:23:09.184516 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.184493    2581 scope.go:117] "RemoveContainer" containerID="a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"
Jul 16 12:23:09.184723 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:09.184706    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f\": container with ID starting with a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f not found: ID does not exist" containerID="a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"
Jul 16 12:23:09.184766 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.184724    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"} err="failed to get container status \"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f\": rpc error: code = NotFound desc = could not find container \"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f\": container with ID starting with a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f not found: ID does not exist"
Jul 16 12:23:09.184766 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.184738    2581 scope.go:117] "RemoveContainer" containerID="8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"
Jul 16 12:23:09.184954 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:09.184938    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce\": container with ID starting with 8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce not found: ID does not exist" containerID="8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"
Jul 16 12:23:09.184992 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.184959    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"} err="failed to get container status \"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce\": rpc error: code = NotFound desc = could not find container \"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce\": container with ID starting with 8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce not found: ID does not exist"
Jul 16 12:23:09.184992 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.184973    2581 scope.go:117] "RemoveContainer" containerID="a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"
Jul 16 12:23:09.185202 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:09.185187    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a\": container with ID starting with a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a not found: ID does not exist" containerID="a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"
Jul 16 12:23:09.185240 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.185207    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"} err="failed to get container status \"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a\": rpc error: code = NotFound desc = could not find container \"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a\": container with ID starting with a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a not found: ID does not exist"
Jul 16 12:23:09.185240 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.185219    2581 scope.go:117] "RemoveContainer" containerID="997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"
Jul 16 12:23:09.185480 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:09.185461    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01\": container with ID starting with 997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01 not found: ID does not exist" containerID="997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"
Jul 16 12:23:09.185534 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.185485    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"} err="failed to get container status \"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01\": rpc error: code = NotFound desc = could not find container \"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01\": container with ID starting with 997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01 not found: ID does not exist"
Jul 16 12:23:09.185534 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.185500    2581 scope.go:117] "RemoveContainer" containerID="1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"
Jul 16 12:23:09.185727 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:23:09.185709    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397\": container with ID starting with 1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397 not found: ID does not exist" containerID="1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"
Jul 16 12:23:09.185778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.185731    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"} err="failed to get container status \"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397\": rpc error: code = NotFound desc = could not find container \"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397\": container with ID starting with 1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397 not found: ID does not exist"
Jul 16 12:23:09.185778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.185745    2581 scope.go:117] "RemoveContainer" containerID="bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"
Jul 16 12:23:09.185945 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.185929    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"} err="failed to get container status \"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6\": rpc error: code = NotFound desc = could not find container \"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6\": container with ID starting with bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6 not found: ID does not exist"
Jul 16 12:23:09.185985 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.185945    2581 scope.go:117] "RemoveContainer" containerID="9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"
Jul 16 12:23:09.186143 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.186129    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"} err="failed to get container status \"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4\": rpc error: code = NotFound desc = could not find container \"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4\": container with ID starting with 9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4 not found: ID does not exist"
Jul 16 12:23:09.186185 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.186144    2581 scope.go:117] "RemoveContainer" containerID="a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"
Jul 16 12:23:09.186326 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.186311    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"} err="failed to get container status \"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f\": rpc error: code = NotFound desc = could not find container \"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f\": container with ID starting with a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f not found: ID does not exist"
Jul 16 12:23:09.186326 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.186325    2581 scope.go:117] "RemoveContainer" containerID="8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"
Jul 16 12:23:09.186535 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.186520    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"} err="failed to get container status \"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce\": rpc error: code = NotFound desc = could not find container \"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce\": container with ID starting with 8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce not found: ID does not exist"
Jul 16 12:23:09.186578 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.186534    2581 scope.go:117] "RemoveContainer" containerID="a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"
Jul 16 12:23:09.186719 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.186697    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"} err="failed to get container status \"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a\": rpc error: code = NotFound desc = could not find container \"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a\": container with ID starting with a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a not found: ID does not exist"
Jul 16 12:23:09.186796 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.186719    2581 scope.go:117] "RemoveContainer" containerID="997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"
Jul 16 12:23:09.186944 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.186924    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"} err="failed to get container status \"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01\": rpc error: code = NotFound desc = could not find container \"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01\": container with ID starting with 997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01 not found: ID does not exist"
Jul 16 12:23:09.186944 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.186942    2581 scope.go:117] "RemoveContainer" containerID="1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"
Jul 16 12:23:09.187338 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.187316    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"} err="failed to get container status \"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397\": rpc error: code = NotFound desc = could not find container \"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397\": container with ID starting with 1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397 not found: ID does not exist"
Jul 16 12:23:09.187338 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.187337    2581 scope.go:117] "RemoveContainer" containerID="bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"
Jul 16 12:23:09.187620 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.187598    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"} err="failed to get container status \"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6\": rpc error: code = NotFound desc = could not find container \"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6\": container with ID starting with bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6 not found: ID does not exist"
Jul 16 12:23:09.187677 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.187623    2581 scope.go:117] "RemoveContainer" containerID="9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"
Jul 16 12:23:09.187883 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.187863    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"} err="failed to get container status \"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4\": rpc error: code = NotFound desc = could not find container \"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4\": container with ID starting with 9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4 not found: ID does not exist"
Jul 16 12:23:09.187924 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.187884    2581 scope.go:117] "RemoveContainer" containerID="a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"
Jul 16 12:23:09.188091 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.188076    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"} err="failed to get container status \"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f\": rpc error: code = NotFound desc = could not find container \"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f\": container with ID starting with a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f not found: ID does not exist"
Jul 16 12:23:09.188132 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.188092    2581 scope.go:117] "RemoveContainer" containerID="8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"
Jul 16 12:23:09.188280 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.188258    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"} err="failed to get container status \"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce\": rpc error: code = NotFound desc = could not find container \"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce\": container with ID starting with 8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce not found: ID does not exist"
Jul 16 12:23:09.188280 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.188278    2581 scope.go:117] "RemoveContainer" containerID="a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"
Jul 16 12:23:09.188567 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.188546    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"} err="failed to get container status \"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a\": rpc error: code = NotFound desc = could not find container \"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a\": container with ID starting with a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a not found: ID does not exist"
Jul 16 12:23:09.188567 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.188567    2581 scope.go:117] "RemoveContainer" containerID="997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"
Jul 16 12:23:09.188786 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.188768    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"} err="failed to get container status \"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01\": rpc error: code = NotFound desc = could not find container \"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01\": container with ID starting with 997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01 not found: ID does not exist"
Jul 16 12:23:09.188838 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.188787    2581 scope.go:117] "RemoveContainer" containerID="1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"
Jul 16 12:23:09.188994 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.188977    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"} err="failed to get container status \"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397\": rpc error: code = NotFound desc = could not find container \"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397\": container with ID starting with 1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397 not found: ID does not exist"
Jul 16 12:23:09.189037 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.188995    2581 scope.go:117] "RemoveContainer" containerID="bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"
Jul 16 12:23:09.189204 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.189186    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"} err="failed to get container status \"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6\": rpc error: code = NotFound desc = could not find container \"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6\": container with ID starting with bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6 not found: ID does not exist"
Jul 16 12:23:09.189280 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.189205    2581 scope.go:117] "RemoveContainer" containerID="9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"
Jul 16 12:23:09.189454 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.189438    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"} err="failed to get container status \"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4\": rpc error: code = NotFound desc = could not find container \"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4\": container with ID starting with 9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4 not found: ID does not exist"
Jul 16 12:23:09.189510 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.189454    2581 scope.go:117] "RemoveContainer" containerID="a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"
Jul 16 12:23:09.189667 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.189648    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"} err="failed to get container status \"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f\": rpc error: code = NotFound desc = could not find container \"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f\": container with ID starting with a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f not found: ID does not exist"
Jul 16 12:23:09.189667 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.189664    2581 scope.go:117] "RemoveContainer" containerID="8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"
Jul 16 12:23:09.189878 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.189855    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"} err="failed to get container status \"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce\": rpc error: code = NotFound desc = could not find container \"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce\": container with ID starting with 8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce not found: ID does not exist"
Jul 16 12:23:09.189942 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.189879    2581 scope.go:117] "RemoveContainer" containerID="a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"
Jul 16 12:23:09.190078 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.190063    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"} err="failed to get container status \"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a\": rpc error: code = NotFound desc = could not find container \"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a\": container with ID starting with a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a not found: ID does not exist"
Jul 16 12:23:09.190126 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.190078    2581 scope.go:117] "RemoveContainer" containerID="997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"
Jul 16 12:23:09.190277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.190260    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"} err="failed to get container status \"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01\": rpc error: code = NotFound desc = could not find container \"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01\": container with ID starting with 997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01 not found: ID does not exist"
Jul 16 12:23:09.190340 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.190278    2581 scope.go:117] "RemoveContainer" containerID="1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"
Jul 16 12:23:09.190529 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.190509    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"} err="failed to get container status \"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397\": rpc error: code = NotFound desc = could not find container \"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397\": container with ID starting with 1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397 not found: ID does not exist"
Jul 16 12:23:09.190569 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.190530    2581 scope.go:117] "RemoveContainer" containerID="bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"
Jul 16 12:23:09.190719 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.190703    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"} err="failed to get container status \"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6\": rpc error: code = NotFound desc = could not find container \"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6\": container with ID starting with bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6 not found: ID does not exist"
Jul 16 12:23:09.190761 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.190719    2581 scope.go:117] "RemoveContainer" containerID="9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"
Jul 16 12:23:09.190900 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.190885    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"} err="failed to get container status \"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4\": rpc error: code = NotFound desc = could not find container \"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4\": container with ID starting with 9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4 not found: ID does not exist"
Jul 16 12:23:09.190900 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.190900    2581 scope.go:117] "RemoveContainer" containerID="a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"
Jul 16 12:23:09.191117 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.191100    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"} err="failed to get container status \"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f\": rpc error: code = NotFound desc = could not find container \"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f\": container with ID starting with a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f not found: ID does not exist"
Jul 16 12:23:09.191184 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.191118    2581 scope.go:117] "RemoveContainer" containerID="8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"
Jul 16 12:23:09.191312 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.191297    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"} err="failed to get container status \"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce\": rpc error: code = NotFound desc = could not find container \"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce\": container with ID starting with 8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce not found: ID does not exist"
Jul 16 12:23:09.191425 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.191315    2581 scope.go:117] "RemoveContainer" containerID="a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"
Jul 16 12:23:09.191532 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.191516    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"} err="failed to get container status \"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a\": rpc error: code = NotFound desc = could not find container \"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a\": container with ID starting with a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a not found: ID does not exist"
Jul 16 12:23:09.191599 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.191534    2581 scope.go:117] "RemoveContainer" containerID="997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"
Jul 16 12:23:09.191756 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.191731    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"} err="failed to get container status \"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01\": rpc error: code = NotFound desc = could not find container \"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01\": container with ID starting with 997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01 not found: ID does not exist"
Jul 16 12:23:09.191756 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.191753    2581 scope.go:117] "RemoveContainer" containerID="1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"
Jul 16 12:23:09.191952 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.191936    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"} err="failed to get container status \"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397\": rpc error: code = NotFound desc = could not find container \"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397\": container with ID starting with 1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397 not found: ID does not exist"
Jul 16 12:23:09.192010 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.191953    2581 scope.go:117] "RemoveContainer" containerID="bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"
Jul 16 12:23:09.192179 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.192163    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6"} err="failed to get container status \"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6\": rpc error: code = NotFound desc = could not find container \"bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6\": container with ID starting with bc458d35deaa570a4683d43866f5e5963727d88f10c5cab88b429955c72dd7a6 not found: ID does not exist"
Jul 16 12:23:09.192242 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.192179    2581 scope.go:117] "RemoveContainer" containerID="9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"
Jul 16 12:23:09.192347 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.192331    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4"} err="failed to get container status \"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4\": rpc error: code = NotFound desc = could not find container \"9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4\": container with ID starting with 9b059b36460e1415431d808e94621f108a2d0fac922b2dc109d66efca49083d4 not found: ID does not exist"
Jul 16 12:23:09.192425 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.192348    2581 scope.go:117] "RemoveContainer" containerID="a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"
Jul 16 12:23:09.192547 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.192531    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f"} err="failed to get container status \"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f\": rpc error: code = NotFound desc = could not find container \"a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f\": container with ID starting with a91b755fd736be4c408f1475303709af28fd97605fc3ddb56132098bebc2416f not found: ID does not exist"
Jul 16 12:23:09.192602 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.192548    2581 scope.go:117] "RemoveContainer" containerID="8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"
Jul 16 12:23:09.192790 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.192767    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce"} err="failed to get container status \"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce\": rpc error: code = NotFound desc = could not find container \"8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce\": container with ID starting with 8fa4dafbc0c35c1ca656e52248587f683b0719afa3a1120d25674bc0dc3a94ce not found: ID does not exist"
Jul 16 12:23:09.192836 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.192792    2581 scope.go:117] "RemoveContainer" containerID="a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"
Jul 16 12:23:09.192986 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.192968    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a"} err="failed to get container status \"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a\": rpc error: code = NotFound desc = could not find container \"a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a\": container with ID starting with a86240ac209d9edc65527c0292311ab3eb240af7e8681bea782372162d87545a not found: ID does not exist"
Jul 16 12:23:09.193035 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.192988    2581 scope.go:117] "RemoveContainer" containerID="997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"
Jul 16 12:23:09.193202 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.193185    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01"} err="failed to get container status \"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01\": rpc error: code = NotFound desc = could not find container \"997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01\": container with ID starting with 997d42446fb81a01e7b7b4aa3b976d794f77ac41f25cd5a33e1d40cc7c529b01 not found: ID does not exist"
Jul 16 12:23:09.193202 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.193201    2581 scope.go:117] "RemoveContainer" containerID="1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"
Jul 16 12:23:09.193421 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.193393    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397"} err="failed to get container status \"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397\": rpc error: code = NotFound desc = could not find container \"1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397\": container with ID starting with 1d278c5ed6439fd4aa2249023002e8e7e838df05e140d331d564ad45d7369397 not found: ID does not exist"
Jul 16 12:23:09.197630 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197609    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 12:23:09.197875 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197864    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="kube-rbac-proxy"
Jul 16 12:23:09.197925 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197876    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="kube-rbac-proxy"
Jul 16 12:23:09.197925 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197888    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="thanos-sidecar"
Jul 16 12:23:09.197925 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197893    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="thanos-sidecar"
Jul 16 12:23:09.197925 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197901    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="kube-rbac-proxy-web"
Jul 16 12:23:09.197925 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197907    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="kube-rbac-proxy-web"
Jul 16 12:23:09.197925 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197922    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="init-config-reloader"
Jul 16 12:23:09.197925 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197927    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="init-config-reloader"
Jul 16 12:23:09.198138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197934    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="prometheus"
Jul 16 12:23:09.198138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197939    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="prometheus"
Jul 16 12:23:09.198138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197944    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="kube-rbac-proxy-thanos"
Jul 16 12:23:09.198138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197949    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="kube-rbac-proxy-thanos"
Jul 16 12:23:09.198138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197954    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="config-reloader"
Jul 16 12:23:09.198138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197959    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="config-reloader"
Jul 16 12:23:09.198138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.197997    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="kube-rbac-proxy-web"
Jul 16 12:23:09.198138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.198004    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="config-reloader"
Jul 16 12:23:09.198138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.198011    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="prometheus"
Jul 16 12:23:09.198138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.198018    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="thanos-sidecar"
Jul 16 12:23:09.198138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.198023    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="kube-rbac-proxy-thanos"
Jul 16 12:23:09.198138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.198028    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" containerName="kube-rbac-proxy"
Jul 16 12:23:09.201983 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.201963    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.204600 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.204567    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 16 12:23:09.204749 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.204718    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 16 12:23:09.204805 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.204765    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 16 12:23:09.205013 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.204998    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 12:23:09.205068 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.205028    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 16 12:23:09.205068 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.205042    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cbemav8nbte7\""
Jul 16 12:23:09.205164 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.205149    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 16 12:23:09.205244 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.205230    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 16 12:23:09.205414 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.205392    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-k68sd\""
Jul 16 12:23:09.205498 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.205423    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 16 12:23:09.205498 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.205443    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 16 12:23:09.205498 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.205398    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 16 12:23:09.205498 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.205464    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 16 12:23:09.205673 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.205507    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 16 12:23:09.208029 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.208003    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 16 12:23:09.210341 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.210323    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 16 12:23:09.213607 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.213592    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 16 12:23:09.219301 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.219282    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 12:23:09.290947 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.290927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/174c2dca-87be-44e4-aaba-9dd39aa728b1-config-out\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291044 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.290979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291113 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-config\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291169 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291238 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291311 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291294    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291346 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291317    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291346 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291428 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/174c2dca-87be-44e4-aaba-9dd39aa728b1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291428 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291403    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291497 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291483    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291530 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291570 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291606 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291645 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291605    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-web-config\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291645 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291645 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291749 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291658    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fllr\" (UniqueName: \"kubernetes.io/projected/174c2dca-87be-44e4-aaba-9dd39aa728b1-kube-api-access-2fllr\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.291749 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.291704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.392459 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.392459 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392439    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/174c2dca-87be-44e4-aaba-9dd39aa728b1-config-out\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.392459 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.392678 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392496    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-config\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.392678 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.392678 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.392678 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392567    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.392678 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.392678 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.392678 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.392678 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392658    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/174c2dca-87be-44e4-aaba-9dd39aa728b1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.393047 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.393047 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.393047 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.393047 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.393047 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.393047 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-web-config\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.393047 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.393047 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392894    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.393047 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.392926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fllr\" (UniqueName: \"kubernetes.io/projected/174c2dca-87be-44e4-aaba-9dd39aa728b1-kube-api-access-2fllr\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.393047 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.393032    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.393560 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.393220    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.396479 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.395444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-config\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.396479 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.395500    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/174c2dca-87be-44e4-aaba-9dd39aa728b1-config-out\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.396479 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.395552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.396479 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.395789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.396479 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.395851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.396479 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.395863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.396479 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.395966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-web-config\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.396479 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.396080    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.396479 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.396126    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.396479 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.396417    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.397046 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.396694    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.397046 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.396818    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.397046 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.396993    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/174c2dca-87be-44e4-aaba-9dd39aa728b1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.397947 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.397921    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.398059 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.398042    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.398132 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.398117    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/174c2dca-87be-44e4-aaba-9dd39aa728b1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.398434 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.398415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/174c2dca-87be-44e4-aaba-9dd39aa728b1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.403446 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.403429    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fllr\" (UniqueName: \"kubernetes.io/projected/174c2dca-87be-44e4-aaba-9dd39aa728b1-kube-api-access-2fllr\") pod \"prometheus-k8s-0\" (UID: \"174c2dca-87be-44e4-aaba-9dd39aa728b1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.412252 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.412231    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a8fc74f-b3b7-4c56-be93-778c4f9247f0" path="/var/lib/kubelet/pods/1a8fc74f-b3b7-4c56-be93-778c4f9247f0/volumes"
Jul 16 12:23:09.512811 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.512788    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:09.645624 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:09.645601    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 12:23:09.647958 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:23:09.647930    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod174c2dca_87be_44e4_aaba_9dd39aa728b1.slice/crio-1b96d0b69d90345d9e8ff71a11e073ade144d28a846639b1fb3f22370cea478a WatchSource:0}: Error finding container 1b96d0b69d90345d9e8ff71a11e073ade144d28a846639b1fb3f22370cea478a: Status 404 returned error can't find the container with id 1b96d0b69d90345d9e8ff71a11e073ade144d28a846639b1fb3f22370cea478a
Jul 16 12:23:10.141327 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:10.141295    2581 generic.go:356] "Generic (PLEG): container finished" podID="174c2dca-87be-44e4-aaba-9dd39aa728b1" containerID="7e840d3fd53e77ef8f8f56ab696847d56c1e1614a95e9683cc4794efe7485e0a" exitCode=0
Jul 16 12:23:10.141767 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:10.141386    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"174c2dca-87be-44e4-aaba-9dd39aa728b1","Type":"ContainerDied","Data":"7e840d3fd53e77ef8f8f56ab696847d56c1e1614a95e9683cc4794efe7485e0a"}
Jul 16 12:23:10.141767 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:10.141485    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"174c2dca-87be-44e4-aaba-9dd39aa728b1","Type":"ContainerStarted","Data":"1b96d0b69d90345d9e8ff71a11e073ade144d28a846639b1fb3f22370cea478a"}
Jul 16 12:23:11.149089 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:11.149051    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"174c2dca-87be-44e4-aaba-9dd39aa728b1","Type":"ContainerStarted","Data":"cb00fefa0dcab9a453f5ec1ca8a9293a20eee6c28cb6806a857d6d5ffbc527f8"}
Jul 16 12:23:11.149509 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:11.149146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"174c2dca-87be-44e4-aaba-9dd39aa728b1","Type":"ContainerStarted","Data":"8356079838b3da12ee97227de4d14a167414168e6f970b5e03c41adc1cef5a0d"}
Jul 16 12:23:11.149509 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:11.149179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"174c2dca-87be-44e4-aaba-9dd39aa728b1","Type":"ContainerStarted","Data":"2f3ecd81cea5d8e63fdf2d6ea7260bbdf66dde605e5424c0c3dd9837a4016dbe"}
Jul 16 12:23:11.149509 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:11.149221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"174c2dca-87be-44e4-aaba-9dd39aa728b1","Type":"ContainerStarted","Data":"c02344aebdefd5dea1f8f5af02c5931b9536e467cf8680754df528a74013368f"}
Jul 16 12:23:11.149509 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:11.149249    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"174c2dca-87be-44e4-aaba-9dd39aa728b1","Type":"ContainerStarted","Data":"871b6022e4a935a9a97846d4041841aeb8122f8a28f2a55cdb5a2215e1eab999"}
Jul 16 12:23:11.149509 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:11.149273    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"174c2dca-87be-44e4-aaba-9dd39aa728b1","Type":"ContainerStarted","Data":"f00cdc9a24d1dc5b14c12c42318798541ce2b6bbe02de5790cd8c466863e8122"}
Jul 16 12:23:11.182531 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:11.182475    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.161656514 podStartE2EDuration="2.182455674s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.79916ms" isStatefulPod=false podCreationTimestamp="2026-07-16 12:23:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:23:11.181511862 +0000 UTC m=+154.962085905" watchObservedRunningTime="2026-07-16 12:23:11.182455674 +0000 UTC m=+154.963029713"
Jul 16 12:23:11.784558 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:11.784524    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:11.845236 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:11.845205    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:12.933911 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:12.933870    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:13.034959 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:13.034911    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:14.513451 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:14.513410    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:23:21.471685 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:21.471632    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:21.571128 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:21.571081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:23.458756 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:23.458728    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:23.560730 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:23.560700    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:23.660837 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:23.660806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:30.505668 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:30.505578    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:30.605155 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:30.605121    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:58.062700 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:23:58.062665    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:05.479068 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:05.479031    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:05.587588 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:05.587557    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:09.513204 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:09.513157    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:24:09.528267 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:09.528231    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:24:10.398218 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:10.398193    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 12:24:39.588800 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:39.588766    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:40.354426 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:40.354394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:43.187907 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:43.187873    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:43.290260 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:43.290232    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:44.133397 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:44.133352    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:44.237887 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:44.237855    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:45.194646 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:45.194614    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:45.300436 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:45.300413    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:47.314750 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.314693    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:47.468145 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.468113    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc"]
Jul 16 12:24:47.471196 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.471177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc"
Jul 16 12:24:47.474038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.474018    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 16 12:24:47.474136 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.474075    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-d2hmh\""
Jul 16 12:24:47.474844 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.474829    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 16 12:24:47.486849 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.486826    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc"]
Jul 16 12:24:47.624618 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.624533    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:47.639067 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.639047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz8v2\" (UniqueName: \"kubernetes.io/projected/1942870c-6988-4c6a-a0b9-0306a7927995-kube-api-access-qz8v2\") pod \"cert-manager-cainjector-559cdd8c87-2m9zc\" (UID: \"1942870c-6988-4c6a-a0b9-0306a7927995\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc"
Jul 16 12:24:47.639159 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.639084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1942870c-6988-4c6a-a0b9-0306a7927995-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2m9zc\" (UID: \"1942870c-6988-4c6a-a0b9-0306a7927995\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc"
Jul 16 12:24:47.739798 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.739766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1942870c-6988-4c6a-a0b9-0306a7927995-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2m9zc\" (UID: \"1942870c-6988-4c6a-a0b9-0306a7927995\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc"
Jul 16 12:24:47.739899 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.739848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz8v2\" (UniqueName: \"kubernetes.io/projected/1942870c-6988-4c6a-a0b9-0306a7927995-kube-api-access-qz8v2\") pod \"cert-manager-cainjector-559cdd8c87-2m9zc\" (UID: \"1942870c-6988-4c6a-a0b9-0306a7927995\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc"
Jul 16 12:24:47.749181 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.749152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz8v2\" (UniqueName: \"kubernetes.io/projected/1942870c-6988-4c6a-a0b9-0306a7927995-kube-api-access-qz8v2\") pod \"cert-manager-cainjector-559cdd8c87-2m9zc\" (UID: \"1942870c-6988-4c6a-a0b9-0306a7927995\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc"
Jul 16 12:24:47.749511 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.749493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1942870c-6988-4c6a-a0b9-0306a7927995-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2m9zc\" (UID: \"1942870c-6988-4c6a-a0b9-0306a7927995\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc"
Jul 16 12:24:47.790659 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.790624    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc"
Jul 16 12:24:47.917161 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:47.917139    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc"]
Jul 16 12:24:47.919000 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:24:47.918975    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1942870c_6988_4c6a_a0b9_0306a7927995.slice/crio-4a88e4a848dba5ca0f42c6eecd492e9202465ce6c3d36e7cd2be76745bf1858b WatchSource:0}: Error finding container 4a88e4a848dba5ca0f42c6eecd492e9202465ce6c3d36e7cd2be76745bf1858b: Status 404 returned error can't find the container with id 4a88e4a848dba5ca0f42c6eecd492e9202465ce6c3d36e7cd2be76745bf1858b
Jul 16 12:24:48.516638 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:48.516604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc" event={"ID":"1942870c-6988-4c6a-a0b9-0306a7927995","Type":"ContainerStarted","Data":"4a88e4a848dba5ca0f42c6eecd492e9202465ce6c3d36e7cd2be76745bf1858b"}
Jul 16 12:24:49.772112 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:49.772068    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:49.855195 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:49.855161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:51.532655 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:51.532618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc" event={"ID":"1942870c-6988-4c6a-a0b9-0306a7927995","Type":"ContainerStarted","Data":"cf9dd39f9dd71aadb2906271e5f6277478a7b459859abdb19f2847005ed9c2e7"}
Jul 16 12:24:51.549492 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:51.549445    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2m9zc" podStartSLOduration=1.353157227 podStartE2EDuration="4.549428265s" totalImagesPullingTime="3.196271038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:24:51.54859193 +0000 UTC m=+255.329166047" watchObservedRunningTime="2026-07-16 12:24:51.549428265 +0000 UTC m=+255.330002307"
Jul 16 12:24:53.093068 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:53.093028    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:53.193524 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:53.193494    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:55.816610 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:55.816576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:56.970917 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:56.970884    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:57.072692 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:24:57.072658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:00.993077 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:00.992990    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:01.095749 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:01.095721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:07.497176 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:07.497136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:07.599482 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:07.599452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:09.662898 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:09.662869    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:20.414646 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:20.414618    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:21.985226 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:21.985194    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:22.025661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.025634    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"]
Jul 16 12:25:22.031971 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.031954    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.035259 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.035237    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 16 12:25:22.035259 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.035249    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 16 12:25:22.035504 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.035277    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 12:25:22.035504 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.035308    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 16 12:25:22.035504 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.035317    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 12:25:22.035504 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.035373    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-grdmx\""
Jul 16 12:25:22.040495 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.040476    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"]
Jul 16 12:25:22.069850 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.069827    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:22.089650 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.089628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/00556a1a-0844-4882-a0b0-176167190346-metrics-cert\") pod \"lws-controller-manager-698fdd4469-7ks5z\" (UID: \"00556a1a-0844-4882-a0b0-176167190346\") " pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.089749 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.089672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00556a1a-0844-4882-a0b0-176167190346-cert\") pod \"lws-controller-manager-698fdd4469-7ks5z\" (UID: \"00556a1a-0844-4882-a0b0-176167190346\") " pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.089799 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.089767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/00556a1a-0844-4882-a0b0-176167190346-manager-config\") pod \"lws-controller-manager-698fdd4469-7ks5z\" (UID: \"00556a1a-0844-4882-a0b0-176167190346\") " pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.089877 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.089859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wdpv\" (UniqueName: \"kubernetes.io/projected/00556a1a-0844-4882-a0b0-176167190346-kube-api-access-4wdpv\") pod \"lws-controller-manager-698fdd4469-7ks5z\" (UID: \"00556a1a-0844-4882-a0b0-176167190346\") " pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.190787 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.190764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/00556a1a-0844-4882-a0b0-176167190346-manager-config\") pod \"lws-controller-manager-698fdd4469-7ks5z\" (UID: \"00556a1a-0844-4882-a0b0-176167190346\") " pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.190866 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.190800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wdpv\" (UniqueName: \"kubernetes.io/projected/00556a1a-0844-4882-a0b0-176167190346-kube-api-access-4wdpv\") pod \"lws-controller-manager-698fdd4469-7ks5z\" (UID: \"00556a1a-0844-4882-a0b0-176167190346\") " pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.190866 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.190827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/00556a1a-0844-4882-a0b0-176167190346-metrics-cert\") pod \"lws-controller-manager-698fdd4469-7ks5z\" (UID: \"00556a1a-0844-4882-a0b0-176167190346\") " pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.190866 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.190845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00556a1a-0844-4882-a0b0-176167190346-cert\") pod \"lws-controller-manager-698fdd4469-7ks5z\" (UID: \"00556a1a-0844-4882-a0b0-176167190346\") " pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.191371 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.191326    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/00556a1a-0844-4882-a0b0-176167190346-manager-config\") pod \"lws-controller-manager-698fdd4469-7ks5z\" (UID: \"00556a1a-0844-4882-a0b0-176167190346\") " pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.193453 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.193432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/00556a1a-0844-4882-a0b0-176167190346-metrics-cert\") pod \"lws-controller-manager-698fdd4469-7ks5z\" (UID: \"00556a1a-0844-4882-a0b0-176167190346\") " pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.193528 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.193437    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00556a1a-0844-4882-a0b0-176167190346-cert\") pod \"lws-controller-manager-698fdd4469-7ks5z\" (UID: \"00556a1a-0844-4882-a0b0-176167190346\") " pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.199836 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.199807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wdpv\" (UniqueName: \"kubernetes.io/projected/00556a1a-0844-4882-a0b0-176167190346-kube-api-access-4wdpv\") pod \"lws-controller-manager-698fdd4469-7ks5z\" (UID: \"00556a1a-0844-4882-a0b0-176167190346\") " pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.341483 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.341421    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:22.495701 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.495433    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"]
Jul 16 12:25:22.501431 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:25:22.501401    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00556a1a_0844_4882_a0b0_176167190346.slice/crio-826886a87e5cc549019122e9a1d300f375061d00e173dbea3bae1291519fa371 WatchSource:0}: Error finding container 826886a87e5cc549019122e9a1d300f375061d00e173dbea3bae1291519fa371: Status 404 returned error can't find the container with id 826886a87e5cc549019122e9a1d300f375061d00e173dbea3bae1291519fa371
Jul 16 12:25:22.616164 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.616099    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:22.660859 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.660829    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z" event={"ID":"00556a1a-0844-4882-a0b0-176167190346","Type":"ContainerStarted","Data":"826886a87e5cc549019122e9a1d300f375061d00e173dbea3bae1291519fa371"}
Jul 16 12:25:22.709831 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:22.709804    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:22.979642 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:25:22.979609    2581 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" image="registry.redhat.io/leader-worker-set/lws-rhel9@sha256:affb303b1173c273231bb50fef07310b0e220d2f08bfc0aa5912d0825e3e0d4f"
Jul 16 12:25:22.979777 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:25:22.979714    2581 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod lws-controller-manager-698fdd4469-7ks5z_openshift-lws-operator(00556a1a-0844-4882-a0b0-176167190346): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 16 12:25:22.979777 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:25:22.979746    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z" podUID="00556a1a-0844-4882-a0b0-176167190346"
Jul 16 12:25:23.208700 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.208675    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:23.387825 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.387796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:23.494790 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.494763    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:23.541522 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.541500    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"]
Jul 16 12:25:23.546128 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.546110    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.550188 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.550021    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 12:25:23.551068 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.550442    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 12:25:23.551068 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.550652    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 12:25:23.551068 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.550803    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rxvlt\""
Jul 16 12:25:23.551068 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.550952    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 12:25:23.568330 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.568307    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"]
Jul 16 12:25:23.602662 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.602633    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f53e5384-9c1f-4ab1-893a-76c1f393870d-tmp\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.602783 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.602670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f53e5384-9c1f-4ab1-893a-76c1f393870d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.602783 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.602739    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f53e5384-9c1f-4ab1-893a-76c1f393870d-webhook-cert\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.602905 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.602815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftcsx\" (UniqueName: \"kubernetes.io/projected/f53e5384-9c1f-4ab1-893a-76c1f393870d-kube-api-access-ftcsx\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.602905 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.602885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f53e5384-9c1f-4ab1-893a-76c1f393870d-manifests\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.665117 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:25:23.665094    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/leader-worker-set/lws-rhel9@sha256:affb303b1173c273231bb50fef07310b0e220d2f08bfc0aa5912d0825e3e0d4f\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z" podUID="00556a1a-0844-4882-a0b0-176167190346"
Jul 16 12:25:23.703414 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.703389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftcsx\" (UniqueName: \"kubernetes.io/projected/f53e5384-9c1f-4ab1-893a-76c1f393870d-kube-api-access-ftcsx\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.703534 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.703433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f53e5384-9c1f-4ab1-893a-76c1f393870d-manifests\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.703534 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.703518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f53e5384-9c1f-4ab1-893a-76c1f393870d-tmp\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.703652 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.703547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f53e5384-9c1f-4ab1-893a-76c1f393870d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.703652 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.703570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f53e5384-9c1f-4ab1-893a-76c1f393870d-webhook-cert\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.704334 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.704307    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f53e5384-9c1f-4ab1-893a-76c1f393870d-manifests\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.706014 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.705988    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f53e5384-9c1f-4ab1-893a-76c1f393870d-tmp\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.706140 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.706121    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f53e5384-9c1f-4ab1-893a-76c1f393870d-webhook-cert\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.706241 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.706225    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f53e5384-9c1f-4ab1-893a-76c1f393870d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.712489 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.712465    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftcsx\" (UniqueName: \"kubernetes.io/projected/f53e5384-9c1f-4ab1-893a-76c1f393870d-kube-api-access-ftcsx\") pod \"opendatahub-operator-controller-manager-87d97db45-fn2js\" (UID: \"f53e5384-9c1f-4ab1-893a-76c1f393870d\") " pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.749751 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.749733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:23.854602 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.854582    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:23.859581 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.859564    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:23.951763 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.951501    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:23.985335 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:23.985312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"]
Jul 16 12:25:23.987446 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:25:23.987417    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf53e5384_9c1f_4ab1_893a_76c1f393870d.slice/crio-7b5c7c108bfb21d2081792c3a741820d4f609d2d39943968976ab1ac4fc237bb WatchSource:0}: Error finding container 7b5c7c108bfb21d2081792c3a741820d4f609d2d39943968976ab1ac4fc237bb: Status 404 returned error can't find the container with id 7b5c7c108bfb21d2081792c3a741820d4f609d2d39943968976ab1ac4fc237bb
Jul 16 12:25:24.050769 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:24.050746    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:24.151203 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:24.151179    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:24.250619 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:24.250561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:24.358553 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:24.358530    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:24.670025 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:24.669995    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js" event={"ID":"f53e5384-9c1f-4ab1-893a-76c1f393870d","Type":"ContainerStarted","Data":"7b5c7c108bfb21d2081792c3a741820d4f609d2d39943968976ab1ac4fc237bb"}
Jul 16 12:25:27.684227 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:27.684196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js" event={"ID":"f53e5384-9c1f-4ab1-893a-76c1f393870d","Type":"ContainerStarted","Data":"af49db0effb5185d441e3a0a38b19089374290a5b0164dda641bdc32532dc425"}
Jul 16 12:25:28.689035 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:28.689000    2581 generic.go:356] "Generic (PLEG): container finished" podID="f53e5384-9c1f-4ab1-893a-76c1f393870d" containerID="af49db0effb5185d441e3a0a38b19089374290a5b0164dda641bdc32532dc425" exitCode=0
Jul 16 12:25:28.689516 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:28.689052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js" event={"ID":"f53e5384-9c1f-4ab1-893a-76c1f393870d","Type":"ContainerDied","Data":"af49db0effb5185d441e3a0a38b19089374290a5b0164dda641bdc32532dc425"}
Jul 16 12:25:29.696266 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:29.696226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js" event={"ID":"f53e5384-9c1f-4ab1-893a-76c1f393870d","Type":"ContainerStarted","Data":"af2cae4abc6e6bc6b007498dba10194829237f4b55824b86a215d446426dfa26"}
Jul 16 12:25:29.696755 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:29.696386    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:29.719530 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:29.719484    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js" podStartSLOduration=2.117625795 podStartE2EDuration="6.71947087s" totalImagesPullingTime="3.537536828s" totalInitContainerRuntime="1.064308247s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:25:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:25:29.71864918 +0000 UTC m=+293.499223221" watchObservedRunningTime="2026-07-16 12:25:29.71947087 +0000 UTC m=+293.500044912"
Jul 16 12:25:34.739250 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:34.739217    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:34.821040 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:34.821013    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:37.347869 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:37.347840    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:25:37.349012 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:37.348150    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:25:37.350680 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:37.350665    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 12:25:37.729544 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:37.729509    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z" event={"ID":"00556a1a-0844-4882-a0b0-176167190346","Type":"ContainerStarted","Data":"15076feaa55826abb24810b3908d52682493ce0e2dfd9d2bffb4283e61ab25af"}
Jul 16 12:25:37.729756 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:37.729738    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:37.747731 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:37.747692    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z" podStartSLOduration=0.889794893 podStartE2EDuration="15.747678515s" totalImagesPullingTime="14.857883622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:25:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-16 12:25:37.746014388 +0000 UTC m=+301.526588435" watchObservedRunningTime="2026-07-16 12:25:37.747678515 +0000 UTC m=+301.528252556"
Jul 16 12:25:40.702276 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:40.702241    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-87d97db45-fn2js"
Jul 16 12:25:42.884660 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:42.884631    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:42.984399 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:42.984368    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:43.088438 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.088409    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:43.167295 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.167224    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"]
Jul 16 12:25:43.175337 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.175310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"
Jul 16 12:25:43.198967 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.198938    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 12:25:43.205246 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.205223    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 12:25:43.205373 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.205254    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 12:25:43.206235 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.206216    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sgkfp\""
Jul 16 12:25:43.209512 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.209494    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"]
Jul 16 12:25:43.213852 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.213829    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 12:25:43.254280 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.254254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk9qh\" (UniqueName: \"kubernetes.io/projected/7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80-kube-api-access-fk9qh\") pod \"kube-auth-proxy-5f5767f667-d87nt\" (UID: \"7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"
Jul 16 12:25:43.254452 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.254301    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80-tmp\") pod \"kube-auth-proxy-5f5767f667-d87nt\" (UID: \"7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"
Jul 16 12:25:43.254452 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.254418    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80-tls-certs\") pod \"kube-auth-proxy-5f5767f667-d87nt\" (UID: \"7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"
Jul 16 12:25:43.261227 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.261208    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:43.355332 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.355309    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80-tls-certs\") pod \"kube-auth-proxy-5f5767f667-d87nt\" (UID: \"7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"
Jul 16 12:25:43.355459 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.355414    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk9qh\" (UniqueName: \"kubernetes.io/projected/7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80-kube-api-access-fk9qh\") pod \"kube-auth-proxy-5f5767f667-d87nt\" (UID: \"7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"
Jul 16 12:25:43.355459 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.355439    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80-tmp\") pod \"kube-auth-proxy-5f5767f667-d87nt\" (UID: \"7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"
Jul 16 12:25:43.357650 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.357621    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80-tmp\") pod \"kube-auth-proxy-5f5767f667-d87nt\" (UID: \"7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"
Jul 16 12:25:43.357831 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.357816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80-tls-certs\") pod \"kube-auth-proxy-5f5767f667-d87nt\" (UID: \"7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"
Jul 16 12:25:43.366537 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.366508    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk9qh\" (UniqueName: \"kubernetes.io/projected/7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80-kube-api-access-fk9qh\") pod \"kube-auth-proxy-5f5767f667-d87nt\" (UID: \"7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80\") " pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"
Jul 16 12:25:43.486308 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.486224    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"
Jul 16 12:25:43.527620 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.527589    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:43.626850 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.626814    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:43.657249 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.657225    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5767f667-d87nt"]
Jul 16 12:25:43.659317 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:25:43.659289    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4f80cb_d31b_4aac_8ea7_3bb8291e9d80.slice/crio-47737c8964e84f9bb5f34a307683ec8ee9cb859ed34df9ae08fd3d2a11ccd043 WatchSource:0}: Error finding container 47737c8964e84f9bb5f34a307683ec8ee9cb859ed34df9ae08fd3d2a11ccd043: Status 404 returned error can't find the container with id 47737c8964e84f9bb5f34a307683ec8ee9cb859ed34df9ae08fd3d2a11ccd043
Jul 16 12:25:43.661496 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.661480    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:25:43.697980 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.697926    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:43.754922 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.754842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt" event={"ID":"7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80","Type":"ContainerStarted","Data":"47737c8964e84f9bb5f34a307683ec8ee9cb859ed34df9ae08fd3d2a11ccd043"}
Jul 16 12:25:43.836001 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:43.835965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:44.084934 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:44.084828    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:44.200256 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:44.200218    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:44.693759 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:44.693712    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:44.787820 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:44.787783    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:45.807011 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:45.806975    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:48.736276 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:48.736238    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-698fdd4469-7ks5z"
Jul 16 12:25:48.779596 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:48.779560    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt" event={"ID":"7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80","Type":"ContainerStarted","Data":"b506a44f73730751c04e6f99971f8ee2a6877c4aa417d1e3eecfb94c3ab0fc9c"}
Jul 16 12:25:48.797921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:48.797871    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f5767f667-d87nt" podStartSLOduration=1.297428176 podStartE2EDuration="5.79785457s" totalImagesPullingTime="4.500426394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:25:48.796053219 +0000 UTC m=+312.576627260" watchObservedRunningTime="2026-07-16 12:25:48.79785457 +0000 UTC m=+312.578428610"
Jul 16 12:25:50.438295 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:50.438263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:50.543183 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:50.543138    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:50.832406 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:50.832307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:51.057156 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:51.057128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:51.181043 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:51.181012    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:53.424571 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.424516    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:53.494109 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.494080    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2"]
Jul 16 12:25:53.500026 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.497827    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2"
Jul 16 12:25:53.500743 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.500700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-kppwh\""
Jul 16 12:25:53.500743 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.500716    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 12:25:53.504506 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.504481    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:53.506330 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.506309    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2"]
Jul 16 12:25:53.642864 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.642836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cac46431-418e-4f57-9324-46daa414627e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-czgq2\" (UID: \"cac46431-418e-4f57-9324-46daa414627e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2"
Jul 16 12:25:53.642987 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.642887    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9qwx\" (UniqueName: \"kubernetes.io/projected/cac46431-418e-4f57-9324-46daa414627e-kube-api-access-r9qwx\") pod \"llmisvc-controller-manager-777c6bd7d5-czgq2\" (UID: \"cac46431-418e-4f57-9324-46daa414627e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2"
Jul 16 12:25:53.653582 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.653560    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:53.744035 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.743959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qwx\" (UniqueName: \"kubernetes.io/projected/cac46431-418e-4f57-9324-46daa414627e-kube-api-access-r9qwx\") pod \"llmisvc-controller-manager-777c6bd7d5-czgq2\" (UID: \"cac46431-418e-4f57-9324-46daa414627e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2"
Jul 16 12:25:53.744173 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.744058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cac46431-418e-4f57-9324-46daa414627e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-czgq2\" (UID: \"cac46431-418e-4f57-9324-46daa414627e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2"
Jul 16 12:25:53.746566 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.746543    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cac46431-418e-4f57-9324-46daa414627e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-czgq2\" (UID: \"cac46431-418e-4f57-9324-46daa414627e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2"
Jul 16 12:25:53.759276 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.759251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9qwx\" (UniqueName: \"kubernetes.io/projected/cac46431-418e-4f57-9324-46daa414627e-kube-api-access-r9qwx\") pod \"llmisvc-controller-manager-777c6bd7d5-czgq2\" (UID: \"cac46431-418e-4f57-9324-46daa414627e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2"
Jul 16 12:25:53.776754 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.776726    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:53.810496 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.810473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2"
Jul 16 12:25:53.942026 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:53.941992    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2"]
Jul 16 12:25:53.945134 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:25:53.945099    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcac46431_418e_4f57_9324_46daa414627e.slice/crio-7415534e5cbc5fb9392fe8aaf0caca3f28da621f289fc320009e3e1c9c3fa3d6 WatchSource:0}: Error finding container 7415534e5cbc5fb9392fe8aaf0caca3f28da621f289fc320009e3e1c9c3fa3d6: Status 404 returned error can't find the container with id 7415534e5cbc5fb9392fe8aaf0caca3f28da621f289fc320009e3e1c9c3fa3d6
Jul 16 12:25:54.704460 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:54.704413    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:54.806181 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:54.806141    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:54.809014 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:54.808978    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2" event={"ID":"cac46431-418e-4f57-9324-46daa414627e","Type":"ContainerStarted","Data":"7415534e5cbc5fb9392fe8aaf0caca3f28da621f289fc320009e3e1c9c3fa3d6"}
Jul 16 12:25:54.905059 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:54.905019    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:56.650809 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:56.650769    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:56.709751 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:56.709721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:57.825641 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:57.825603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2" event={"ID":"cac46431-418e-4f57-9324-46daa414627e","Type":"ContainerStarted","Data":"b4aef03c1f3d62276e75d145a9818673658fb6723890f8f2d110ba474669bb64"}
Jul 16 12:25:57.826054 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:57.825660    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2"
Jul 16 12:25:57.843300 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:25:57.843257    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2" podStartSLOduration=1.872837111 podStartE2EDuration="4.843242615s" totalImagesPullingTime="2.970405504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:25:57.841444144 +0000 UTC m=+321.622018185" watchObservedRunningTime="2026-07-16 12:25:57.843242615 +0000 UTC m=+321.623816708"
Jul 16 12:26:28.831761 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:26:28.831688    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-czgq2"
Jul 16 12:26:44.457061 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:26:44.457020    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:44.557405 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:26:44.557373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:44.659122 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:26:44.659094    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:12.501761 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:12.501726    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:13.588581 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:13.588547    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:13.684764 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:13.684731    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:13.783651 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:13.783627    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:14.332642 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:14.332611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:14.600206 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:14.600127    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:16.549289 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:16.549237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:17.909723 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:17.909696    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:18.304349 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:18.304271    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:19.340927 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:19.340893    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:21.748066 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:21.748017    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:21.935274 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:21.935245    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:23.312798 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:23.312772    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:24.242244 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:24.242219    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:24.371506 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:24.371476    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:24.563986 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:24.563880    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:24.943260 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:24.943235    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8xs6"]
Jul 16 12:27:24.946576 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:24.946558    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8xs6"
Jul 16 12:27:24.948882 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:24.948863    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 16 12:27:24.948999 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:24.948931    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 12:27:24.949712 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:24.949693    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-dk5j9\""
Jul 16 12:27:24.949712 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:24.949705    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 12:27:24.958547 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:24.958525    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8xs6"]
Jul 16 12:27:25.011651 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:25.011630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klswv\" (UniqueName: \"kubernetes.io/projected/592975d7-9cf7-4df3-9ee9-9d2bc873bb3d-kube-api-access-klswv\") pod \"dns-operator-controller-manager-864dd78c4c-z8xs6\" (UID: \"592975d7-9cf7-4df3-9ee9-9d2bc873bb3d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8xs6"
Jul 16 12:27:25.111953 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:25.111931    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klswv\" (UniqueName: \"kubernetes.io/projected/592975d7-9cf7-4df3-9ee9-9d2bc873bb3d-kube-api-access-klswv\") pod \"dns-operator-controller-manager-864dd78c4c-z8xs6\" (UID: \"592975d7-9cf7-4df3-9ee9-9d2bc873bb3d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8xs6"
Jul 16 12:27:25.120126 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:25.120097    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klswv\" (UniqueName: \"kubernetes.io/projected/592975d7-9cf7-4df3-9ee9-9d2bc873bb3d-kube-api-access-klswv\") pod \"dns-operator-controller-manager-864dd78c4c-z8xs6\" (UID: \"592975d7-9cf7-4df3-9ee9-9d2bc873bb3d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8xs6"
Jul 16 12:27:25.257407 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:25.257336    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8xs6"
Jul 16 12:27:25.380548 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:25.380527    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8xs6"]
Jul 16 12:27:25.383320 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:27:25.383146    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592975d7_9cf7_4df3_9ee9_9d2bc873bb3d.slice/crio-3b698cd97f9e1b4c3b5aacf84034a9c1a1498973fd97cc66141ca2f5eeb928fc WatchSource:0}: Error finding container 3b698cd97f9e1b4c3b5aacf84034a9c1a1498973fd97cc66141ca2f5eeb928fc: Status 404 returned error can't find the container with id 3b698cd97f9e1b4c3b5aacf84034a9c1a1498973fd97cc66141ca2f5eeb928fc
Jul 16 12:27:26.218454 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:26.218415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8xs6" event={"ID":"592975d7-9cf7-4df3-9ee9-9d2bc873bb3d","Type":"ContainerStarted","Data":"3b698cd97f9e1b4c3b5aacf84034a9c1a1498973fd97cc66141ca2f5eeb928fc"}
Jul 16 12:27:27.113036 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.113000    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:27.183439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.183404    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:27.500148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.500112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:27.500148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.500140    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"]
Jul 16 12:27:27.504280 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.504252    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"
Jul 16 12:27:27.507028 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.506759    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 16 12:27:27.507028 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.506774    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 16 12:27:27.507028 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.506839    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jrqsj\""
Jul 16 12:27:27.510286 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.510264    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"]
Jul 16 12:27:27.634027 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.634004    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5qbw\" (UniqueName: \"kubernetes.io/projected/de344ce6-c365-4a6e-b3f9-fa6067aa8321-kube-api-access-k5qbw\") pod \"kuadrant-console-plugin-66b5774985-rwk9j\" (UID: \"de344ce6-c365-4a6e-b3f9-fa6067aa8321\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"
Jul 16 12:27:27.634123 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.634034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/de344ce6-c365-4a6e-b3f9-fa6067aa8321-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rwk9j\" (UID: \"de344ce6-c365-4a6e-b3f9-fa6067aa8321\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"
Jul 16 12:27:27.634123 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.634056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de344ce6-c365-4a6e-b3f9-fa6067aa8321-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rwk9j\" (UID: \"de344ce6-c365-4a6e-b3f9-fa6067aa8321\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"
Jul 16 12:27:27.735118 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.735090    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5qbw\" (UniqueName: \"kubernetes.io/projected/de344ce6-c365-4a6e-b3f9-fa6067aa8321-kube-api-access-k5qbw\") pod \"kuadrant-console-plugin-66b5774985-rwk9j\" (UID: \"de344ce6-c365-4a6e-b3f9-fa6067aa8321\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"
Jul 16 12:27:27.735222 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.735121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/de344ce6-c365-4a6e-b3f9-fa6067aa8321-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rwk9j\" (UID: \"de344ce6-c365-4a6e-b3f9-fa6067aa8321\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"
Jul 16 12:27:27.735222 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.735144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de344ce6-c365-4a6e-b3f9-fa6067aa8321-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rwk9j\" (UID: \"de344ce6-c365-4a6e-b3f9-fa6067aa8321\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"
Jul 16 12:27:27.735700 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.735673    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de344ce6-c365-4a6e-b3f9-fa6067aa8321-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rwk9j\" (UID: \"de344ce6-c365-4a6e-b3f9-fa6067aa8321\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"
Jul 16 12:27:27.737269 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.737243    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/de344ce6-c365-4a6e-b3f9-fa6067aa8321-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rwk9j\" (UID: \"de344ce6-c365-4a6e-b3f9-fa6067aa8321\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"
Jul 16 12:27:27.743550 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.743533    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5qbw\" (UniqueName: \"kubernetes.io/projected/de344ce6-c365-4a6e-b3f9-fa6067aa8321-kube-api-access-k5qbw\") pod \"kuadrant-console-plugin-66b5774985-rwk9j\" (UID: \"de344ce6-c365-4a6e-b3f9-fa6067aa8321\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"
Jul 16 12:27:27.798382 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.798314    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:27.816863 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.816841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"
Jul 16 12:27:27.940043 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:27.940022    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j"]
Jul 16 12:27:27.942047 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:27:27.942027    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde344ce6_c365_4a6e_b3f9_fa6067aa8321.slice/crio-0c31bdf43e608cf0846f83629e06268dbaf40a6449a2560c08a2251fcfe72d80 WatchSource:0}: Error finding container 0c31bdf43e608cf0846f83629e06268dbaf40a6449a2560c08a2251fcfe72d80: Status 404 returned error can't find the container with id 0c31bdf43e608cf0846f83629e06268dbaf40a6449a2560c08a2251fcfe72d80
Jul 16 12:27:28.229503 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:28.229465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j" event={"ID":"de344ce6-c365-4a6e-b3f9-fa6067aa8321","Type":"ContainerStarted","Data":"0c31bdf43e608cf0846f83629e06268dbaf40a6449a2560c08a2251fcfe72d80"}
Jul 16 12:27:28.230944 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:28.230924    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8xs6" event={"ID":"592975d7-9cf7-4df3-9ee9-9d2bc873bb3d","Type":"ContainerStarted","Data":"29da0e9a70e6de3480a02c8e964c504a56f5c1db7fde02e9414e639d3d52ca21"}
Jul 16 12:27:28.231075 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:28.231058    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8xs6"
Jul 16 12:27:28.250619 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:28.250581    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8xs6" podStartSLOduration=2.050446269 podStartE2EDuration="4.250568178s" totalImagesPullingTime="2.200121909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:27:28.248887384 +0000 UTC m=+412.029461439" watchObservedRunningTime="2026-07-16 12:27:28.250568178 +0000 UTC m=+412.031142219"
Jul 16 12:27:37.150539 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:37.150501    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:37.253976 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:37.253944    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:39.238463 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:39.238426    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8xs6"
Jul 16 12:27:40.155093 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:40.155053    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:40.245835 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:40.245796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:42.573902 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:42.573814    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:42.639045 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:42.639014    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:48.529103 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:48.529072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:48.629035 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:48.629007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:49.332884 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:49.332852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j" event={"ID":"de344ce6-c365-4a6e-b3f9-fa6067aa8321","Type":"ContainerStarted","Data":"322cb2a88511533fcd99619e4531c907996690d386818f72bc6205933f8a2573"}
Jul 16 12:27:49.348497 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:49.348451    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rwk9j" podStartSLOduration=1.446945456 podStartE2EDuration="22.348434779s" totalImagesPullingTime="20.901489323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:27:49.347746961 +0000 UTC m=+433.128321003" watchObservedRunningTime="2026-07-16 12:27:49.348434779 +0000 UTC m=+433.129008819"
Jul 16 12:27:57.534078 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:57.534049    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:57.634309 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:27:57.634282    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:00.533770 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:00.533687    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:01.179595 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:01.179557    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:02.983248 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:02.983214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:03.083870 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:03.083817    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:07.555652 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:07.555621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:07.763643 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:07.763605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:09.587916 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:09.587881    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:09.697643 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:09.697612    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:09.764868 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:09.764843    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:09.901739 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:09.901718    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:28:09.922574 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:09.922555    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:28:09.922700 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:09.922652    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"
Jul 16 12:28:09.924787 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:09.924768    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 12:28:09.930296 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:09.930272    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:28:09.972955 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:09.972937    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78-config-file\") pod \"limitador-limitador-54d6d988d5-7rnmh\" (UID: \"2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"
Jul 16 12:28:09.973054 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:09.973002    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr5wz\" (UniqueName: \"kubernetes.io/projected/2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78-kube-api-access-wr5wz\") pod \"limitador-limitador-54d6d988d5-7rnmh\" (UID: \"2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"
Jul 16 12:28:10.073326 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.073301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr5wz\" (UniqueName: \"kubernetes.io/projected/2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78-kube-api-access-wr5wz\") pod \"limitador-limitador-54d6d988d5-7rnmh\" (UID: \"2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"
Jul 16 12:28:10.073455 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.073331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78-config-file\") pod \"limitador-limitador-54d6d988d5-7rnmh\" (UID: \"2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"
Jul 16 12:28:10.073919 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.073902    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78-config-file\") pod \"limitador-limitador-54d6d988d5-7rnmh\" (UID: \"2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"
Jul 16 12:28:10.081148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.081120    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr5wz\" (UniqueName: \"kubernetes.io/projected/2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78-kube-api-access-wr5wz\") pod \"limitador-limitador-54d6d988d5-7rnmh\" (UID: \"2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"
Jul 16 12:28:10.233090 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.233044    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"
Jul 16 12:28:10.356140 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.356094    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:28:10.358835 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:28:10.358813    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c508ea9_cb8c_40e5_98b9_1bbc34d2dc78.slice/crio-2e44bbd2e2e09ed2fa988966317df49791129d70d7476c6f42d822c9526fe910 WatchSource:0}: Error finding container 2e44bbd2e2e09ed2fa988966317df49791129d70d7476c6f42d822c9526fe910: Status 404 returned error can't find the container with id 2e44bbd2e2e09ed2fa988966317df49791129d70d7476c6f42d822c9526fe910
Jul 16 12:28:10.427012 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.426987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7rnmh" event={"ID":"2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78","Type":"ContainerStarted","Data":"2e44bbd2e2e09ed2fa988966317df49791129d70d7476c6f42d822c9526fe910"}
Jul 16 12:28:10.451720 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.451697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:10.535379 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.535304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:10.542100 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.542079    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-6g7wn"]
Jul 16 12:28:10.545206 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.545191    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6g7wn"
Jul 16 12:28:10.547215 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.547195    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b5p6x\""
Jul 16 12:28:10.552675 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.552655    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6g7wn"]
Jul 16 12:28:10.679296 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.679270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj8pr\" (UniqueName: \"kubernetes.io/projected/264792c6-218a-4f35-8eba-2d27664e7243-kube-api-access-dj8pr\") pod \"authorino-75d556bd77-6g7wn\" (UID: \"264792c6-218a-4f35-8eba-2d27664e7243\") " pod="kuadrant-system/authorino-75d556bd77-6g7wn"
Jul 16 12:28:10.780624 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.780600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj8pr\" (UniqueName: \"kubernetes.io/projected/264792c6-218a-4f35-8eba-2d27664e7243-kube-api-access-dj8pr\") pod \"authorino-75d556bd77-6g7wn\" (UID: \"264792c6-218a-4f35-8eba-2d27664e7243\") " pod="kuadrant-system/authorino-75d556bd77-6g7wn"
Jul 16 12:28:10.788929 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.788864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj8pr\" (UniqueName: \"kubernetes.io/projected/264792c6-218a-4f35-8eba-2d27664e7243-kube-api-access-dj8pr\") pod \"authorino-75d556bd77-6g7wn\" (UID: \"264792c6-218a-4f35-8eba-2d27664e7243\") " pod="kuadrant-system/authorino-75d556bd77-6g7wn"
Jul 16 12:28:10.805652 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.805631    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:10.855151 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.855132    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6g7wn"
Jul 16 12:28:10.859233 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.859216    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:10.976459 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:10.976435    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6g7wn"]
Jul 16 12:28:10.978905 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:28:10.978882    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod264792c6_218a_4f35_8eba_2d27664e7243.slice/crio-ce309f8aaf9dd74d804947c8cb8ef145d25b379b1bc1073f3ba3b43403fb7a66 WatchSource:0}: Error finding container ce309f8aaf9dd74d804947c8cb8ef145d25b379b1bc1073f3ba3b43403fb7a66: Status 404 returned error can't find the container with id ce309f8aaf9dd74d804947c8cb8ef145d25b379b1bc1073f3ba3b43403fb7a66
Jul 16 12:28:11.432163 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:11.432134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6g7wn" event={"ID":"264792c6-218a-4f35-8eba-2d27664e7243","Type":"ContainerStarted","Data":"ce309f8aaf9dd74d804947c8cb8ef145d25b379b1bc1073f3ba3b43403fb7a66"}
Jul 16 12:28:12.774820 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:12.774789    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:12.838725 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:12.838688    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:16.460463 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:16.460422    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7rnmh" event={"ID":"2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78","Type":"ContainerStarted","Data":"04e463d9af00e0b80c0b0003f1ac40864014b1d5b4508c50abb452cb209a4898"}
Jul 16 12:28:16.460892 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:16.460554    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"
Jul 16 12:28:16.461835 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:16.461816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6g7wn" event={"ID":"264792c6-218a-4f35-8eba-2d27664e7243","Type":"ContainerStarted","Data":"4cd40dc1db29fc147d4f1be4751c9627b3e36d03e8a11e08c01321a3bfa84bb3"}
Jul 16 12:28:16.477920 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:16.477879    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7rnmh" podStartSLOduration=2.347753682 podStartE2EDuration="7.477867576s" totalImagesPullingTime="5.130113894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:28:16.476116179 +0000 UTC m=+460.256690215" watchObservedRunningTime="2026-07-16 12:28:16.477867576 +0000 UTC m=+460.258441617"
Jul 16 12:28:16.491976 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:16.491936    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-6g7wn" podStartSLOduration=2.034120574 podStartE2EDuration="6.491921718s" totalImagesPullingTime="4.457801144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:28:16.490666128 +0000 UTC m=+460.271240169" watchObservedRunningTime="2026-07-16 12:28:16.491921718 +0000 UTC m=+460.272495755"
Jul 16 12:28:27.466051 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:27.466019    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"
Jul 16 12:28:30.921654 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:30.921609    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:31.027638 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:31.027599    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:31.454228 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:31.454181    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:44.904337 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:44.904305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:45.004568 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:45.004543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:46.563831 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:46.563795    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6g7wn"]
Jul 16 12:28:46.564182 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:46.563961    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-6g7wn" podUID="264792c6-218a-4f35-8eba-2d27664e7243" containerName="authorino" containerID="cri-o://4cd40dc1db29fc147d4f1be4751c9627b3e36d03e8a11e08c01321a3bfa84bb3" gracePeriod=30
Jul 16 12:28:46.820745 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:46.820692    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6g7wn"
Jul 16 12:28:46.943267 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:46.943244    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj8pr\" (UniqueName: \"kubernetes.io/projected/264792c6-218a-4f35-8eba-2d27664e7243-kube-api-access-dj8pr\") pod \"264792c6-218a-4f35-8eba-2d27664e7243\" (UID: \"264792c6-218a-4f35-8eba-2d27664e7243\") "
Jul 16 12:28:46.945243 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:46.945218    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/264792c6-218a-4f35-8eba-2d27664e7243-kube-api-access-dj8pr" (OuterVolumeSpecName: "kube-api-access-dj8pr") pod "264792c6-218a-4f35-8eba-2d27664e7243" (UID: "264792c6-218a-4f35-8eba-2d27664e7243"). InnerVolumeSpecName "kube-api-access-dj8pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:28:47.043877 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:47.043858    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj8pr\" (UniqueName: \"kubernetes.io/projected/264792c6-218a-4f35-8eba-2d27664e7243-kube-api-access-dj8pr\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:28:47.587329 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:47.587297    2581 generic.go:356] "Generic (PLEG): container finished" podID="264792c6-218a-4f35-8eba-2d27664e7243" containerID="4cd40dc1db29fc147d4f1be4751c9627b3e36d03e8a11e08c01321a3bfa84bb3" exitCode=0
Jul 16 12:28:47.587329 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:47.587332    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6g7wn"
Jul 16 12:28:47.587744 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:47.587389    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6g7wn" event={"ID":"264792c6-218a-4f35-8eba-2d27664e7243","Type":"ContainerDied","Data":"4cd40dc1db29fc147d4f1be4751c9627b3e36d03e8a11e08c01321a3bfa84bb3"}
Jul 16 12:28:47.587744 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:47.587419    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6g7wn" event={"ID":"264792c6-218a-4f35-8eba-2d27664e7243","Type":"ContainerDied","Data":"ce309f8aaf9dd74d804947c8cb8ef145d25b379b1bc1073f3ba3b43403fb7a66"}
Jul 16 12:28:47.587744 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:47.587434    2581 scope.go:117] "RemoveContainer" containerID="4cd40dc1db29fc147d4f1be4751c9627b3e36d03e8a11e08c01321a3bfa84bb3"
Jul 16 12:28:47.595412 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:47.595394    2581 scope.go:117] "RemoveContainer" containerID="4cd40dc1db29fc147d4f1be4751c9627b3e36d03e8a11e08c01321a3bfa84bb3"
Jul 16 12:28:47.595691 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:28:47.595674    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cd40dc1db29fc147d4f1be4751c9627b3e36d03e8a11e08c01321a3bfa84bb3\": container with ID starting with 4cd40dc1db29fc147d4f1be4751c9627b3e36d03e8a11e08c01321a3bfa84bb3 not found: ID does not exist" containerID="4cd40dc1db29fc147d4f1be4751c9627b3e36d03e8a11e08c01321a3bfa84bb3"
Jul 16 12:28:47.595762 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:47.595710    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cd40dc1db29fc147d4f1be4751c9627b3e36d03e8a11e08c01321a3bfa84bb3"} err="failed to get container status \"4cd40dc1db29fc147d4f1be4751c9627b3e36d03e8a11e08c01321a3bfa84bb3\": rpc error: code = NotFound desc = could not find container \"4cd40dc1db29fc147d4f1be4751c9627b3e36d03e8a11e08c01321a3bfa84bb3\": container with ID starting with 4cd40dc1db29fc147d4f1be4751c9627b3e36d03e8a11e08c01321a3bfa84bb3 not found: ID does not exist"
Jul 16 12:28:47.603281 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:47.603262    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6g7wn"]
Jul 16 12:28:47.607569 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:47.607550    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6g7wn"]
Jul 16 12:28:49.416738 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:49.416704    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="264792c6-218a-4f35-8eba-2d27664e7243" path="/var/lib/kubelet/pods/264792c6-218a-4f35-8eba-2d27664e7243/volumes"
Jul 16 12:28:51.688706 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:51.688661    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:51.793564 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:51.793539    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:51.979960 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:51.979899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:56.123012 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:56.122980    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:56.222323 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:28:56.222293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:15.463333 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:15.463303    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:15.526169 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:15.526146    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:29.466666 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:29.466561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:29.563424 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:29.563394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:29.920561 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:29.920539    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:30.198729 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:30.198660    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:30.426775 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:30.426747    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:30.523837 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:30.523776    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:30.609964 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:30.609937    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:29:40.116972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:40.116937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:40.201748 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:40.201716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:50.901124 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:50.901090    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:55.163523 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:55.163486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:55.584175 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:29:55.584084    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:30:00.139078 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:00.139047    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736750-hkn48"]
Jul 16 12:30:00.139442 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:00.139404    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="264792c6-218a-4f35-8eba-2d27664e7243" containerName="authorino"
Jul 16 12:30:00.139442 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:00.139416    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="264792c6-218a-4f35-8eba-2d27664e7243" containerName="authorino"
Jul 16 12:30:00.139518 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:00.139482    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="264792c6-218a-4f35-8eba-2d27664e7243" containerName="authorino"
Jul 16 12:30:00.143495 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:00.143477    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-hkn48"
Jul 16 12:30:00.145663 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:00.145644    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zjpqc\""
Jul 16 12:30:00.151051 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:00.151031    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736750-hkn48"]
Jul 16 12:30:00.153910 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:00.153891    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-hkn48"
Jul 16 12:30:00.482052 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:00.482026    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736750-hkn48"]
Jul 16 12:30:00.484411 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:30:00.484386    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4f5720_ff0f_47f2_8bd2_fa252939870e.slice/crio-36456f2bbb16cca75fb3027b72b61373f719bc5697b9edf20350be5f311400a1 WatchSource:0}: Error finding container 36456f2bbb16cca75fb3027b72b61373f719bc5697b9edf20350be5f311400a1: Status 404 returned error can't find the container with id 36456f2bbb16cca75fb3027b72b61373f719bc5697b9edf20350be5f311400a1
Jul 16 12:30:00.891300 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:00.891273    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-hkn48" event={"ID":"ac4f5720-ff0f-47f2-8bd2-fa252939870e","Type":"ContainerStarted","Data":"36456f2bbb16cca75fb3027b72b61373f719bc5697b9edf20350be5f311400a1"}
Jul 16 12:30:02.901628 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:02.901600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-hkn48" event={"ID":"ac4f5720-ff0f-47f2-8bd2-fa252939870e","Type":"ContainerStarted","Data":"56fc253c88ac148e6c3a0a4bfbf13db7623be31f469c6c5232ce4d16fa8e6625"}
Jul 16 12:30:02.918520 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:02.918476    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-hkn48" podStartSLOduration=0.980169046 podStartE2EDuration="2.918460072s" totalImagesPullingTime="1.938291026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:30:02.917054472 +0000 UTC m=+566.697628512" watchObservedRunningTime="2026-07-16 12:30:02.918460072 +0000 UTC m=+566.699034168"
Jul 16 12:30:03.906657 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:03.906624    2581 generic.go:356] "Generic (PLEG): container finished" podID="ac4f5720-ff0f-47f2-8bd2-fa252939870e" containerID="56fc253c88ac148e6c3a0a4bfbf13db7623be31f469c6c5232ce4d16fa8e6625" exitCode=0
Jul 16 12:30:03.907050 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:03.906696    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-hkn48" event={"ID":"ac4f5720-ff0f-47f2-8bd2-fa252939870e","Type":"ContainerDied","Data":"56fc253c88ac148e6c3a0a4bfbf13db7623be31f469c6c5232ce4d16fa8e6625"}
Jul 16 12:30:05.030639 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:05.030616    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-hkn48"
Jul 16 12:30:05.916251 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:05.916227    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-hkn48"
Jul 16 12:30:05.916424 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:05.916263    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-hkn48" event={"ID":"ac4f5720-ff0f-47f2-8bd2-fa252939870e","Type":"ContainerDied","Data":"36456f2bbb16cca75fb3027b72b61373f719bc5697b9edf20350be5f311400a1"}
Jul 16 12:30:05.916424 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:05.916303    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36456f2bbb16cca75fb3027b72b61373f719bc5697b9edf20350be5f311400a1"
Jul 16 12:30:08.112540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.112510    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"]
Jul 16 12:30:08.112888 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.112836    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac4f5720-ff0f-47f2-8bd2-fa252939870e" containerName="cleanup"
Jul 16 12:30:08.112888 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.112846    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac4f5720-ff0f-47f2-8bd2-fa252939870e" containerName="cleanup"
Jul 16 12:30:08.112960 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.112899    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac4f5720-ff0f-47f2-8bd2-fa252939870e" containerName="cleanup"
Jul 16 12:30:08.115946 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.115931    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.119303 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.119281    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 12:30:08.119303 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.119292    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-78wqk\""
Jul 16 12:30:08.119502 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.119293    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 12:30:08.119502 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.119278    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 16 12:30:08.127321 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.127301    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"]
Jul 16 12:30:08.172395 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.172373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:08.249644 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.249623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d6bddf9-1a78-4960-9821-f44f5184c65c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.249719 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.249650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d6bddf9-1a78-4960-9821-f44f5184c65c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.249719 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.249677    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d6bddf9-1a78-4960-9821-f44f5184c65c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.249798 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.249779    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d6bddf9-1a78-4960-9821-f44f5184c65c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.249870 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.249809    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d6bddf9-1a78-4960-9821-f44f5184c65c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.249870 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.249824    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h4g9\" (UniqueName: \"kubernetes.io/projected/4d6bddf9-1a78-4960-9821-f44f5184c65c-kube-api-access-4h4g9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.350725 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.350708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d6bddf9-1a78-4960-9821-f44f5184c65c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.350804 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.350734    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d6bddf9-1a78-4960-9821-f44f5184c65c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.350804 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.350751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h4g9\" (UniqueName: \"kubernetes.io/projected/4d6bddf9-1a78-4960-9821-f44f5184c65c-kube-api-access-4h4g9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.350804 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.350781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d6bddf9-1a78-4960-9821-f44f5184c65c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.350804 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.350798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d6bddf9-1a78-4960-9821-f44f5184c65c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.350949 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.350821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d6bddf9-1a78-4960-9821-f44f5184c65c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.351085 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.351066    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d6bddf9-1a78-4960-9821-f44f5184c65c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.351192 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.351175    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d6bddf9-1a78-4960-9821-f44f5184c65c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.351242 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.351231    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d6bddf9-1a78-4960-9821-f44f5184c65c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.352805 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.352785    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d6bddf9-1a78-4960-9821-f44f5184c65c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.353258 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.353238    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d6bddf9-1a78-4960-9821-f44f5184c65c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.359022 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.359000    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h4g9\" (UniqueName: \"kubernetes.io/projected/4d6bddf9-1a78-4960-9821-f44f5184c65c-kube-api-access-4h4g9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-754kh\" (UID: \"4d6bddf9-1a78-4960-9821-f44f5184c65c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.425646 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.425629    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:08.553063 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.553029    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"]
Jul 16 12:30:08.556912 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:30:08.556880    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6bddf9_1a78_4960_9821_f44f5184c65c.slice/crio-edb6e6dfd8d509d10bec6f6b352639577ca9b77207f5be3bfb1e538f3aece18d WatchSource:0}: Error finding container edb6e6dfd8d509d10bec6f6b352639577ca9b77207f5be3bfb1e538f3aece18d: Status 404 returned error can't find the container with id edb6e6dfd8d509d10bec6f6b352639577ca9b77207f5be3bfb1e538f3aece18d
Jul 16 12:30:08.888978 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.888950    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:30:08.930817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:08.930790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh" event={"ID":"4d6bddf9-1a78-4960-9821-f44f5184c65c","Type":"ContainerStarted","Data":"edb6e6dfd8d509d10bec6f6b352639577ca9b77207f5be3bfb1e538f3aece18d"}
Jul 16 12:30:11.946426 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:11.946394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh" event={"ID":"4d6bddf9-1a78-4960-9821-f44f5184c65c","Type":"ContainerStarted","Data":"7a29dbe236f310587ea66ddd3e466198a8c4ccbc4f3ecbd73f3ae7d4d26946c1"}
Jul 16 12:30:11.967439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:11.967396    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh" podStartSLOduration=0.968991528 podStartE2EDuration="3.967380801s" totalImagesPullingTime="2.998389273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:30:11.967247767 +0000 UTC m=+575.747821808" watchObservedRunningTime="2026-07-16 12:30:11.967380801 +0000 UTC m=+575.747954842"
Jul 16 12:30:13.842395 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:13.842346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:15.081891 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:15.081861    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:30:17.635030 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:17.634997    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:18.426396 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:18.426349    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:18.426544 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:18.426421    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:18.438691 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:18.438669    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:18.986415 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:18.986394    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-754kh"
Jul 16 12:30:22.947844 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:22.947810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:24.484128 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:24.484092    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:30:28.622532 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.622499    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"]
Jul 16 12:30:28.628778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.628759    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.631860 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.631843    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 16 12:30:28.639448 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.639425    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"]
Jul 16 12:30:28.649525 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.649503    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:28.701848 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.701825    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbn7s\" (UniqueName: \"kubernetes.io/projected/fb5785c9-32f2-4909-8612-5d220aa3c956-kube-api-access-jbn7s\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.701941 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.701857    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb5785c9-32f2-4909-8612-5d220aa3c956-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.701941 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.701876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb5785c9-32f2-4909-8612-5d220aa3c956-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.701941 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.701891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb5785c9-32f2-4909-8612-5d220aa3c956-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.702044 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.701980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb5785c9-32f2-4909-8612-5d220aa3c956-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.702044 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.702002    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb5785c9-32f2-4909-8612-5d220aa3c956-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.803188 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.803165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb5785c9-32f2-4909-8612-5d220aa3c956-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.803319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.803198    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb5785c9-32f2-4909-8612-5d220aa3c956-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.803319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.803263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbn7s\" (UniqueName: \"kubernetes.io/projected/fb5785c9-32f2-4909-8612-5d220aa3c956-kube-api-access-jbn7s\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.803319 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.803303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb5785c9-32f2-4909-8612-5d220aa3c956-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.803526 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.803323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb5785c9-32f2-4909-8612-5d220aa3c956-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.803526 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.803346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb5785c9-32f2-4909-8612-5d220aa3c956-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.803639 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.803613    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb5785c9-32f2-4909-8612-5d220aa3c956-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.803704 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.803663    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb5785c9-32f2-4909-8612-5d220aa3c956-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.803704 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.803685    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb5785c9-32f2-4909-8612-5d220aa3c956-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.805514 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.805494    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb5785c9-32f2-4909-8612-5d220aa3c956-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.805754 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.805738    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb5785c9-32f2-4909-8612-5d220aa3c956-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.811440 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.811423    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbn7s\" (UniqueName: \"kubernetes.io/projected/fb5785c9-32f2-4909-8612-5d220aa3c956-kube-api-access-jbn7s\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4pdfr\" (UID: \"fb5785c9-32f2-4909-8612-5d220aa3c956\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:28.939621 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:28.939600    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:29.072617 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:29.072593    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"]
Jul 16 12:30:29.074756 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:30:29.074736    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb5785c9_32f2_4909_8612_5d220aa3c956.slice/crio-503de34e0e21da9fe6939c01ff80475c7862dbb8dd4bf0db9cfed6c90692b9e7 WatchSource:0}: Error finding container 503de34e0e21da9fe6939c01ff80475c7862dbb8dd4bf0db9cfed6c90692b9e7: Status 404 returned error can't find the container with id 503de34e0e21da9fe6939c01ff80475c7862dbb8dd4bf0db9cfed6c90692b9e7
Jul 16 12:30:29.562796 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:29.562748    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:29.663498 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:29.663473    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:30.026797 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:30.026765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr" event={"ID":"fb5785c9-32f2-4909-8612-5d220aa3c956","Type":"ContainerStarted","Data":"79d2f85f62ddddac2a511a6ba959640ea65083f6be68024826a51098ce163a81"}
Jul 16 12:30:30.026986 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:30.026815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr" event={"ID":"fb5785c9-32f2-4909-8612-5d220aa3c956","Type":"ContainerStarted","Data":"503de34e0e21da9fe6939c01ff80475c7862dbb8dd4bf0db9cfed6c90692b9e7"}
Jul 16 12:30:30.046596 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:30.046554    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr" podStartSLOduration=1.4266891959999999 podStartE2EDuration="2.04654021s" totalImagesPullingTime="619.851014ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:30:30.04416873 +0000 UTC m=+593.824742770" watchObservedRunningTime="2026-07-16 12:30:30.04654021 +0000 UTC m=+593.827114250"
Jul 16 12:30:30.478201 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:30.478169    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:30:32.709650 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.709619    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"]
Jul 16 12:30:32.714526 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.714508    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.716952 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.716934    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 16 12:30:32.724433 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.724410    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"]
Jul 16 12:30:32.733925 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.733902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a23bf383-5461-482a-8c0b-6b890dc0125c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.734001 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.733962    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsrdq\" (UniqueName: \"kubernetes.io/projected/a23bf383-5461-482a-8c0b-6b890dc0125c-kube-api-access-hsrdq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.734001 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.733996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a23bf383-5461-482a-8c0b-6b890dc0125c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.734100 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.734082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a23bf383-5461-482a-8c0b-6b890dc0125c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.734160 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.734145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a23bf383-5461-482a-8c0b-6b890dc0125c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.734208 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.734170    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a23bf383-5461-482a-8c0b-6b890dc0125c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.825475 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.825438    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:32.834558 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.834534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a23bf383-5461-482a-8c0b-6b890dc0125c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.834662 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.834578    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsrdq\" (UniqueName: \"kubernetes.io/projected/a23bf383-5461-482a-8c0b-6b890dc0125c-kube-api-access-hsrdq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.834721 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.834701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a23bf383-5461-482a-8c0b-6b890dc0125c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.834795 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.834778    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a23bf383-5461-482a-8c0b-6b890dc0125c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.834874 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.834861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a23bf383-5461-482a-8c0b-6b890dc0125c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.834926 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.834893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a23bf383-5461-482a-8c0b-6b890dc0125c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.835130 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.835105    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a23bf383-5461-482a-8c0b-6b890dc0125c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.835208 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.835182    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a23bf383-5461-482a-8c0b-6b890dc0125c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.835208 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.835196    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a23bf383-5461-482a-8c0b-6b890dc0125c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.836581 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.836561    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a23bf383-5461-482a-8c0b-6b890dc0125c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.837659 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.837640    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a23bf383-5461-482a-8c0b-6b890dc0125c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:32.842534 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:32.842511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsrdq\" (UniqueName: \"kubernetes.io/projected/a23bf383-5461-482a-8c0b-6b890dc0125c-kube-api-access-hsrdq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg\" (UID: \"a23bf383-5461-482a-8c0b-6b890dc0125c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:33.023737 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:33.023672    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:33.147230 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:33.147199    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"]
Jul 16 12:30:33.150126 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:30:33.150101    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda23bf383_5461_482a_8c0b_6b890dc0125c.slice/crio-1d9b5c39d79686ed317d353b26d558b32bc8b179cdc16bf55dd1722b9c493b90 WatchSource:0}: Error finding container 1d9b5c39d79686ed317d353b26d558b32bc8b179cdc16bf55dd1722b9c493b90: Status 404 returned error can't find the container with id 1d9b5c39d79686ed317d353b26d558b32bc8b179cdc16bf55dd1722b9c493b90
Jul 16 12:30:34.046165 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:34.046135    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg" event={"ID":"a23bf383-5461-482a-8c0b-6b890dc0125c","Type":"ContainerStarted","Data":"2e935e4db8bb1eedd2adb352c6a972d90edfb8d1446a007504346dea959e281d"}
Jul 16 12:30:34.046165 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:34.046172    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg" event={"ID":"a23bf383-5461-482a-8c0b-6b890dc0125c","Type":"ContainerStarted","Data":"1d9b5c39d79686ed317d353b26d558b32bc8b179cdc16bf55dd1722b9c493b90"}
Jul 16 12:30:34.064661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:34.064618    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg" podStartSLOduration=1.8110594020000002 podStartE2EDuration="2.064603248s" totalImagesPullingTime="253.543846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:30:34.06423344 +0000 UTC m=+597.844807482" watchObservedRunningTime="2026-07-16 12:30:34.064603248 +0000 UTC m=+597.845177289"
Jul 16 12:30:37.378916 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:37.378889    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:30:37.386016 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:37.380262    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:30:38.940135 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:38.940107    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:38.940577 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:38.940159    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:38.951693 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:38.951670    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:39.079104 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:39.079081    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4pdfr"
Jul 16 12:30:41.305488 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:41.305452    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:30:43.024470 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:43.024436    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:43.024869 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:43.024514    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:43.036362 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:43.036343    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:43.096289 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:43.096268    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg"
Jul 16 12:30:49.522412 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:30:49.522351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:00.741381 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:32:00.741329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:00.839397 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:32:00.839343    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:15.540776 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:32:15.540739    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:18.007451 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:32:18.007414    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:18.105301 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:32:18.105270    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:45.576135 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:32:45.576098    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:45.596058 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:32:45.596033    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:32:55.582226 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:32:55.582192    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:33:06.585983 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:33:06.585954    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:34:21.945210 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:34:21.945134    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:34:23.158945 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:34:23.158912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:34:45.780486 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:34:45.780448    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:34:57.037779 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:34:57.037737    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:34:57.137710 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:34:57.137686    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:34:57.310151 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:34:57.310069    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:34:58.278862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:34:58.278833    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:35:03.323881 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:35:03.323851    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:35:03.577065 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:35:03.576992    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:35:03.839152 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:35:03.839079    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:35:03.995300 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:35:03.995280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:35:10.147444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:35:10.147412    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:35:10.230334 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:35:10.230306    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:35:27.684807 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:35:27.684776    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:35:37.405747 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:35:37.405653    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:35:37.409328 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:35:37.407972    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:35:41.379049 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:35:41.379017    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:35:51.077795 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:35:51.077761    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:35:59.073304 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:35:59.073276    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:36:08.381035 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:36:08.381003    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:36:21.081176 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:36:21.081138    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:36:33.077368 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:36:33.077336    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:36:41.280834 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:36:41.280794    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:37:03.688014 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:37:03.687936    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:37:14.788682 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:37:14.788646    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:37:22.484800 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:37:22.484768    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:37:28.120844 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:37:28.120809    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:37:37.378025 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:37:37.377992    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:37:51.685497 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:37:51.685468    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:38:04.086562 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:38:04.086530    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:38:13.979564 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:38:13.979529    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:38:24.384400 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:38:24.384352    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:38:36.479439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:38:36.479390    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:39:36.148592 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:39:36.148556    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:39:36.233546 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:39:36.233517    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:40:29.182198 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:40:29.182122    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:40:37.440006 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:40:37.439902    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:40:37.444029 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:40:37.441287    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:40:40.680916 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:40:40.680883    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:40:49.874044 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:40:49.874014    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:41:03.777797 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:41:03.777770    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:41:13.784817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:41:13.784788    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:41:24.278884 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:41:24.278852    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:41:32.981514 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:41:32.981481    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:41:39.968474 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:41:39.968441    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:41:43.085463 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:41:43.085427    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:41:54.472336 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:41:54.472302    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:42:03.677985 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:42:03.677948    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:42:17.484861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:42:17.484822    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:42:35.676533 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:42:35.676502    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:42:45.280148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:42:45.280116    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:42:55.973117 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:42:55.973088    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:43:06.286991 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:43:06.284032    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:43:15.782622 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:43:15.782586    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:43:28.375202 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:43:28.375169    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:43:38.469806 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:43:38.469775    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:43:48.386672 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:43:48.386643    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:43:56.486275 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:43:56.486236    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:44:06.897634 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:44:06.897602    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:44:18.375347 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:44:18.375310    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:44:36.794411 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:44:36.794374    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:44:55.675142 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:44:55.675098    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:45:07.285982 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:45:07.285946    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:45:14.379084 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:45:14.379030    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:45:35.394873 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:45:35.394837    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:45:37.465413 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:45:37.465303    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:45:37.469407 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:45:37.467794    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:45:48.090038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:45:48.090002    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:46:01.083574 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:01.083491    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:46:06.715700 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:06.715659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:09.416742 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:09.416705    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:14.135186 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:14.135140    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:14.248649 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:14.248621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:14.343373 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:14.343328    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:17.326661 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:17.326634    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:19.591830 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:19.591802    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:46:19.751411 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:19.751382    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:19.852243 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:19.852183    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:21.050763 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:21.050730    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:26.310157 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:26.310124    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:26.414812 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:26.414781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:26.578935 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:26.578864    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:26.676985 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:26.676958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:26.797533 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:26.797509    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:26.898786 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:26.898760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:27.109768 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:27.109734    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:27.218616 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:27.218543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:27.589721 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:27.589643    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:27.837833 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:27.837800    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:27.936630 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:27.936605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:30.140590 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:30.140560    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:31.582776 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:31.582747    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:46:32.768405 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:32.768371    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:32.889338 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:32.889315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:34.183079 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:34.183051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:39.051992 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:39.051956    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:39.117768 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:39.117743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:39.261722 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:39.261688    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:39.361696 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:39.361622    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:39.448379 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:39.448326    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:39.543621 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:39.543595    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:39.643206 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:39.643167    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:39.956731 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:39.956655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:40.060543 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:40.060519    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:42.470488 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:42.470455    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:43.189982 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:43.189949    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:46:44.904609 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:44.904580    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:45.006539 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:45.006512    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:46.436647 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:46.436616    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:51.194521 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:51.194486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:51.295069 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:51.295040    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:51.700474 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:51.700438    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:51.798901 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:51.798867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:51.898506 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:51.898479    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:53.405112 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:53.405075    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:55.779200 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:55.779167    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:46:59.726012 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:59.725977    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:59.828779 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:59.828750    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:46:59.940258 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:46:59.940232    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:00.038753 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:47:00.038686    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:00.467662 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:47:00.467633    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:04.352590 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:47:04.352546    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:26.434274 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:47:26.434229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:32.616194 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:47:32.616099    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:32.723875 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:47:32.723843    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:32.820003 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:47:32.819975    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:48.731186 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:47:48.731150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:54.897138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:47:54.897098    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:55.153280 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:47:55.153152    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:47:55.249454 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:47:55.249434    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:05.649559 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:05.649527    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:06.468483 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:06.468453    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:12.795144 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:12.795110    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:12.901152 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:12.901127    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:12.994769 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:12.994746    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:13.095683 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:13.095620    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:13.872952 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:13.872915    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:13.974370 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:13.974336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:14.072164 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:14.072133    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:15.729475 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:15.729444    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:16.379155 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:16.379127    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:48:22.105097 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:22.105064    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:22.204408 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:22.204384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:22.540414 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:22.540385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:26.475509 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:26.475477    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:48:28.793848 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:28.793801    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:28.894181 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:28.894135    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:29.017081 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:29.017055    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:29.354506 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:29.354474    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:29.702470 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:29.702437    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:31.617117 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:31.617083    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:31.705033 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:31.704982    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:31.775050 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:31.775018    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:31.875078 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:31.875012    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:32.318865 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:32.318832    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:32.419162 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:32.419131    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:37.892025 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:37.891993    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:37.997628 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:37.997588    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:38.233751 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:38.233688    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:39.377506 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:39.377474    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:48:44.226999 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:44.226963    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:44.328506 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:44.328468    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:44.953392 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:44.953340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:51.031237 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:51.031200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:51.097386 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:51.097348    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:51.324205 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:51.324105    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:51.534559 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:51.534528    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:51.651404 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:51.651379    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:51.745313 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:51.745291    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:51.883347 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:51.883319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:54.581822 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:54.581797    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:48:58.065466 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:58.065431    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:58.719625 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:58.719542    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:48:58.821819 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:48:58.821792    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:04.433851 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:04.433812    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:04.534441 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:04.534417    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:12.032513 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:12.032482    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:12.129831 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:12.129793    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:12.231101 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:12.231081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:12.429196 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:12.429174    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:12.924934 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:12.924899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:13.367382 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:13.367289    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:13.467125 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:13.467098    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:14.475328 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:14.475299    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:15.478913 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:15.478882    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:49:20.887604 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:20.887569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:20.987841 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:20.987795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:21.592678 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:21.592647    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:27.884563 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:27.884529    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:27.983942 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:27.983898    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:28.082945 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:28.082916    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:29.979127 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:29.979097    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:49:38.697859 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:38.697815    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:39.001767 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:39.001684    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:44.021791 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:44.021752    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:44.123445 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:44.123423    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:49:59.949550 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:49:59.949519    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:06.279483 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:06.279437    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:06.349916 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:06.349886    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:06.627324 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:06.627293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:06.934555 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:06.934481    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:07.135600 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:07.135565    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:09.096476 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:09.096438    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:09.178829 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:09.178796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:09.257102 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:09.257076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:09.660959 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:09.660932    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:09.852782 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:09.852753    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:09.953795 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:09.953725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:14.627022 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:14.626990    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:15.389500 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:15.389469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:15.456486 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:15.456451    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:15.891738 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:15.891699    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:17.208590 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:17.208550    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:17.306195 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:17.306160    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:17.369826 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:17.369788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:17.873703 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:17.873670    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:50:17.978900 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:17.978867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:18.451971 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:18.451938    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:22.735789 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:22.735727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:29.077485 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:29.077397    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:50:31.735509 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:31.735475    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:31.832607 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:31.832582    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:37.495415 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:37.495281    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:50:37.501627 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:37.499338    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:50:39.609335 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:39.609261    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:39.711147 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:39.711108    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:43.615890 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.615858    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"]
Jul 16 12:50:43.619713 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.619688    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.622101 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.622078    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-825c20\"/\"openshift-service-ca.crt\""
Jul 16 12:50:43.623375 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.623233    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-825c20\"/\"kube-root-ca.crt\""
Jul 16 12:50:43.623375 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.623244    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-825c20\"/\"test-model-825c20-kserve-self-signed-certs\""
Jul 16 12:50:43.623548 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.623505    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-825c20\"/\"default-dockercfg-2mbhd\""
Jul 16 12:50:43.628111 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.628095    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"]
Jul 16 12:50:43.662931 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.662905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:50:43.675066 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.675044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-model-cache\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.675158 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.675070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-tmp-dir\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.675158 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.675097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-home\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.675158 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.675128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81536c9c-b732-4e4d-afff-d82ff8469ff4-tls-certs\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.675277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.675169    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-dshm\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.675277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.675187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn2ts\" (UniqueName: \"kubernetes.io/projected/81536c9c-b732-4e4d-afff-d82ff8469ff4-kube-api-access-zn2ts\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.775901 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.775881    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-home\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.775988 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.775905    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81536c9c-b732-4e4d-afff-d82ff8469ff4-tls-certs\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.775988 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.775929    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-dshm\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.775988 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.775944    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn2ts\" (UniqueName: \"kubernetes.io/projected/81536c9c-b732-4e4d-afff-d82ff8469ff4-kube-api-access-zn2ts\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.776125 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.776022    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-model-cache\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.776125 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.776048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-tmp-dir\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.776313 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.776293    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-home\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.776416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.776380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-model-cache\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.776416 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.776411    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-tmp-dir\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.778112 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.778095    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-dshm\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.778384 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.778350    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81536c9c-b732-4e4d-afff-d82ff8469ff4-tls-certs\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.784229 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.784208    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn2ts\" (UniqueName: \"kubernetes.io/projected/81536c9c-b732-4e4d-afff-d82ff8469ff4-kube-api-access-zn2ts\") pod \"test-model-825c20-kserve-74b8ddd5f7-cbrtm\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") " pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:43.930325 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:43.930301    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:44.059423 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:44.059402    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"]
Jul 16 12:50:44.061918 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:50:44.061892    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81536c9c_b732_4e4d_afff_d82ff8469ff4.slice/crio-88088c84a4454e9eb064256164df054088e7fc5763feeb27649e246a4ea938b2 WatchSource:0}: Error finding container 88088c84a4454e9eb064256164df054088e7fc5763feeb27649e246a4ea938b2: Status 404 returned error can't find the container with id 88088c84a4454e9eb064256164df054088e7fc5763feeb27649e246a4ea938b2
Jul 16 12:50:44.376962 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:44.376929    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm" event={"ID":"81536c9c-b732-4e4d-afff-d82ff8469ff4","Type":"ContainerStarted","Data":"243573e278ea83461b7aff778602c62cf680b6310a310077d115da1eb72614ac"}
Jul 16 12:50:44.377115 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:44.376965    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm" event={"ID":"81536c9c-b732-4e4d-afff-d82ff8469ff4","Type":"ContainerStarted","Data":"88088c84a4454e9eb064256164df054088e7fc5763feeb27649e246a4ea938b2"}
Jul 16 12:50:44.396780 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:44.396744    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm" podStartSLOduration=1.396729842 podStartE2EDuration="1.396729842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:50:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:50:44.396272381 +0000 UTC m=+1808.176846422" watchObservedRunningTime="2026-07-16 12:50:44.396729842 +0000 UTC m=+1808.177303883"
Jul 16 12:50:47.572745 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:47.572713    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:50:53.930465 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:53.930431    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:53.930842 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:53.930485    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:53.942599 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:53.942575    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:54.429714 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:54.429681    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:50:59.577773 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:50:59.577736    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:51:02.308785 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.308749    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"]
Jul 16 12:51:02.312531 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.312510    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.315564 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.315534    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b2b0c9\"/\"default-dockercfg-q5tb4\""
Jul 16 12:51:02.315564 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.315556    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b2b0c9\"/\"kube-root-ca.crt\""
Jul 16 12:51:02.315770 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.315573    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b2b0c9\"/\"test-model-b2b0c9-kserve-self-signed-certs\""
Jul 16 12:51:02.315770 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.315605    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b2b0c9\"/\"openshift-service-ca.crt\""
Jul 16 12:51:02.320262 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.320103    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"]
Jul 16 12:51:02.344241 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.344216    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:02.425690 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.425663    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2x9z\" (UniqueName: \"kubernetes.io/projected/aa9f19e1-5881-424e-a319-df76f32aafe1-kube-api-access-f2x9z\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.425812 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.425692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-model-cache\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.425812 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.425769    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-tmp-dir\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.425812 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.425787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-home\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.425907 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.425819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa9f19e1-5881-424e-a319-df76f32aafe1-tls-certs\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.425907 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.425839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-dshm\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.526953 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.526934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-tmp-dir\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.527079 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.526959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-home\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.527079 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.526975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa9f19e1-5881-424e-a319-df76f32aafe1-tls-certs\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.527079 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.526994    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-dshm\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.527079 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.527061    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2x9z\" (UniqueName: \"kubernetes.io/projected/aa9f19e1-5881-424e-a319-df76f32aafe1-kube-api-access-f2x9z\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.527265 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.527086    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-model-cache\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.527318 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.527297    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-tmp-dir\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.527431 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.527411    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-home\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.527494 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.527474    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-model-cache\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.529242 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.529217    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-dshm\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.529493 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.529479    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa9f19e1-5881-424e-a319-df76f32aafe1-tls-certs\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.536342 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.536314    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2x9z\" (UniqueName: \"kubernetes.io/projected/aa9f19e1-5881-424e-a319-df76f32aafe1-kube-api-access-f2x9z\") pod \"test-model-b2b0c9-kserve-54d5fb8f45-jhq8s\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") " pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.622674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.622616    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:02.749832 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:02.749750    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"]
Jul 16 12:51:02.751943 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:51:02.751919    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa9f19e1_5881_424e_a319_df76f32aafe1.slice/crio-0958db4368e872e4cd195f6dbad8c8b0a2f1ef4122bc5e06b68143f0e1f35297 WatchSource:0}: Error finding container 0958db4368e872e4cd195f6dbad8c8b0a2f1ef4122bc5e06b68143f0e1f35297: Status 404 returned error can't find the container with id 0958db4368e872e4cd195f6dbad8c8b0a2f1ef4122bc5e06b68143f0e1f35297
Jul 16 12:51:03.458526 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:03.458487    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s" event={"ID":"aa9f19e1-5881-424e-a319-df76f32aafe1","Type":"ContainerStarted","Data":"5c57179aa7f0d40b345f83198d180498ccca1ce752935fabd6302bfa7d28fda1"}
Jul 16 12:51:03.458928 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:03.458533    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s" event={"ID":"aa9f19e1-5881-424e-a319-df76f32aafe1","Type":"ContainerStarted","Data":"0958db4368e872e4cd195f6dbad8c8b0a2f1ef4122bc5e06b68143f0e1f35297"}
Jul 16 12:51:03.477105 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:03.477063    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s" podStartSLOduration=1.4770437109999999 podStartE2EDuration="1.477043711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:51:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:51:03.475092087 +0000 UTC m=+1827.255666128" watchObservedRunningTime="2026-07-16 12:51:03.477043711 +0000 UTC m=+1827.257617787"
Jul 16 12:51:03.496546 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:03.496521    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:12.622972 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:12.622939    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:12.623323 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:12.622991    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:12.634706 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:12.634684    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:13.514131 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:13.514106    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:14.981160 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:14.981127    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:51:21.302021 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:21.301991    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"]
Jul 16 12:51:21.318674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:21.318645    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:22.164206 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:22.164162    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"]
Jul 16 12:51:22.724571 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:22.724534    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:27.753397 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:27.753351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:51:36.321762 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.321722    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm" podUID="81536c9c-b732-4e4d-afff-d82ff8469ff4" containerName="main" containerID="cri-o://243573e278ea83461b7aff778602c62cf680b6310a310077d115da1eb72614ac" gracePeriod=45
Jul 16 12:51:36.551148 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.551126    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:51:36.576508 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.576445    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:51:36.604121 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.604093    2581 generic.go:356] "Generic (PLEG): container finished" podID="81536c9c-b732-4e4d-afff-d82ff8469ff4" containerID="243573e278ea83461b7aff778602c62cf680b6310a310077d115da1eb72614ac" exitCode=0
Jul 16 12:51:36.604226 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.604127    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"
Jul 16 12:51:36.604226 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.604167    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm" event={"ID":"81536c9c-b732-4e4d-afff-d82ff8469ff4","Type":"ContainerDied","Data":"243573e278ea83461b7aff778602c62cf680b6310a310077d115da1eb72614ac"}
Jul 16 12:51:36.604226 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.604196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm" event={"ID":"81536c9c-b732-4e4d-afff-d82ff8469ff4","Type":"ContainerDied","Data":"88088c84a4454e9eb064256164df054088e7fc5763feeb27649e246a4ea938b2"}
Jul 16 12:51:36.604226 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.604214    2581 scope.go:117] "RemoveContainer" containerID="243573e278ea83461b7aff778602c62cf680b6310a310077d115da1eb72614ac"
Jul 16 12:51:36.611813 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.611798    2581 scope.go:117] "RemoveContainer" containerID="243573e278ea83461b7aff778602c62cf680b6310a310077d115da1eb72614ac"
Jul 16 12:51:36.612060 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:51:36.612043    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"243573e278ea83461b7aff778602c62cf680b6310a310077d115da1eb72614ac\": container with ID starting with 243573e278ea83461b7aff778602c62cf680b6310a310077d115da1eb72614ac not found: ID does not exist" containerID="243573e278ea83461b7aff778602c62cf680b6310a310077d115da1eb72614ac"
Jul 16 12:51:36.612102 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.612069    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"243573e278ea83461b7aff778602c62cf680b6310a310077d115da1eb72614ac"} err="failed to get container status \"243573e278ea83461b7aff778602c62cf680b6310a310077d115da1eb72614ac\": rpc error: code = NotFound desc = could not find container \"243573e278ea83461b7aff778602c62cf680b6310a310077d115da1eb72614ac\": container with ID starting with 243573e278ea83461b7aff778602c62cf680b6310a310077d115da1eb72614ac not found: ID does not exist"
Jul 16 12:51:36.680914 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.680885    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zn2ts\" (UniqueName: \"kubernetes.io/projected/81536c9c-b732-4e4d-afff-d82ff8469ff4-kube-api-access-zn2ts\") pod \"81536c9c-b732-4e4d-afff-d82ff8469ff4\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") "
Jul 16 12:51:36.681002 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.680958    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-tmp-dir\") pod \"81536c9c-b732-4e4d-afff-d82ff8469ff4\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") "
Jul 16 12:51:36.681041 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.681006    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-dshm\") pod \"81536c9c-b732-4e4d-afff-d82ff8469ff4\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") "
Jul 16 12:51:36.681041 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.681032    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-model-cache\") pod \"81536c9c-b732-4e4d-afff-d82ff8469ff4\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") "
Jul 16 12:51:36.681127 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.681050    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81536c9c-b732-4e4d-afff-d82ff8469ff4-tls-certs\") pod \"81536c9c-b732-4e4d-afff-d82ff8469ff4\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") "
Jul 16 12:51:36.681127 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.681075    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-home\") pod \"81536c9c-b732-4e4d-afff-d82ff8469ff4\" (UID: \"81536c9c-b732-4e4d-afff-d82ff8469ff4\") "
Jul 16 12:51:36.681256 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.681232    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "81536c9c-b732-4e4d-afff-d82ff8469ff4" (UID: "81536c9c-b732-4e4d-afff-d82ff8469ff4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:51:36.681256 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.681243    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-model-cache" (OuterVolumeSpecName: "model-cache") pod "81536c9c-b732-4e4d-afff-d82ff8469ff4" (UID: "81536c9c-b732-4e4d-afff-d82ff8469ff4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:51:36.681387 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.681338    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-tmp-dir\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:51:36.681387 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.681384    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-model-cache\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:51:36.681500 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.681396    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-home" (OuterVolumeSpecName: "home") pod "81536c9c-b732-4e4d-afff-d82ff8469ff4" (UID: "81536c9c-b732-4e4d-afff-d82ff8469ff4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:51:36.683379 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.683324    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81536c9c-b732-4e4d-afff-d82ff8469ff4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "81536c9c-b732-4e4d-afff-d82ff8469ff4" (UID: "81536c9c-b732-4e4d-afff-d82ff8469ff4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:51:36.683473 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.683423    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-dshm" (OuterVolumeSpecName: "dshm") pod "81536c9c-b732-4e4d-afff-d82ff8469ff4" (UID: "81536c9c-b732-4e4d-afff-d82ff8469ff4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:51:36.683473 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.683423    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81536c9c-b732-4e4d-afff-d82ff8469ff4-kube-api-access-zn2ts" (OuterVolumeSpecName: "kube-api-access-zn2ts") pod "81536c9c-b732-4e4d-afff-d82ff8469ff4" (UID: "81536c9c-b732-4e4d-afff-d82ff8469ff4"). InnerVolumeSpecName "kube-api-access-zn2ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:51:36.781901 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.781873    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-dshm\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:51:36.781901 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.781901    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81536c9c-b732-4e4d-afff-d82ff8469ff4-tls-certs\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:51:36.782014 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.781911    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81536c9c-b732-4e4d-afff-d82ff8469ff4-home\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:51:36.782014 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.781919    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn2ts\" (UniqueName: \"kubernetes.io/projected/81536c9c-b732-4e4d-afff-d82ff8469ff4-kube-api-access-zn2ts\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:51:36.926315 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.926291    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"]
Jul 16 12:51:36.930536 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:36.930517    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-825c20/test-model-825c20-kserve-74b8ddd5f7-cbrtm"]
Jul 16 12:51:37.184688 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.184634    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s" podUID="aa9f19e1-5881-424e-a319-df76f32aafe1" containerName="main" containerID="cri-o://5c57179aa7f0d40b345f83198d180498ccca1ce752935fabd6302bfa7d28fda1" gracePeriod=45
Jul 16 12:51:37.413290 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.413167    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81536c9c-b732-4e4d-afff-d82ff8469ff4" path="/var/lib/kubelet/pods/81536c9c-b732-4e4d-afff-d82ff8469ff4/volumes"
Jul 16 12:51:37.427668 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.427643    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:37.487342 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.487319    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-tmp-dir\") pod \"aa9f19e1-5881-424e-a319-df76f32aafe1\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") "
Jul 16 12:51:37.487457 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.487390    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2x9z\" (UniqueName: \"kubernetes.io/projected/aa9f19e1-5881-424e-a319-df76f32aafe1-kube-api-access-f2x9z\") pod \"aa9f19e1-5881-424e-a319-df76f32aafe1\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") "
Jul 16 12:51:37.487457 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.487414    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-home\") pod \"aa9f19e1-5881-424e-a319-df76f32aafe1\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") "
Jul 16 12:51:37.487457 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.487441    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa9f19e1-5881-424e-a319-df76f32aafe1-tls-certs\") pod \"aa9f19e1-5881-424e-a319-df76f32aafe1\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") "
Jul 16 12:51:37.487618 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.487465    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-dshm\") pod \"aa9f19e1-5881-424e-a319-df76f32aafe1\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") "
Jul 16 12:51:37.487618 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.487508    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-model-cache\") pod \"aa9f19e1-5881-424e-a319-df76f32aafe1\" (UID: \"aa9f19e1-5881-424e-a319-df76f32aafe1\") "
Jul 16 12:51:37.487618 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.487549    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aa9f19e1-5881-424e-a319-df76f32aafe1" (UID: "aa9f19e1-5881-424e-a319-df76f32aafe1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:51:37.487766 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.487668    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-home" (OuterVolumeSpecName: "home") pod "aa9f19e1-5881-424e-a319-df76f32aafe1" (UID: "aa9f19e1-5881-424e-a319-df76f32aafe1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:51:37.487832 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.487815    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-tmp-dir\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:51:37.487890 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.487837    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-home\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:51:37.487890 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.487841    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-model-cache" (OuterVolumeSpecName: "model-cache") pod "aa9f19e1-5881-424e-a319-df76f32aafe1" (UID: "aa9f19e1-5881-424e-a319-df76f32aafe1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:51:37.489493 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.489467    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-dshm" (OuterVolumeSpecName: "dshm") pod "aa9f19e1-5881-424e-a319-df76f32aafe1" (UID: "aa9f19e1-5881-424e-a319-df76f32aafe1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:51:37.489595 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.489545    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa9f19e1-5881-424e-a319-df76f32aafe1-kube-api-access-f2x9z" (OuterVolumeSpecName: "kube-api-access-f2x9z") pod "aa9f19e1-5881-424e-a319-df76f32aafe1" (UID: "aa9f19e1-5881-424e-a319-df76f32aafe1"). InnerVolumeSpecName "kube-api-access-f2x9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:51:37.489595 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.489555    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa9f19e1-5881-424e-a319-df76f32aafe1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aa9f19e1-5881-424e-a319-df76f32aafe1" (UID: "aa9f19e1-5881-424e-a319-df76f32aafe1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:51:37.588763 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.588743    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2x9z\" (UniqueName: \"kubernetes.io/projected/aa9f19e1-5881-424e-a319-df76f32aafe1-kube-api-access-f2x9z\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:51:37.588847 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.588765    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa9f19e1-5881-424e-a319-df76f32aafe1-tls-certs\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:51:37.588847 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.588775    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-dshm\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:51:37.588847 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.588782    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa9f19e1-5881-424e-a319-df76f32aafe1-model-cache\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:51:37.609160 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.609137    2581 generic.go:356] "Generic (PLEG): container finished" podID="aa9f19e1-5881-424e-a319-df76f32aafe1" containerID="5c57179aa7f0d40b345f83198d180498ccca1ce752935fabd6302bfa7d28fda1" exitCode=0
Jul 16 12:51:37.609245 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.609178    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"
Jul 16 12:51:37.609245 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.609225    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s" event={"ID":"aa9f19e1-5881-424e-a319-df76f32aafe1","Type":"ContainerDied","Data":"5c57179aa7f0d40b345f83198d180498ccca1ce752935fabd6302bfa7d28fda1"}
Jul 16 12:51:37.609314 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.609262    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s" event={"ID":"aa9f19e1-5881-424e-a319-df76f32aafe1","Type":"ContainerDied","Data":"0958db4368e872e4cd195f6dbad8c8b0a2f1ef4122bc5e06b68143f0e1f35297"}
Jul 16 12:51:37.609314 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.609280    2581 scope.go:117] "RemoveContainer" containerID="5c57179aa7f0d40b345f83198d180498ccca1ce752935fabd6302bfa7d28fda1"
Jul 16 12:51:37.617211 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.617195    2581 scope.go:117] "RemoveContainer" containerID="5c57179aa7f0d40b345f83198d180498ccca1ce752935fabd6302bfa7d28fda1"
Jul 16 12:51:37.617443 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:51:37.617424    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c57179aa7f0d40b345f83198d180498ccca1ce752935fabd6302bfa7d28fda1\": container with ID starting with 5c57179aa7f0d40b345f83198d180498ccca1ce752935fabd6302bfa7d28fda1 not found: ID does not exist" containerID="5c57179aa7f0d40b345f83198d180498ccca1ce752935fabd6302bfa7d28fda1"
Jul 16 12:51:37.617516 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.617455    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c57179aa7f0d40b345f83198d180498ccca1ce752935fabd6302bfa7d28fda1"} err="failed to get container status \"5c57179aa7f0d40b345f83198d180498ccca1ce752935fabd6302bfa7d28fda1\": rpc error: code = NotFound desc = could not find container \"5c57179aa7f0d40b345f83198d180498ccca1ce752935fabd6302bfa7d28fda1\": container with ID starting with 5c57179aa7f0d40b345f83198d180498ccca1ce752935fabd6302bfa7d28fda1 not found: ID does not exist"
Jul 16 12:51:37.629982 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.629961    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"]
Jul 16 12:51:37.632168 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:37.632149    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-b2b0c9/test-model-b2b0c9-kserve-54d5fb8f45-jhq8s"]
Jul 16 12:51:39.412774 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:51:39.412743    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa9f19e1-5881-424e-a319-df76f32aafe1" path="/var/lib/kubelet/pods/aa9f19e1-5881-424e-a319-df76f32aafe1/volumes"
Jul 16 12:52:05.756732 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:05.756651    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:05.918107 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:05.918080    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:06.137752 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:06.137718    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:06.624538 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:06.624468    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:09.485255 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:09.485224    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:52:12.664629 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:12.664594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:12.762874 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:12.762841    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:12.915751 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:12.915664    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:13.194042 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:13.193959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:13.506303 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:13.506201    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:13.828931 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:13.828853    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:13.995670 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:13.995630    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:15.979402 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:15.979344    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:16.059861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.059822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:16.060796 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.060776    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"]
Jul 16 12:52:16.061191 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.061177    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa9f19e1-5881-424e-a319-df76f32aafe1" containerName="main"
Jul 16 12:52:16.061191 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.061192    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa9f19e1-5881-424e-a319-df76f32aafe1" containerName="main"
Jul 16 12:52:16.061285 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.061203    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81536c9c-b732-4e4d-afff-d82ff8469ff4" containerName="main"
Jul 16 12:52:16.061285 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.061208    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="81536c9c-b732-4e4d-afff-d82ff8469ff4" containerName="main"
Jul 16 12:52:16.061285 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.061256    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa9f19e1-5881-424e-a319-df76f32aafe1" containerName="main"
Jul 16 12:52:16.061285 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.061265    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="81536c9c-b732-4e4d-afff-d82ff8469ff4" containerName="main"
Jul 16 12:52:16.064303 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.064287    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"
Jul 16 12:52:16.066648 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.066618    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 12:52:16.066648 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.066634    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 12:52:16.066798 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.066724    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-467ea0-serving-cert\""
Jul 16 12:52:16.067506 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.067491    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nttp2\""
Jul 16 12:52:16.073988 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.073964    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"]
Jul 16 12:52:16.124502 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.124475    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:16.196910 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.196880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57317ce2-424f-4437-aaf7-bbc2fecdaa64-openshift-service-ca\") pod \"maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn\" (UID: \"57317ce2-424f-4437-aaf7-bbc2fecdaa64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"
Jul 16 12:52:16.197057 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.196941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jk7n\" (UniqueName: \"kubernetes.io/projected/57317ce2-424f-4437-aaf7-bbc2fecdaa64-kube-api-access-9jk7n\") pod \"maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn\" (UID: \"57317ce2-424f-4437-aaf7-bbc2fecdaa64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"
Jul 16 12:52:16.197057 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.196970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57317ce2-424f-4437-aaf7-bbc2fecdaa64-maas-api-tls\") pod \"maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn\" (UID: \"57317ce2-424f-4437-aaf7-bbc2fecdaa64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"
Jul 16 12:52:16.225486 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.225459    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:16.298232 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.298161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57317ce2-424f-4437-aaf7-bbc2fecdaa64-maas-api-tls\") pod \"maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn\" (UID: \"57317ce2-424f-4437-aaf7-bbc2fecdaa64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"
Jul 16 12:52:16.298335 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.298234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57317ce2-424f-4437-aaf7-bbc2fecdaa64-openshift-service-ca\") pod \"maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn\" (UID: \"57317ce2-424f-4437-aaf7-bbc2fecdaa64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"
Jul 16 12:52:16.298335 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.298278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jk7n\" (UniqueName: \"kubernetes.io/projected/57317ce2-424f-4437-aaf7-bbc2fecdaa64-kube-api-access-9jk7n\") pod \"maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn\" (UID: \"57317ce2-424f-4437-aaf7-bbc2fecdaa64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"
Jul 16 12:52:16.298872 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.298849    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57317ce2-424f-4437-aaf7-bbc2fecdaa64-openshift-service-ca\") pod \"maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn\" (UID: \"57317ce2-424f-4437-aaf7-bbc2fecdaa64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"
Jul 16 12:52:16.300723 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.300701    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57317ce2-424f-4437-aaf7-bbc2fecdaa64-maas-api-tls\") pod \"maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn\" (UID: \"57317ce2-424f-4437-aaf7-bbc2fecdaa64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"
Jul 16 12:52:16.312503 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.312483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jk7n\" (UniqueName: \"kubernetes.io/projected/57317ce2-424f-4437-aaf7-bbc2fecdaa64-kube-api-access-9jk7n\") pod \"maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn\" (UID: \"57317ce2-424f-4437-aaf7-bbc2fecdaa64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"
Jul 16 12:52:16.375409 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.375379    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"
Jul 16 12:52:16.504948 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.504924    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"]
Jul 16 12:52:16.507529 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:52:16.507501    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57317ce2_424f_4437_aaf7_bbc2fecdaa64.slice/crio-9ed20b86e6e0e92691413327a4c4cc93a6871fabda64c3d4f0cb2da888f12fa5 WatchSource:0}: Error finding container 9ed20b86e6e0e92691413327a4c4cc93a6871fabda64c3d4f0cb2da888f12fa5: Status 404 returned error can't find the container with id 9ed20b86e6e0e92691413327a4c4cc93a6871fabda64c3d4f0cb2da888f12fa5
Jul 16 12:52:16.508788 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.508773    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:52:16.563836 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.563749    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:16.660787 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.660760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:16.783187 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:16.783153    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn" event={"ID":"57317ce2-424f-4437-aaf7-bbc2fecdaa64","Type":"ContainerStarted","Data":"9ed20b86e6e0e92691413327a4c4cc93a6871fabda64c3d4f0cb2da888f12fa5"}
Jul 16 12:52:19.797805 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:19.797770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn" event={"ID":"57317ce2-424f-4437-aaf7-bbc2fecdaa64","Type":"ContainerStarted","Data":"7dc48dbdc06ff528d67ed951afc40041d0992e4c4c34d04a1669b8d826e9dbce"}
Jul 16 12:52:19.798221 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:19.797912    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"
Jul 16 12:52:19.819138 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:19.819082    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn" podStartSLOduration=1.554194266 podStartE2EDuration="3.819065856s" totalImagesPullingTime="2.26487159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:52:19.817473702 +0000 UTC m=+1903.598047741" watchObservedRunningTime="2026-07-16 12:52:19.819065856 +0000 UTC m=+1903.599639897"
Jul 16 12:52:21.504671 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:21.504626    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:21.973228 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:21.973191    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:22.283387 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:22.283284    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:52:22.316838 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:22.316794    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:22.503630 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:22.503593    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:23.995415 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:23.995379    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:24.082379 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:24.082336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:24.186626 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:24.186594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:24.506806 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:24.506769    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:24.870701 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:24.870610    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:24.970657 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:24.970619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:25.807494 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:25.807468    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn"
Jul 16 12:52:29.498330 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:29.498291    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:38.156281 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:38.156239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:38.308006 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:38.307970    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:38.415829 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:38.415736    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:39.890757 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:39.890709    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:52:44.303812 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:44.303769    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:46.295348 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:46.295309    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:46.394607 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:46.394577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:50.101534 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:50.101495    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:50.201010 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:50.200977    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:50.401242 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:50.401205    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:50.635610 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:50.635555    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:51.133562 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:51.133528    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:53.089239 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:53.089206    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:52:53.674506 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:53.674467    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:52:57.805046 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:52:57.805007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:03.622902 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:03.622863    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:03.725104 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:03.725069    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:03.914892 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:03.914854    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:04.141992 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:04.141952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:04.485886 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:04.485852    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:04.827892 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:04.827803    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:05.363866 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:05.363832    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:07.154749 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.154710    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:07.253475 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.253440    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"]
Jul 16 12:53:07.256881 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.256845    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:07.257352 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.257331    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:07.259663 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.259645    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-989150-serving-cert\""
Jul 16 12:53:07.267250 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.267225    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"]
Jul 16 12:53:07.362792 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.362747    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ad9e735-b344-4882-b08f-d9524c9ec8a1-maas-api-tls\") pod \"maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q\" (UID: \"7ad9e735-b344-4882-b08f-d9524c9ec8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:07.362792 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.362789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ad9e735-b344-4882-b08f-d9524c9ec8a1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q\" (UID: \"7ad9e735-b344-4882-b08f-d9524c9ec8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:07.363016 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.362871    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdswf\" (UniqueName: \"kubernetes.io/projected/7ad9e735-b344-4882-b08f-d9524c9ec8a1-kube-api-access-cdswf\") pod \"maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q\" (UID: \"7ad9e735-b344-4882-b08f-d9524c9ec8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:07.464123 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.464033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ad9e735-b344-4882-b08f-d9524c9ec8a1-maas-api-tls\") pod \"maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q\" (UID: \"7ad9e735-b344-4882-b08f-d9524c9ec8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:07.464123 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.464067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ad9e735-b344-4882-b08f-d9524c9ec8a1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q\" (UID: \"7ad9e735-b344-4882-b08f-d9524c9ec8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:07.464123 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.464122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdswf\" (UniqueName: \"kubernetes.io/projected/7ad9e735-b344-4882-b08f-d9524c9ec8a1-kube-api-access-cdswf\") pod \"maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q\" (UID: \"7ad9e735-b344-4882-b08f-d9524c9ec8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:07.464340 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:53:07.464179    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-serving-cert: secret "maas-api-e2e-shared-a-989150-serving-cert" not found
Jul 16 12:53:07.464340 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:53:07.464258    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ad9e735-b344-4882-b08f-d9524c9ec8a1-maas-api-tls podName:7ad9e735-b344-4882-b08f-d9524c9ec8a1 nodeName:}" failed. No retries permitted until 2026-07-16 12:53:07.96423991 +0000 UTC m=+1951.744813930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7ad9e735-b344-4882-b08f-d9524c9ec8a1-maas-api-tls") pod "maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q" (UID: "7ad9e735-b344-4882-b08f-d9524c9ec8a1") : secret "maas-api-e2e-shared-a-989150-serving-cert" not found
Jul 16 12:53:07.464754 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.464737    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ad9e735-b344-4882-b08f-d9524c9ec8a1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q\" (UID: \"7ad9e735-b344-4882-b08f-d9524c9ec8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:07.480549 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.480512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdswf\" (UniqueName: \"kubernetes.io/projected/7ad9e735-b344-4882-b08f-d9524c9ec8a1-kube-api-access-cdswf\") pod \"maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q\" (UID: \"7ad9e735-b344-4882-b08f-d9524c9ec8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:07.968108 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.968070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ad9e735-b344-4882-b08f-d9524c9ec8a1-maas-api-tls\") pod \"maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q\" (UID: \"7ad9e735-b344-4882-b08f-d9524c9ec8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:07.970510 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:07.970484    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ad9e735-b344-4882-b08f-d9524c9ec8a1-maas-api-tls\") pod \"maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q\" (UID: \"7ad9e735-b344-4882-b08f-d9524c9ec8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:08.077820 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:08.077787    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:08.167920 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:08.167882    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:08.182120 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:08.182085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:08.186967 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:08.184632    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:53:08.307978 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:08.307950    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"]
Jul 16 12:53:08.310382 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:53:08.310337    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad9e735_b344_4882_b08f_d9524c9ec8a1.slice/crio-5df7c8feccc312cf597a577f8a1495aa0144df06839ee4acdfd5a66e055353e5 WatchSource:0}: Error finding container 5df7c8feccc312cf597a577f8a1495aa0144df06839ee4acdfd5a66e055353e5: Status 404 returned error can't find the container with id 5df7c8feccc312cf597a577f8a1495aa0144df06839ee4acdfd5a66e055353e5
Jul 16 12:53:09.022012 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:09.021912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q" event={"ID":"7ad9e735-b344-4882-b08f-d9524c9ec8a1","Type":"ContainerStarted","Data":"0319c4dbe17dc06dc5a51121882448be21ebfef5ab4341e11c7e9edf45d34e71"}
Jul 16 12:53:09.022012 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:09.021970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q" event={"ID":"7ad9e735-b344-4882-b08f-d9524c9ec8a1","Type":"ContainerStarted","Data":"5df7c8feccc312cf597a577f8a1495aa0144df06839ee4acdfd5a66e055353e5"}
Jul 16 12:53:09.022237 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:09.022049    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:09.038987 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:09.038934    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q" podStartSLOduration=1.6448084760000001 podStartE2EDuration="2.038917254s" totalImagesPullingTime="394.108778ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:53:09.038140992 +0000 UTC m=+1952.818715034" watchObservedRunningTime="2026-07-16 12:53:09.038917254 +0000 UTC m=+1952.819491274"
Jul 16 12:53:12.770685 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:12.770646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:13.131420 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:13.131393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:13.463777 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:13.463699    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:13.694847 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:13.694806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:15.031999 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.031974    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q"
Jul 16 12:53:15.293258 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.293169    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:15.391302 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.391264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:15.475582 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.475539    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"]
Jul 16 12:53:15.479627 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.479604    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:15.482878 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.482857    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-293c75-serving-cert\""
Jul 16 12:53:15.494790 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.494769    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"]
Jul 16 12:53:15.533602 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.533569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:15.539827 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.539799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c079b08-54cd-42bb-8a78-0f5a51dac294-maas-api-tls\") pod \"maas-api-e2e-shared-b-293c75-5b86845bcc-922dw\" (UID: \"3c079b08-54cd-42bb-8a78-0f5a51dac294\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:15.539984 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.539966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c079b08-54cd-42bb-8a78-0f5a51dac294-openshift-service-ca\") pod \"maas-api-e2e-shared-b-293c75-5b86845bcc-922dw\" (UID: \"3c079b08-54cd-42bb-8a78-0f5a51dac294\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:15.540168 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.540143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht4ss\" (UniqueName: \"kubernetes.io/projected/3c079b08-54cd-42bb-8a78-0f5a51dac294-kube-api-access-ht4ss\") pod \"maas-api-e2e-shared-b-293c75-5b86845bcc-922dw\" (UID: \"3c079b08-54cd-42bb-8a78-0f5a51dac294\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:15.641250 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.641220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c079b08-54cd-42bb-8a78-0f5a51dac294-openshift-service-ca\") pod \"maas-api-e2e-shared-b-293c75-5b86845bcc-922dw\" (UID: \"3c079b08-54cd-42bb-8a78-0f5a51dac294\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:15.641456 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.641271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht4ss\" (UniqueName: \"kubernetes.io/projected/3c079b08-54cd-42bb-8a78-0f5a51dac294-kube-api-access-ht4ss\") pod \"maas-api-e2e-shared-b-293c75-5b86845bcc-922dw\" (UID: \"3c079b08-54cd-42bb-8a78-0f5a51dac294\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:15.641456 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.641297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c079b08-54cd-42bb-8a78-0f5a51dac294-maas-api-tls\") pod \"maas-api-e2e-shared-b-293c75-5b86845bcc-922dw\" (UID: \"3c079b08-54cd-42bb-8a78-0f5a51dac294\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:15.641456 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:53:15.641427    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-serving-cert: secret "maas-api-e2e-shared-b-293c75-serving-cert" not found
Jul 16 12:53:15.641625 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:53:15.641489    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c079b08-54cd-42bb-8a78-0f5a51dac294-maas-api-tls podName:3c079b08-54cd-42bb-8a78-0f5a51dac294 nodeName:}" failed. No retries permitted until 2026-07-16 12:53:16.141473389 +0000 UTC m=+1959.922047408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3c079b08-54cd-42bb-8a78-0f5a51dac294-maas-api-tls") pod "maas-api-e2e-shared-b-293c75-5b86845bcc-922dw" (UID: "3c079b08-54cd-42bb-8a78-0f5a51dac294") : secret "maas-api-e2e-shared-b-293c75-serving-cert" not found
Jul 16 12:53:15.641940 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.641918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c079b08-54cd-42bb-8a78-0f5a51dac294-openshift-service-ca\") pod \"maas-api-e2e-shared-b-293c75-5b86845bcc-922dw\" (UID: \"3c079b08-54cd-42bb-8a78-0f5a51dac294\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:15.649648 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.649626    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht4ss\" (UniqueName: \"kubernetes.io/projected/3c079b08-54cd-42bb-8a78-0f5a51dac294-kube-api-access-ht4ss\") pod \"maas-api-e2e-shared-b-293c75-5b86845bcc-922dw\" (UID: \"3c079b08-54cd-42bb-8a78-0f5a51dac294\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:15.863865 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:15.863828    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:16.104726 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:16.104614    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:16.145790 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:16.145758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c079b08-54cd-42bb-8a78-0f5a51dac294-maas-api-tls\") pod \"maas-api-e2e-shared-b-293c75-5b86845bcc-922dw\" (UID: \"3c079b08-54cd-42bb-8a78-0f5a51dac294\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:16.148268 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:16.148245    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c079b08-54cd-42bb-8a78-0f5a51dac294-maas-api-tls\") pod \"maas-api-e2e-shared-b-293c75-5b86845bcc-922dw\" (UID: \"3c079b08-54cd-42bb-8a78-0f5a51dac294\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:16.202645 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:16.202619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:16.389582 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:16.389556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:16.517409 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:16.517387    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"]
Jul 16 12:53:16.519862 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:53:16.519833    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c079b08_54cd_42bb_8a78_0f5a51dac294.slice/crio-ae2f85442f39bd693189d2a8b58fd303af3107d22cb37dfac0b132749b190737 WatchSource:0}: Error finding container ae2f85442f39bd693189d2a8b58fd303af3107d22cb37dfac0b132749b190737: Status 404 returned error can't find the container with id ae2f85442f39bd693189d2a8b58fd303af3107d22cb37dfac0b132749b190737
Jul 16 12:53:17.061933 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:17.061899    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw" event={"ID":"3c079b08-54cd-42bb-8a78-0f5a51dac294","Type":"ContainerStarted","Data":"c002e6b24aee6abf67de141e5113d56601db74d673471b399ef647c3c80329b8"}
Jul 16 12:53:17.062084 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:17.061960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw" event={"ID":"3c079b08-54cd-42bb-8a78-0f5a51dac294","Type":"ContainerStarted","Data":"ae2f85442f39bd693189d2a8b58fd303af3107d22cb37dfac0b132749b190737"}
Jul 16 12:53:17.062084 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:17.062006    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:17.080232 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:17.080189    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw" podStartSLOduration=1.691444375 podStartE2EDuration="2.08017637s" totalImagesPullingTime="388.731995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:53:17.07886531 +0000 UTC m=+1960.859439350" watchObservedRunningTime="2026-07-16 12:53:17.08017637 +0000 UTC m=+1960.860750437"
Jul 16 12:53:20.923019 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:20.922984    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:23.071434 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:23.071405    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-293c75-5b86845bcc-922dw"
Jul 16 12:53:25.477768 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:25.477735    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:53:29.783382 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:29.783271    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:29.910901 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:29.910867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:37.569424 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:37.569390    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:37.681811 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:37.681777    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:39.918442 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.918404    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"]
Jul 16 12:53:39.923190 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.923166    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:39.926833 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.926404    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-989150\"/\"kube-root-ca.crt\""
Jul 16 12:53:39.926833 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.926624    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-989150\"/\"openshift-service-ca.crt\""
Jul 16 12:53:39.926833 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.926635    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-989150\"/\"auth-test-model-989150-kserve-self-signed-certs\""
Jul 16 12:53:39.926833 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.926730    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-989150\"/\"default-dockercfg-5cfbg\""
Jul 16 12:53:39.932517 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.932494    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"]
Jul 16 12:53:39.948637 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.948605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:39.956813 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.956794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-home\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:39.956899 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.956818    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-dshm\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:39.956899 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.956837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-model-cache\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:39.956899 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.956868    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-tmp-dir\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:39.956996 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.956913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45039c7-9996-48a2-b4b8-c0d3e60727d7-tls-certs\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:39.956996 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:39.956969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztxgg\" (UniqueName: \"kubernetes.io/projected/c45039c7-9996-48a2-b4b8-c0d3e60727d7-kube-api-access-ztxgg\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.058294 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.058258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-home\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.058294 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.058290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-dshm\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.058545 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.058306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-model-cache\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.058545 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.058430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-tmp-dir\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.058545 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.058488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45039c7-9996-48a2-b4b8-c0d3e60727d7-tls-certs\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.058545 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.058537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztxgg\" (UniqueName: \"kubernetes.io/projected/c45039c7-9996-48a2-b4b8-c0d3e60727d7-kube-api-access-ztxgg\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.058776 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.058756    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-home\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.058893 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.058869    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-tmp-dir\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.059023 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.059006    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-model-cache\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.060613 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.060589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-dshm\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.060974 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.060952    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45039c7-9996-48a2-b4b8-c0d3e60727d7-tls-certs\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.067795 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.067771    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztxgg\" (UniqueName: \"kubernetes.io/projected/c45039c7-9996-48a2-b4b8-c0d3e60727d7-kube-api-access-ztxgg\") pod \"auth-test-model-989150-kserve-785458b6dc-6sfx8\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") " pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.233686 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.233599    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:40.366710 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:40.366687    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"]
Jul 16 12:53:40.368681 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:53:40.368654    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc45039c7_9996_48a2_b4b8_c0d3e60727d7.slice/crio-7105ab59748273445f0edabf98a26b8180a2c321164c4fe3380702238fadde63 WatchSource:0}: Error finding container 7105ab59748273445f0edabf98a26b8180a2c321164c4fe3380702238fadde63: Status 404 returned error can't find the container with id 7105ab59748273445f0edabf98a26b8180a2c321164c4fe3380702238fadde63
Jul 16 12:53:41.175989 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:41.175951    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8" event={"ID":"c45039c7-9996-48a2-b4b8-c0d3e60727d7","Type":"ContainerStarted","Data":"7ad988a742fb9ccfc270e80126cf85713daa6002eb6b86fb52375b0d18bdc126"}
Jul 16 12:53:41.176347 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:41.175997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8" event={"ID":"c45039c7-9996-48a2-b4b8-c0d3e60727d7","Type":"ContainerStarted","Data":"7105ab59748273445f0edabf98a26b8180a2c321164c4fe3380702238fadde63"}
Jul 16 12:53:41.193376 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:41.193319    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8" podStartSLOduration=2.193304042 podStartE2EDuration="2.193304042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:53:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:53:41.192544519 +0000 UTC m=+1984.973118560" watchObservedRunningTime="2026-07-16 12:53:41.193304042 +0000 UTC m=+1984.973878080"
Jul 16 12:53:43.876752 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:43.876712    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:53:50.233924 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:50.233887    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:50.234552 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:50.233943    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:50.246130 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:50.246100    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:51.231567 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:51.231539    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:53:58.736332 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.736303    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"]
Jul 16 12:53:58.739934 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.739915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.743768 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.743740    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-293c75\"/\"kube-root-ca.crt\""
Jul 16 12:53:58.743967 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.743949    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-293c75\"/\"default-dockercfg-m8p2m\""
Jul 16 12:53:58.744199 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.744183    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-293c75\"/\"auth-test-model-293c75-kserve-self-signed-certs\""
Jul 16 12:53:58.744450 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.744433    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-293c75\"/\"openshift-service-ca.crt\""
Jul 16 12:53:58.752196 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.752167    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"]
Jul 16 12:53:58.771911 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.771879    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:53:58.814296 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.814267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-dshm\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.814466 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.814397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-model-cache\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.814466 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.814427    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25b93b5-590d-4163-93ad-4a3302268a1d-tls-certs\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.814466 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.814451    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-tmp-dir\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.814608 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.814474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-home\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.814608 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.814575    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltl8f\" (UniqueName: \"kubernetes.io/projected/d25b93b5-590d-4163-93ad-4a3302268a1d-kube-api-access-ltl8f\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.915717 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.915685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-dshm\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.915851 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.915734    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-model-cache\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.915851 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.915752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25b93b5-590d-4163-93ad-4a3302268a1d-tls-certs\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.915851 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.915768    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-tmp-dir\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.915851 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.915785    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-home\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.915851 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.915812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltl8f\" (UniqueName: \"kubernetes.io/projected/d25b93b5-590d-4163-93ad-4a3302268a1d-kube-api-access-ltl8f\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.916206 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.916187    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-tmp-dir\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.916293 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.916268    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-model-cache\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.916380 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.916321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-home\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.917968 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.917942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-dshm\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.918211 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.918195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25b93b5-590d-4163-93ad-4a3302268a1d-tls-certs\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:58.924798 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:58.924778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltl8f\" (UniqueName: \"kubernetes.io/projected/d25b93b5-590d-4163-93ad-4a3302268a1d-kube-api-access-ltl8f\") pod \"auth-test-model-293c75-kserve-665fb54dff-8mgsj\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") " pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:59.056401 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:59.056335    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:53:59.192993 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:59.192969    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"]
Jul 16 12:53:59.194718 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:53:59.194693    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd25b93b5_590d_4163_93ad_4a3302268a1d.slice/crio-a17c4b44b26fbcda05591962559d1e64651e9f89c3a5e46f368b03a3f5ba9741 WatchSource:0}: Error finding container a17c4b44b26fbcda05591962559d1e64651e9f89c3a5e46f368b03a3f5ba9741: Status 404 returned error can't find the container with id a17c4b44b26fbcda05591962559d1e64651e9f89c3a5e46f368b03a3f5ba9741
Jul 16 12:53:59.257595 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:59.257565    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj" event={"ID":"d25b93b5-590d-4163-93ad-4a3302268a1d","Type":"ContainerStarted","Data":"2771268937e96a24b7ee6593617a9e09c16106cb4b434aadb50a9b145f66ac1b"}
Jul 16 12:53:59.257701 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:59.257612    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj" event={"ID":"d25b93b5-590d-4163-93ad-4a3302268a1d","Type":"ContainerStarted","Data":"a17c4b44b26fbcda05591962559d1e64651e9f89c3a5e46f368b03a3f5ba9741"}
Jul 16 12:53:59.280135 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:53:59.280089    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj" podStartSLOduration=1.280074049 podStartE2EDuration="1.280074049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:53:59.279241145 +0000 UTC m=+2003.059815187" watchObservedRunningTime="2026-07-16 12:53:59.280074049 +0000 UTC m=+2003.060648089"
Jul 16 12:54:02.875996 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:54:02.875966    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:54:09.056783 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:54:09.056736    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:54:09.057282 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:54:09.056798    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:54:09.068838 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:54:09.068809    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:54:09.315526 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:54:09.315439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:54:19.782038 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:54:19.782006    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:54:42.075448 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:54:42.075414    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:54:42.743767 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:54:42.743733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:44.809864 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:54:44.809832    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:44.906743 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:54:44.906700    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:54:59.882090 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:54:59.882006    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:55:08.687863 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:55:08.687827    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:55:20.482088 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:55:20.482054    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:55:37.527430 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:55:37.527311    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:55:37.531515 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:55:37.531495    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 12:55:37.988741 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:55:37.988711    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:55:54.785695 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:55:54.785658    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:56:09.153035 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:09.153004    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"]
Jul 16 12:56:09.234551 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:09.234515    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:56:10.028513 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:10.028483    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"]
Jul 16 12:56:10.059738 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:10.059706    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:56:10.941437 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:10.941405    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:56:15.287576 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:15.287546    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:56:21.520814 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.520780    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"]
Jul 16 12:56:21.524249 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.524227    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.526548 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.526529    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-989150\"/\"sub-test-model-989150-kserve-self-signed-certs\""
Jul 16 12:56:21.535546 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.535526    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"]
Jul 16 12:56:21.617150 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.617124    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:56:21.624322 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.624294    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp9cv\" (UniqueName: \"kubernetes.io/projected/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-kube-api-access-gp9cv\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.624453 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.624328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-home\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.624453 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.624347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-tmp-dir\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.624453 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.624418    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-dshm\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.624554 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.624504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-tls-certs\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.624554 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.624542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-model-cache\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.725285 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.725258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-tls-certs\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.725439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.725300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-model-cache\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.725439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.725341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp9cv\" (UniqueName: \"kubernetes.io/projected/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-kube-api-access-gp9cv\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.725439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.725383    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-home\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.725439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.725404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-tmp-dir\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.725625 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.725450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-dshm\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.725713 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.725694    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-model-cache\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.725821 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.725803    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-home\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.725892 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.725868    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-tmp-dir\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.727598 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.727582    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-dshm\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.727862 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.727847    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-tls-certs\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.736997 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.736973    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp9cv\" (UniqueName: \"kubernetes.io/projected/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-kube-api-access-gp9cv\") pod \"sub-test-model-989150-kserve-5dd7bc888c-j6qvs\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") " pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.833403 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.833314    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:21.962633 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:21.962607    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"]
Jul 16 12:56:21.964949 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:56:21.964920    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41e9a3e3_40d2_4d06_8f82_35bff06ef4b1.slice/crio-bd30a6d3f3f967af75048b9efb1f7c7cecf0ef327392e9723d978aeb1154a60d WatchSource:0}: Error finding container bd30a6d3f3f967af75048b9efb1f7c7cecf0ef327392e9723d978aeb1154a60d: Status 404 returned error can't find the container with id bd30a6d3f3f967af75048b9efb1f7c7cecf0ef327392e9723d978aeb1154a60d
Jul 16 12:56:22.923977 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:22.923939    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs" event={"ID":"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1","Type":"ContainerStarted","Data":"75845877fed3081bd6f39b60581e822ef8bd68c9366d0372a57b22cb08ae63b6"}
Jul 16 12:56:22.924351 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:22.923988    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs" event={"ID":"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1","Type":"ContainerStarted","Data":"bd30a6d3f3f967af75048b9efb1f7c7cecf0ef327392e9723d978aeb1154a60d"}
Jul 16 12:56:22.941820 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:22.941776    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs" podStartSLOduration=1.941762496 podStartE2EDuration="1.941762496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:56:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:56:22.940745562 +0000 UTC m=+2146.721319627" watchObservedRunningTime="2026-07-16 12:56:22.941762496 +0000 UTC m=+2146.722336594"
Jul 16 12:56:24.172331 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.172296    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8" podUID="c45039c7-9996-48a2-b4b8-c0d3e60727d7" containerName="main" containerID="cri-o://7ad988a742fb9ccfc270e80126cf85713daa6002eb6b86fb52375b0d18bdc126" gracePeriod=45
Jul 16 12:56:24.425367 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.425304    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:56:24.550921 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.550897    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-model-cache\") pod \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") "
Jul 16 12:56:24.551075 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.550936    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45039c7-9996-48a2-b4b8-c0d3e60727d7-tls-certs\") pod \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") "
Jul 16 12:56:24.551075 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.550978    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-tmp-dir\") pod \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") "
Jul 16 12:56:24.551075 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.551004    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-dshm\") pod \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") "
Jul 16 12:56:24.551075 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.551021    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztxgg\" (UniqueName: \"kubernetes.io/projected/c45039c7-9996-48a2-b4b8-c0d3e60727d7-kube-api-access-ztxgg\") pod \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") "
Jul 16 12:56:24.551075 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.551053    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-home\") pod \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\" (UID: \"c45039c7-9996-48a2-b4b8-c0d3e60727d7\") "
Jul 16 12:56:24.551347 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.551205    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-model-cache" (OuterVolumeSpecName: "model-cache") pod "c45039c7-9996-48a2-b4b8-c0d3e60727d7" (UID: "c45039c7-9996-48a2-b4b8-c0d3e60727d7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:56:24.551347 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.551219    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c45039c7-9996-48a2-b4b8-c0d3e60727d7" (UID: "c45039c7-9996-48a2-b4b8-c0d3e60727d7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:56:24.551452 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.551376    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-home" (OuterVolumeSpecName: "home") pod "c45039c7-9996-48a2-b4b8-c0d3e60727d7" (UID: "c45039c7-9996-48a2-b4b8-c0d3e60727d7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:56:24.553037 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.553014    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-dshm" (OuterVolumeSpecName: "dshm") pod "c45039c7-9996-48a2-b4b8-c0d3e60727d7" (UID: "c45039c7-9996-48a2-b4b8-c0d3e60727d7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:56:24.553142 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.553036    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45039c7-9996-48a2-b4b8-c0d3e60727d7-kube-api-access-ztxgg" (OuterVolumeSpecName: "kube-api-access-ztxgg") pod "c45039c7-9996-48a2-b4b8-c0d3e60727d7" (UID: "c45039c7-9996-48a2-b4b8-c0d3e60727d7"). InnerVolumeSpecName "kube-api-access-ztxgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:56:24.553142 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.553088    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c45039c7-9996-48a2-b4b8-c0d3e60727d7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c45039c7-9996-48a2-b4b8-c0d3e60727d7" (UID: "c45039c7-9996-48a2-b4b8-c0d3e60727d7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:56:24.652405 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.652379    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-model-cache\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:56:24.652405 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.652401    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c45039c7-9996-48a2-b4b8-c0d3e60727d7-tls-certs\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:56:24.652405 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.652410    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-tmp-dir\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:56:24.652582 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.652419    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-dshm\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:56:24.652582 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.652427    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztxgg\" (UniqueName: \"kubernetes.io/projected/c45039c7-9996-48a2-b4b8-c0d3e60727d7-kube-api-access-ztxgg\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:56:24.652582 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.652435    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c45039c7-9996-48a2-b4b8-c0d3e60727d7-home\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:56:24.934195 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.934166    2581 generic.go:356] "Generic (PLEG): container finished" podID="c45039c7-9996-48a2-b4b8-c0d3e60727d7" containerID="7ad988a742fb9ccfc270e80126cf85713daa6002eb6b86fb52375b0d18bdc126" exitCode=0
Jul 16 12:56:24.934383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.934203    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"
Jul 16 12:56:24.934383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.934233    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8" event={"ID":"c45039c7-9996-48a2-b4b8-c0d3e60727d7","Type":"ContainerDied","Data":"7ad988a742fb9ccfc270e80126cf85713daa6002eb6b86fb52375b0d18bdc126"}
Jul 16 12:56:24.934383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.934270    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8" event={"ID":"c45039c7-9996-48a2-b4b8-c0d3e60727d7","Type":"ContainerDied","Data":"7105ab59748273445f0edabf98a26b8180a2c321164c4fe3380702238fadde63"}
Jul 16 12:56:24.934383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.934292    2581 scope.go:117] "RemoveContainer" containerID="7ad988a742fb9ccfc270e80126cf85713daa6002eb6b86fb52375b0d18bdc126"
Jul 16 12:56:24.942772 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.942755    2581 scope.go:117] "RemoveContainer" containerID="7ad988a742fb9ccfc270e80126cf85713daa6002eb6b86fb52375b0d18bdc126"
Jul 16 12:56:24.943037 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:56:24.943006    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ad988a742fb9ccfc270e80126cf85713daa6002eb6b86fb52375b0d18bdc126\": container with ID starting with 7ad988a742fb9ccfc270e80126cf85713daa6002eb6b86fb52375b0d18bdc126 not found: ID does not exist" containerID="7ad988a742fb9ccfc270e80126cf85713daa6002eb6b86fb52375b0d18bdc126"
Jul 16 12:56:24.943076 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.943044    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ad988a742fb9ccfc270e80126cf85713daa6002eb6b86fb52375b0d18bdc126"} err="failed to get container status \"7ad988a742fb9ccfc270e80126cf85713daa6002eb6b86fb52375b0d18bdc126\": rpc error: code = NotFound desc = could not find container \"7ad988a742fb9ccfc270e80126cf85713daa6002eb6b86fb52375b0d18bdc126\": container with ID starting with 7ad988a742fb9ccfc270e80126cf85713daa6002eb6b86fb52375b0d18bdc126 not found: ID does not exist"
Jul 16 12:56:24.955674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.955650    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"]
Jul 16 12:56:24.963365 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:24.963300    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-989150/auth-test-model-989150-kserve-785458b6dc-6sfx8"]
Jul 16 12:56:25.047539 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.047484    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj" podUID="d25b93b5-590d-4163-93ad-4a3302268a1d" containerName="main" containerID="cri-o://2771268937e96a24b7ee6593617a9e09c16106cb4b434aadb50a9b145f66ac1b" gracePeriod=45
Jul 16 12:56:25.290292 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.290268    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:56:25.358288 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.358264    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltl8f\" (UniqueName: \"kubernetes.io/projected/d25b93b5-590d-4163-93ad-4a3302268a1d-kube-api-access-ltl8f\") pod \"d25b93b5-590d-4163-93ad-4a3302268a1d\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") "
Jul 16 12:56:25.358446 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.358301    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25b93b5-590d-4163-93ad-4a3302268a1d-tls-certs\") pod \"d25b93b5-590d-4163-93ad-4a3302268a1d\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") "
Jul 16 12:56:25.358446 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.358329    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-home\") pod \"d25b93b5-590d-4163-93ad-4a3302268a1d\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") "
Jul 16 12:56:25.358446 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.358380    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-dshm\") pod \"d25b93b5-590d-4163-93ad-4a3302268a1d\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") "
Jul 16 12:56:25.358446 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.358399    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-tmp-dir\") pod \"d25b93b5-590d-4163-93ad-4a3302268a1d\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") "
Jul 16 12:56:25.358667 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.358451    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-model-cache\") pod \"d25b93b5-590d-4163-93ad-4a3302268a1d\" (UID: \"d25b93b5-590d-4163-93ad-4a3302268a1d\") "
Jul 16 12:56:25.358732 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.358699    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d25b93b5-590d-4163-93ad-4a3302268a1d" (UID: "d25b93b5-590d-4163-93ad-4a3302268a1d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:56:25.358786 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.358754    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-model-cache" (OuterVolumeSpecName: "model-cache") pod "d25b93b5-590d-4163-93ad-4a3302268a1d" (UID: "d25b93b5-590d-4163-93ad-4a3302268a1d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:56:25.358834 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.358806    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-home" (OuterVolumeSpecName: "home") pod "d25b93b5-590d-4163-93ad-4a3302268a1d" (UID: "d25b93b5-590d-4163-93ad-4a3302268a1d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:56:25.358894 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.358841    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-tmp-dir\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:56:25.360447 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.360424    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d25b93b5-590d-4163-93ad-4a3302268a1d-kube-api-access-ltl8f" (OuterVolumeSpecName: "kube-api-access-ltl8f") pod "d25b93b5-590d-4163-93ad-4a3302268a1d" (UID: "d25b93b5-590d-4163-93ad-4a3302268a1d"). InnerVolumeSpecName "kube-api-access-ltl8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:56:25.360821 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.360804    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-dshm" (OuterVolumeSpecName: "dshm") pod "d25b93b5-590d-4163-93ad-4a3302268a1d" (UID: "d25b93b5-590d-4163-93ad-4a3302268a1d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:56:25.360883 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.360814    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d25b93b5-590d-4163-93ad-4a3302268a1d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d25b93b5-590d-4163-93ad-4a3302268a1d" (UID: "d25b93b5-590d-4163-93ad-4a3302268a1d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:56:25.413166 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.413142    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c45039c7-9996-48a2-b4b8-c0d3e60727d7" path="/var/lib/kubelet/pods/c45039c7-9996-48a2-b4b8-c0d3e60727d7/volumes"
Jul 16 12:56:25.460114 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.460086    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltl8f\" (UniqueName: \"kubernetes.io/projected/d25b93b5-590d-4163-93ad-4a3302268a1d-kube-api-access-ltl8f\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:56:25.460114 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.460110    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25b93b5-590d-4163-93ad-4a3302268a1d-tls-certs\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:56:25.460261 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.460120    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-home\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:56:25.460261 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.460128    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-dshm\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:56:25.460261 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.460135    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25b93b5-590d-4163-93ad-4a3302268a1d-model-cache\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:56:25.941188 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.941154    2581 generic.go:356] "Generic (PLEG): container finished" podID="d25b93b5-590d-4163-93ad-4a3302268a1d" containerID="2771268937e96a24b7ee6593617a9e09c16106cb4b434aadb50a9b145f66ac1b" exitCode=0
Jul 16 12:56:25.941351 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.941202    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"
Jul 16 12:56:25.941351 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.941205    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj" event={"ID":"d25b93b5-590d-4163-93ad-4a3302268a1d","Type":"ContainerDied","Data":"2771268937e96a24b7ee6593617a9e09c16106cb4b434aadb50a9b145f66ac1b"}
Jul 16 12:56:25.941351 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.941243    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj" event={"ID":"d25b93b5-590d-4163-93ad-4a3302268a1d","Type":"ContainerDied","Data":"a17c4b44b26fbcda05591962559d1e64651e9f89c3a5e46f368b03a3f5ba9741"}
Jul 16 12:56:25.941351 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.941265    2581 scope.go:117] "RemoveContainer" containerID="2771268937e96a24b7ee6593617a9e09c16106cb4b434aadb50a9b145f66ac1b"
Jul 16 12:56:25.949520 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.949484    2581 scope.go:117] "RemoveContainer" containerID="2771268937e96a24b7ee6593617a9e09c16106cb4b434aadb50a9b145f66ac1b"
Jul 16 12:56:25.949774 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:56:25.949755    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2771268937e96a24b7ee6593617a9e09c16106cb4b434aadb50a9b145f66ac1b\": container with ID starting with 2771268937e96a24b7ee6593617a9e09c16106cb4b434aadb50a9b145f66ac1b not found: ID does not exist" containerID="2771268937e96a24b7ee6593617a9e09c16106cb4b434aadb50a9b145f66ac1b"
Jul 16 12:56:25.949817 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.949785    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2771268937e96a24b7ee6593617a9e09c16106cb4b434aadb50a9b145f66ac1b"} err="failed to get container status \"2771268937e96a24b7ee6593617a9e09c16106cb4b434aadb50a9b145f66ac1b\": rpc error: code = NotFound desc = could not find container \"2771268937e96a24b7ee6593617a9e09c16106cb4b434aadb50a9b145f66ac1b\": container with ID starting with 2771268937e96a24b7ee6593617a9e09c16106cb4b434aadb50a9b145f66ac1b not found: ID does not exist"
Jul 16 12:56:25.959176 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.959151    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"]
Jul 16 12:56:25.963326 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:25.963304    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/auth-test-model-293c75-kserve-665fb54dff-8mgsj"]
Jul 16 12:56:27.413865 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:27.413825    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d25b93b5-590d-4163-93ad-4a3302268a1d" path="/var/lib/kubelet/pods/d25b93b5-590d-4163-93ad-4a3302268a1d/volumes"
Jul 16 12:56:29.383206 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:29.383127    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:56:31.833778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:31.833734    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:31.833778 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:31.833793    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:31.846344 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:31.846321    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:31.979755 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:31.979726    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:56:39.877634 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:39.877597    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:56:42.115958 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:42.115928    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:56:51.528028 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.527994    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"]
Jul 16 12:56:51.528437 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.528343    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d25b93b5-590d-4163-93ad-4a3302268a1d" containerName="main"
Jul 16 12:56:51.528437 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.528369    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d25b93b5-590d-4163-93ad-4a3302268a1d" containerName="main"
Jul 16 12:56:51.528437 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.528392    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45039c7-9996-48a2-b4b8-c0d3e60727d7" containerName="main"
Jul 16 12:56:51.528437 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.528400    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45039c7-9996-48a2-b4b8-c0d3e60727d7" containerName="main"
Jul 16 12:56:51.528589 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.528471    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d25b93b5-590d-4163-93ad-4a3302268a1d" containerName="main"
Jul 16 12:56:51.528589 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.528479    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c45039c7-9996-48a2-b4b8-c0d3e60727d7" containerName="main"
Jul 16 12:56:51.531428 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.531413    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.534792 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.534767    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-293c75\"/\"openshift-service-ca.crt\""
Jul 16 12:56:51.534932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.534775    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-293c75\"/\"default-dockercfg-m8p2m\""
Jul 16 12:56:51.534932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.534776    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-293c75\"/\"sub-test-model-293c75-kserve-self-signed-certs\""
Jul 16 12:56:51.534932 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.534860    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-293c75\"/\"kube-root-ca.crt\""
Jul 16 12:56:51.544312 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.544291    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"]
Jul 16 12:56:51.560226 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.560193    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:56:51.699827 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.699789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-tmp-dir\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.699827 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.699828    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrf55\" (UniqueName: \"kubernetes.io/projected/052193b0-decd-42bb-b9a6-482c3fb1e2f5-kube-api-access-nrf55\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.700035 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.699885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-dshm\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.700035 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.699899    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/052193b0-decd-42bb-b9a6-482c3fb1e2f5-tls-certs\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.700035 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.699925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-model-cache\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.700035 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.700008    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-home\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.801126 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.801045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-dshm\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.801126 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.801077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/052193b0-decd-42bb-b9a6-482c3fb1e2f5-tls-certs\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.801126 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.801105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-model-cache\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.801126 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.801122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-home\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.801516 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.801178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-tmp-dir\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.801516 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.801196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrf55\" (UniqueName: \"kubernetes.io/projected/052193b0-decd-42bb-b9a6-482c3fb1e2f5-kube-api-access-nrf55\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.801622 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.801539    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-model-cache\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.801622 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.801570    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-home\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.801622 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.801603    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-tmp-dir\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.803766 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.803739    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-dshm\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.804031 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.804016    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/052193b0-decd-42bb-b9a6-482c3fb1e2f5-tls-certs\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.810427 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.810407    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrf55\" (UniqueName: \"kubernetes.io/projected/052193b0-decd-42bb-b9a6-482c3fb1e2f5-kube-api-access-nrf55\") pod \"sub-test-model-293c75-kserve-7748bb75d5-9gclw\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") " pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.840699 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.840671    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:56:51.972846 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:51.972677    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"]
Jul 16 12:56:51.975131 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:56:51.975102    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod052193b0_decd_42bb_b9a6_482c3fb1e2f5.slice/crio-457a8af0e57e18e62c6d59e6e35d6d105096122bfb4e96255bf5bcb33b20fe4e WatchSource:0}: Error finding container 457a8af0e57e18e62c6d59e6e35d6d105096122bfb4e96255bf5bcb33b20fe4e: Status 404 returned error can't find the container with id 457a8af0e57e18e62c6d59e6e35d6d105096122bfb4e96255bf5bcb33b20fe4e
Jul 16 12:56:52.064599 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:52.064507    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw" event={"ID":"052193b0-decd-42bb-b9a6-482c3fb1e2f5","Type":"ContainerStarted","Data":"3c28d70363eadb6bc7121b91a497784be56282044a43206f50a9350eb3b96244"}
Jul 16 12:56:52.064599 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:52.064563    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw" event={"ID":"052193b0-decd-42bb-b9a6-482c3fb1e2f5","Type":"ContainerStarted","Data":"457a8af0e57e18e62c6d59e6e35d6d105096122bfb4e96255bf5bcb33b20fe4e"}
Jul 16 12:56:52.086196 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:52.086147    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw" podStartSLOduration=1.086131228 podStartE2EDuration="1.086131228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:56:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:56:52.083638422 +0000 UTC m=+2175.864212465" watchObservedRunningTime="2026-07-16 12:56:52.086131228 +0000 UTC m=+2175.866705328"
Jul 16 12:56:56.490512 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:56:56.490480    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:57:01.841522 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:57:01.841484    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:57:01.841906 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:57:01.841536    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:57:01.854001 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:57:01.853975    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:57:02.127044 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:57:02.127021    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:57:02.906802 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:57:02.906767    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:57:23.478050 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:57:23.478018    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:57:46.280499 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:57:46.280462    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:57:52.151398 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:57:52.151349    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"]
Jul 16 12:57:52.171997 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:57:52.171959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:57:53.005404 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:57:53.005371    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"]
Jul 16 12:57:53.041872 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:57:53.041834    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:58:00.704215 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.704145    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"]
Jul 16 12:58:00.707864 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.707846    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.710450 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.710431    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-989150\"/\"rate-test-model-989150-kserve-self-signed-certs\""
Jul 16 12:58:00.720164 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.720128    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"]
Jul 16 12:58:00.746687 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.746663    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:58:00.836328 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.836302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-dshm\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.836540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.836398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-home\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.836540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.836441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539b0a8a-8f32-483c-882b-965ed147eeef-tls-certs\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.836540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.836511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft82j\" (UniqueName: \"kubernetes.io/projected/539b0a8a-8f32-483c-882b-965ed147eeef-kube-api-access-ft82j\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.836695 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.836543    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-tmp-dir\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.836695 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.836568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-model-cache\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.937249 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.937216    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft82j\" (UniqueName: \"kubernetes.io/projected/539b0a8a-8f32-483c-882b-965ed147eeef-kube-api-access-ft82j\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.937249 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.937250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-tmp-dir\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.937540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.937272    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-model-cache\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.937540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.937311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-dshm\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.937540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.937350    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-home\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.937540 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.937423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539b0a8a-8f32-483c-882b-965ed147eeef-tls-certs\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.937743 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.937714    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-model-cache\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.937788 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.937730    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-tmp-dir\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.937848 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.937831    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-home\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.939594 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.939567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-dshm\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.939882 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.939865    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539b0a8a-8f32-483c-882b-965ed147eeef-tls-certs\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:00.945627 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:00.945607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft82j\" (UniqueName: \"kubernetes.io/projected/539b0a8a-8f32-483c-882b-965ed147eeef-kube-api-access-ft82j\") pod \"rate-test-model-989150-kserve-7b44d7cfbc-lq76m\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") " pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:01.016868 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:01.016792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:01.150435 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:01.150409    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"]
Jul 16 12:58:01.152571 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:58:01.152541    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod539b0a8a_8f32_483c_882b_965ed147eeef.slice/crio-4ab320f4c4c2e536b82f663e322e63a393e9db85355ac9ccc4cc4ae642649ddf WatchSource:0}: Error finding container 4ab320f4c4c2e536b82f663e322e63a393e9db85355ac9ccc4cc4ae642649ddf: Status 404 returned error can't find the container with id 4ab320f4c4c2e536b82f663e322e63a393e9db85355ac9ccc4cc4ae642649ddf
Jul 16 12:58:01.395444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:01.395410    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m" event={"ID":"539b0a8a-8f32-483c-882b-965ed147eeef","Type":"ContainerStarted","Data":"50f438107ef6d5c6cf96469de29336c54afa165b79408910d3736106c13aa5d5"}
Jul 16 12:58:01.395444 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:01.395451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m" event={"ID":"539b0a8a-8f32-483c-882b-965ed147eeef","Type":"ContainerStarted","Data":"4ab320f4c4c2e536b82f663e322e63a393e9db85355ac9ccc4cc4ae642649ddf"}
Jul 16 12:58:01.413180 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:01.413124    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m" podStartSLOduration=1.41311024 podStartE2EDuration="1.41311024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:58:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:58:01.411701871 +0000 UTC m=+2245.192275913" watchObservedRunningTime="2026-07-16 12:58:01.41311024 +0000 UTC m=+2245.193684280"
Jul 16 12:58:07.171139 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.171081    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs" podUID="41e9a3e3-40d2-4d06-8f82-35bff06ef4b1" containerName="main" containerID="cri-o://75845877fed3081bd6f39b60581e822ef8bd68c9366d0372a57b22cb08ae63b6" gracePeriod=45
Jul 16 12:58:07.425802 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.425747    2581 generic.go:356] "Generic (PLEG): container finished" podID="41e9a3e3-40d2-4d06-8f82-35bff06ef4b1" containerID="75845877fed3081bd6f39b60581e822ef8bd68c9366d0372a57b22cb08ae63b6" exitCode=0
Jul 16 12:58:07.425912 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.425814    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs" event={"ID":"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1","Type":"ContainerDied","Data":"75845877fed3081bd6f39b60581e822ef8bd68c9366d0372a57b22cb08ae63b6"}
Jul 16 12:58:07.425912 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.425852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs" event={"ID":"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1","Type":"ContainerDied","Data":"bd30a6d3f3f967af75048b9efb1f7c7cecf0ef327392e9723d978aeb1154a60d"}
Jul 16 12:58:07.425912 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.425864    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd30a6d3f3f967af75048b9efb1f7c7cecf0ef327392e9723d978aeb1154a60d"
Jul 16 12:58:07.427908 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.427892    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:58:07.503919 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.503891    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp9cv\" (UniqueName: \"kubernetes.io/projected/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-kube-api-access-gp9cv\") pod \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") "
Jul 16 12:58:07.504036 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.503931    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-tmp-dir\") pod \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") "
Jul 16 12:58:07.504036 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.503973    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-home\") pod \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") "
Jul 16 12:58:07.504145 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.504086    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-tls-certs\") pod \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") "
Jul 16 12:58:07.504205 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.504176    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-dshm\") pod \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") "
Jul 16 12:58:07.504205 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.504181    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-home" (OuterVolumeSpecName: "home") pod "41e9a3e3-40d2-4d06-8f82-35bff06ef4b1" (UID: "41e9a3e3-40d2-4d06-8f82-35bff06ef4b1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:58:07.504300 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.504196    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "41e9a3e3-40d2-4d06-8f82-35bff06ef4b1" (UID: "41e9a3e3-40d2-4d06-8f82-35bff06ef4b1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:58:07.504300 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.504223    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-model-cache\") pod \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\" (UID: \"41e9a3e3-40d2-4d06-8f82-35bff06ef4b1\") "
Jul 16 12:58:07.504453 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.504434    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-model-cache" (OuterVolumeSpecName: "model-cache") pod "41e9a3e3-40d2-4d06-8f82-35bff06ef4b1" (UID: "41e9a3e3-40d2-4d06-8f82-35bff06ef4b1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:58:07.504578 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.504562    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-model-cache\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:58:07.504640 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.504584    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-tmp-dir\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:58:07.504640 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.504596    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-home\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:58:07.505964 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.505944    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-kube-api-access-gp9cv" (OuterVolumeSpecName: "kube-api-access-gp9cv") pod "41e9a3e3-40d2-4d06-8f82-35bff06ef4b1" (UID: "41e9a3e3-40d2-4d06-8f82-35bff06ef4b1"). InnerVolumeSpecName "kube-api-access-gp9cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:58:07.506119 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.506102    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-dshm" (OuterVolumeSpecName: "dshm") pod "41e9a3e3-40d2-4d06-8f82-35bff06ef4b1" (UID: "41e9a3e3-40d2-4d06-8f82-35bff06ef4b1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:58:07.506212 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.506196    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "41e9a3e3-40d2-4d06-8f82-35bff06ef4b1" (UID: "41e9a3e3-40d2-4d06-8f82-35bff06ef4b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:58:07.605942 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.605916    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp9cv\" (UniqueName: \"kubernetes.io/projected/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-kube-api-access-gp9cv\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:58:07.605942 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.605941    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-tls-certs\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:58:07.606088 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:07.605951    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1-dshm\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:58:08.025179 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.025130    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw" podUID="052193b0-decd-42bb-b9a6-482c3fb1e2f5" containerName="main" containerID="cri-o://3c28d70363eadb6bc7121b91a497784be56282044a43206f50a9350eb3b96244" gracePeriod=45
Jul 16 12:58:08.270060 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.270032    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:58:08.413577 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.413552    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrf55\" (UniqueName: \"kubernetes.io/projected/052193b0-decd-42bb-b9a6-482c3fb1e2f5-kube-api-access-nrf55\") pod \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") "
Jul 16 12:58:08.413761 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.413664    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-dshm\") pod \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") "
Jul 16 12:58:08.413761 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.413687    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-home\") pod \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") "
Jul 16 12:58:08.413761 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.413727    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-tmp-dir\") pod \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") "
Jul 16 12:58:08.413924 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.413762    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-model-cache\") pod \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") "
Jul 16 12:58:08.413924 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.413789    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/052193b0-decd-42bb-b9a6-482c3fb1e2f5-tls-certs\") pod \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\" (UID: \"052193b0-decd-42bb-b9a6-482c3fb1e2f5\") "
Jul 16 12:58:08.414041 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.413911    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-home" (OuterVolumeSpecName: "home") pod "052193b0-decd-42bb-b9a6-482c3fb1e2f5" (UID: "052193b0-decd-42bb-b9a6-482c3fb1e2f5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:58:08.414041 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.414010    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-model-cache" (OuterVolumeSpecName: "model-cache") pod "052193b0-decd-42bb-b9a6-482c3fb1e2f5" (UID: "052193b0-decd-42bb-b9a6-482c3fb1e2f5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:58:08.414041 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.414026    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "052193b0-decd-42bb-b9a6-482c3fb1e2f5" (UID: "052193b0-decd-42bb-b9a6-482c3fb1e2f5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:58:08.414187 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.414124    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-home\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:58:08.414187 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.414143    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-tmp-dir\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:58:08.414187 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.414155    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-model-cache\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:58:08.415711 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.415682    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-dshm" (OuterVolumeSpecName: "dshm") pod "052193b0-decd-42bb-b9a6-482c3fb1e2f5" (UID: "052193b0-decd-42bb-b9a6-482c3fb1e2f5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:58:08.415816 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.415786    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/052193b0-decd-42bb-b9a6-482c3fb1e2f5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "052193b0-decd-42bb-b9a6-482c3fb1e2f5" (UID: "052193b0-decd-42bb-b9a6-482c3fb1e2f5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:58:08.415816 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.415797    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/052193b0-decd-42bb-b9a6-482c3fb1e2f5-kube-api-access-nrf55" (OuterVolumeSpecName: "kube-api-access-nrf55") pod "052193b0-decd-42bb-b9a6-482c3fb1e2f5" (UID: "052193b0-decd-42bb-b9a6-482c3fb1e2f5"). InnerVolumeSpecName "kube-api-access-nrf55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:58:08.432733 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.432705    2581 generic.go:356] "Generic (PLEG): container finished" podID="052193b0-decd-42bb-b9a6-482c3fb1e2f5" containerID="3c28d70363eadb6bc7121b91a497784be56282044a43206f50a9350eb3b96244" exitCode=0
Jul 16 12:58:08.432863 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.432749    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"
Jul 16 12:58:08.432863 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.432782    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw" event={"ID":"052193b0-decd-42bb-b9a6-482c3fb1e2f5","Type":"ContainerDied","Data":"3c28d70363eadb6bc7121b91a497784be56282044a43206f50a9350eb3b96244"}
Jul 16 12:58:08.432863 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.432822    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw" event={"ID":"052193b0-decd-42bb-b9a6-482c3fb1e2f5","Type":"ContainerDied","Data":"457a8af0e57e18e62c6d59e6e35d6d105096122bfb4e96255bf5bcb33b20fe4e"}
Jul 16 12:58:08.432863 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.432839    2581 scope.go:117] "RemoveContainer" containerID="3c28d70363eadb6bc7121b91a497784be56282044a43206f50a9350eb3b96244"
Jul 16 12:58:08.433060 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.432867    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"
Jul 16 12:58:08.441492 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.441393    2581 scope.go:117] "RemoveContainer" containerID="3c28d70363eadb6bc7121b91a497784be56282044a43206f50a9350eb3b96244"
Jul 16 12:58:08.441649 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:58:08.441632    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c28d70363eadb6bc7121b91a497784be56282044a43206f50a9350eb3b96244\": container with ID starting with 3c28d70363eadb6bc7121b91a497784be56282044a43206f50a9350eb3b96244 not found: ID does not exist" containerID="3c28d70363eadb6bc7121b91a497784be56282044a43206f50a9350eb3b96244"
Jul 16 12:58:08.441691 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.441656    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c28d70363eadb6bc7121b91a497784be56282044a43206f50a9350eb3b96244"} err="failed to get container status \"3c28d70363eadb6bc7121b91a497784be56282044a43206f50a9350eb3b96244\": rpc error: code = NotFound desc = could not find container \"3c28d70363eadb6bc7121b91a497784be56282044a43206f50a9350eb3b96244\": container with ID starting with 3c28d70363eadb6bc7121b91a497784be56282044a43206f50a9350eb3b96244 not found: ID does not exist"
Jul 16 12:58:08.458744 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.458717    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"]
Jul 16 12:58:08.465800 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.465779    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/sub-test-model-293c75-kserve-7748bb75d5-9gclw"]
Jul 16 12:58:08.476735 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.476717    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"]
Jul 16 12:58:08.483277 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.483260    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-989150/sub-test-model-989150-kserve-5dd7bc888c-j6qvs"]
Jul 16 12:58:08.520383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.515997    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/052193b0-decd-42bb-b9a6-482c3fb1e2f5-tls-certs\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:58:08.520383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.516048    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrf55\" (UniqueName: \"kubernetes.io/projected/052193b0-decd-42bb-b9a6-482c3fb1e2f5-kube-api-access-nrf55\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:58:08.520383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.516068    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/052193b0-decd-42bb-b9a6-482c3fb1e2f5-dshm\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:58:08.981072 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:08.981038    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:58:09.413498 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:09.413468    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="052193b0-decd-42bb-b9a6-482c3fb1e2f5" path="/var/lib/kubelet/pods/052193b0-decd-42bb-b9a6-482c3fb1e2f5/volumes"
Jul 16 12:58:09.413840 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:09.413824    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41e9a3e3-40d2-4d06-8f82-35bff06ef4b1" path="/var/lib/kubelet/pods/41e9a3e3-40d2-4d06-8f82-35bff06ef4b1/volumes"
Jul 16 12:58:11.018002 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:11.017969    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:11.018439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:11.018029    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:11.029675 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:11.029649    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:11.457639 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:11.457609    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:58:22.139103 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.139070    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"]
Jul 16 12:58:22.139668 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.139641    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="052193b0-decd-42bb-b9a6-482c3fb1e2f5" containerName="main"
Jul 16 12:58:22.139668 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.139666    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="052193b0-decd-42bb-b9a6-482c3fb1e2f5" containerName="main"
Jul 16 12:58:22.139668 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.139684    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41e9a3e3-40d2-4d06-8f82-35bff06ef4b1" containerName="main"
Jul 16 12:58:22.139927 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.139692    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="41e9a3e3-40d2-4d06-8f82-35bff06ef4b1" containerName="main"
Jul 16 12:58:22.139927 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.139801    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="41e9a3e3-40d2-4d06-8f82-35bff06ef4b1" containerName="main"
Jul 16 12:58:22.139927 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.139819    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="052193b0-decd-42bb-b9a6-482c3fb1e2f5" containerName="main"
Jul 16 12:58:22.142825 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.142809    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.146145 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.146122    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-293c75\"/\"kube-root-ca.crt\""
Jul 16 12:58:22.146145 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.146133    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-293c75\"/\"openshift-service-ca.crt\""
Jul 16 12:58:22.146145 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.146133    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-293c75\"/\"rate-test-model-293c75-kserve-self-signed-certs\""
Jul 16 12:58:22.146377 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.146149    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-293c75\"/\"default-dockercfg-m8p2m\""
Jul 16 12:58:22.157265 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.157231    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"]
Jul 16 12:58:22.183727 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.183680    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:58:22.243871 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.243825    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-tmp-dir\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.244033 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.243894    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-home\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.244033 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.243917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-tls-certs\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.244033 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.243940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pdnx\" (UniqueName: \"kubernetes.io/projected/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-kube-api-access-5pdnx\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.244033 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.243960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-dshm\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.244226 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.244036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-model-cache\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.345160 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.345119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-home\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.345160 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.345162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-tls-certs\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.345439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.345192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pdnx\" (UniqueName: \"kubernetes.io/projected/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-kube-api-access-5pdnx\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.345439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.345213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-dshm\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.345439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.345251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-model-cache\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.345439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.345337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-tmp-dir\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.345644 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.345535    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-home\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.345698 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.345657    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-model-cache\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.345748 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.345705    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-tmp-dir\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.347446 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.347420    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-dshm\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.347691 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.347674    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-tls-certs\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.355788 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.355761    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pdnx\" (UniqueName: \"kubernetes.io/projected/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-kube-api-access-5pdnx\") pod \"rate-test-model-293c75-kserve-6c5fcf684c-b42nl\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") " pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.457324 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.457234    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:22.595114 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:22.595088    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"]
Jul 16 12:58:22.597233 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:58:22.597203    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65a5f66a_cb52_4056_ad3d_9cc4c895cc32.slice/crio-880a07cf9bceccb89c825d99fbf0c4a7fc88483024d2892a7166dbf5852a7fca WatchSource:0}: Error finding container 880a07cf9bceccb89c825d99fbf0c4a7fc88483024d2892a7166dbf5852a7fca: Status 404 returned error can't find the container with id 880a07cf9bceccb89c825d99fbf0c4a7fc88483024d2892a7166dbf5852a7fca
Jul 16 12:58:23.503878 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:23.503841    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl" event={"ID":"65a5f66a-cb52-4056-ad3d-9cc4c895cc32","Type":"ContainerStarted","Data":"ef36a1f457667b0b54b614bfcb8a43b34cb44ef37e6c23a5edf071642b7effb0"}
Jul 16 12:58:23.504347 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:23.503889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl" event={"ID":"65a5f66a-cb52-4056-ad3d-9cc4c895cc32","Type":"ContainerStarted","Data":"880a07cf9bceccb89c825d99fbf0c4a7fc88483024d2892a7166dbf5852a7fca"}
Jul 16 12:58:23.529915 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:23.529866    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl" podStartSLOduration=1.529847339 podStartE2EDuration="1.529847339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:58:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:58:23.528642404 +0000 UTC m=+2267.309216755" watchObservedRunningTime="2026-07-16 12:58:23.529847339 +0000 UTC m=+2267.310421376"
Jul 16 12:58:29.577141 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:29.577103    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:58:31.299016 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:31.298977    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:58:32.372407 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:32.372365    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:58:32.458496 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:32.458465    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:32.458652 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:32.458517    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:32.470825 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:32.470803    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:32.556505 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:32.556475    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:58:38.914763 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:38.914727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:58:39.025004 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:39.024969    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:58:46.990531 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:58:46.990492    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:59:05.775056 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:05.775022    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:59:12.763446 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:12.763415    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"]
Jul 16 12:59:12.786224 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:12.786192    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:13.641383 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:13.641326    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"]
Jul 16 12:59:13.667561 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:13.667528    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:27.484429 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:27.484393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:59:27.782761 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:27.782674    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m" podUID="539b0a8a-8f32-483c-882b-965ed147eeef" containerName="main" containerID="cri-o://50f438107ef6d5c6cf96469de29336c54afa165b79408910d3736106c13aa5d5" gracePeriod=45
Jul 16 12:59:28.030200 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.030178    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:59:28.115335 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.115257    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-dshm\") pod \"539b0a8a-8f32-483c-882b-965ed147eeef\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") "
Jul 16 12:59:28.115335 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.115317    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539b0a8a-8f32-483c-882b-965ed147eeef-tls-certs\") pod \"539b0a8a-8f32-483c-882b-965ed147eeef\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") "
Jul 16 12:59:28.115570 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.115376    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-home\") pod \"539b0a8a-8f32-483c-882b-965ed147eeef\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") "
Jul 16 12:59:28.115570 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.115434    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft82j\" (UniqueName: \"kubernetes.io/projected/539b0a8a-8f32-483c-882b-965ed147eeef-kube-api-access-ft82j\") pod \"539b0a8a-8f32-483c-882b-965ed147eeef\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") "
Jul 16 12:59:28.115570 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.115489    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-tmp-dir\") pod \"539b0a8a-8f32-483c-882b-965ed147eeef\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") "
Jul 16 12:59:28.115570 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.115518    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-model-cache\") pod \"539b0a8a-8f32-483c-882b-965ed147eeef\" (UID: \"539b0a8a-8f32-483c-882b-965ed147eeef\") "
Jul 16 12:59:28.115749 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.115630    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-home" (OuterVolumeSpecName: "home") pod "539b0a8a-8f32-483c-882b-965ed147eeef" (UID: "539b0a8a-8f32-483c-882b-965ed147eeef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:59:28.115858 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.115750    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "539b0a8a-8f32-483c-882b-965ed147eeef" (UID: "539b0a8a-8f32-483c-882b-965ed147eeef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:59:28.115858 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.115831    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-model-cache" (OuterVolumeSpecName: "model-cache") pod "539b0a8a-8f32-483c-882b-965ed147eeef" (UID: "539b0a8a-8f32-483c-882b-965ed147eeef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:59:28.115964 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.115922    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-home\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:59:28.115964 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.115941    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-tmp-dir\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:59:28.115964 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.115955    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-model-cache\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:59:28.117310 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.117287    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-dshm" (OuterVolumeSpecName: "dshm") pod "539b0a8a-8f32-483c-882b-965ed147eeef" (UID: "539b0a8a-8f32-483c-882b-965ed147eeef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:59:28.117439 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.117343    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/539b0a8a-8f32-483c-882b-965ed147eeef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "539b0a8a-8f32-483c-882b-965ed147eeef" (UID: "539b0a8a-8f32-483c-882b-965ed147eeef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:59:28.117518 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.117502    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/539b0a8a-8f32-483c-882b-965ed147eeef-kube-api-access-ft82j" (OuterVolumeSpecName: "kube-api-access-ft82j") pod "539b0a8a-8f32-483c-882b-965ed147eeef" (UID: "539b0a8a-8f32-483c-882b-965ed147eeef"). InnerVolumeSpecName "kube-api-access-ft82j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:59:28.217260 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.217227    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft82j\" (UniqueName: \"kubernetes.io/projected/539b0a8a-8f32-483c-882b-965ed147eeef-kube-api-access-ft82j\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:59:28.217260 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.217254    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/539b0a8a-8f32-483c-882b-965ed147eeef-dshm\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:59:28.217260 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.217264    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/539b0a8a-8f32-483c-882b-965ed147eeef-tls-certs\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:59:28.664060 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.663975    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl" podUID="65a5f66a-cb52-4056-ad3d-9cc4c895cc32" containerName="main" containerID="cri-o://ef36a1f457667b0b54b614bfcb8a43b34cb44ef37e6c23a5edf071642b7effb0" gracePeriod=45
Jul 16 12:59:28.809457 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.809431    2581 generic.go:356] "Generic (PLEG): container finished" podID="65a5f66a-cb52-4056-ad3d-9cc4c895cc32" containerID="ef36a1f457667b0b54b614bfcb8a43b34cb44ef37e6c23a5edf071642b7effb0" exitCode=0
Jul 16 12:59:28.809586 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.809500    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl" event={"ID":"65a5f66a-cb52-4056-ad3d-9cc4c895cc32","Type":"ContainerDied","Data":"ef36a1f457667b0b54b614bfcb8a43b34cb44ef37e6c23a5edf071642b7effb0"}
Jul 16 12:59:28.810835 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.810810    2581 generic.go:356] "Generic (PLEG): container finished" podID="539b0a8a-8f32-483c-882b-965ed147eeef" containerID="50f438107ef6d5c6cf96469de29336c54afa165b79408910d3736106c13aa5d5" exitCode=0
Jul 16 12:59:28.810942 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.810847    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"
Jul 16 12:59:28.810942 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.810867    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m" event={"ID":"539b0a8a-8f32-483c-882b-965ed147eeef","Type":"ContainerDied","Data":"50f438107ef6d5c6cf96469de29336c54afa165b79408910d3736106c13aa5d5"}
Jul 16 12:59:28.810942 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.810905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m" event={"ID":"539b0a8a-8f32-483c-882b-965ed147eeef","Type":"ContainerDied","Data":"4ab320f4c4c2e536b82f663e322e63a393e9db85355ac9ccc4cc4ae642649ddf"}
Jul 16 12:59:28.810942 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.810928    2581 scope.go:117] "RemoveContainer" containerID="50f438107ef6d5c6cf96469de29336c54afa165b79408910d3736106c13aa5d5"
Jul 16 12:59:28.819663 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.819643    2581 scope.go:117] "RemoveContainer" containerID="50f438107ef6d5c6cf96469de29336c54afa165b79408910d3736106c13aa5d5"
Jul 16 12:59:28.819974 ip-10-0-129-10 kubenswrapper[2581]: E0716 12:59:28.819954    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50f438107ef6d5c6cf96469de29336c54afa165b79408910d3736106c13aa5d5\": container with ID starting with 50f438107ef6d5c6cf96469de29336c54afa165b79408910d3736106c13aa5d5 not found: ID does not exist" containerID="50f438107ef6d5c6cf96469de29336c54afa165b79408910d3736106c13aa5d5"
Jul 16 12:59:28.820058 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.819980    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f438107ef6d5c6cf96469de29336c54afa165b79408910d3736106c13aa5d5"} err="failed to get container status \"50f438107ef6d5c6cf96469de29336c54afa165b79408910d3736106c13aa5d5\": rpc error: code = NotFound desc = could not find container \"50f438107ef6d5c6cf96469de29336c54afa165b79408910d3736106c13aa5d5\": container with ID starting with 50f438107ef6d5c6cf96469de29336c54afa165b79408910d3736106c13aa5d5 not found: ID does not exist"
Jul 16 12:59:28.833757 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.833738    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"]
Jul 16 12:59:28.839855 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.839833    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-989150/rate-test-model-989150-kserve-7b44d7cfbc-lq76m"]
Jul 16 12:59:28.914604 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:28.914552    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:59:29.024460 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.024434    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-model-cache\") pod \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") "
Jul 16 12:59:29.024642 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.024503    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-tls-certs\") pod \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") "
Jul 16 12:59:29.024642 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.024520    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-tmp-dir\") pod \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") "
Jul 16 12:59:29.024642 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.024536    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-home\") pod \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") "
Jul 16 12:59:29.024642 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.024608    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-dshm\") pod \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") "
Jul 16 12:59:29.024845 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.024649    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pdnx\" (UniqueName: \"kubernetes.io/projected/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-kube-api-access-5pdnx\") pod \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\" (UID: \"65a5f66a-cb52-4056-ad3d-9cc4c895cc32\") "
Jul 16 12:59:29.024845 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.024677    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-model-cache" (OuterVolumeSpecName: "model-cache") pod "65a5f66a-cb52-4056-ad3d-9cc4c895cc32" (UID: "65a5f66a-cb52-4056-ad3d-9cc4c895cc32"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:59:29.024845 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.024817    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "65a5f66a-cb52-4056-ad3d-9cc4c895cc32" (UID: "65a5f66a-cb52-4056-ad3d-9cc4c895cc32"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:59:29.024973 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.024904    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-home" (OuterVolumeSpecName: "home") pod "65a5f66a-cb52-4056-ad3d-9cc4c895cc32" (UID: "65a5f66a-cb52-4056-ad3d-9cc4c895cc32"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:59:29.025029 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.025010    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-model-cache\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:59:29.025029 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.025022    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-tmp-dir\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:59:29.025130 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.025030    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-home\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:59:29.026582 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.026558    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-dshm" (OuterVolumeSpecName: "dshm") pod "65a5f66a-cb52-4056-ad3d-9cc4c895cc32" (UID: "65a5f66a-cb52-4056-ad3d-9cc4c895cc32"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:59:29.026693 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.026627    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "65a5f66a-cb52-4056-ad3d-9cc4c895cc32" (UID: "65a5f66a-cb52-4056-ad3d-9cc4c895cc32"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:59:29.026693 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.026667    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-kube-api-access-5pdnx" (OuterVolumeSpecName: "kube-api-access-5pdnx") pod "65a5f66a-cb52-4056-ad3d-9cc4c895cc32" (UID: "65a5f66a-cb52-4056-ad3d-9cc4c895cc32"). InnerVolumeSpecName "kube-api-access-5pdnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:59:29.126111 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.126079    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pdnx\" (UniqueName: \"kubernetes.io/projected/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-kube-api-access-5pdnx\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:59:29.126111 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.126107    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-tls-certs\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:59:29.126111 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.126116    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a5f66a-cb52-4056-ad3d-9cc4c895cc32-dshm\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:59:29.413102 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.413071    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="539b0a8a-8f32-483c-882b-965ed147eeef" path="/var/lib/kubelet/pods/539b0a8a-8f32-483c-882b-965ed147eeef/volumes"
Jul 16 12:59:29.695674 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.695597    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7342-140363002466928"]
Jul 16 12:59:29.696024 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.695974    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65a5f66a-cb52-4056-ad3d-9cc4c895cc32" containerName="main"
Jul 16 12:59:29.696024 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.695986    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="65a5f66a-cb52-4056-ad3d-9cc4c895cc32" containerName="main"
Jul 16 12:59:29.696024 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.695995    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="539b0a8a-8f32-483c-882b-965ed147eeef" containerName="main"
Jul 16 12:59:29.696024 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.696000    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="539b0a8a-8f32-483c-882b-965ed147eeef" containerName="main"
Jul 16 12:59:29.696153 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.696050    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="539b0a8a-8f32-483c-882b-965ed147eeef" containerName="main"
Jul 16 12:59:29.696153 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.696059    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="65a5f66a-cb52-4056-ad3d-9cc4c895cc32" containerName="main"
Jul 16 12:59:29.699147 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.699132    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363002466928"
Jul 16 12:59:29.701133 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.701111    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hrwbx\""
Jul 16 12:59:29.706170 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.706145    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7342-140363002466928"]
Jul 16 12:59:29.818000 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.817971    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"
Jul 16 12:59:29.818189 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.817973    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl" event={"ID":"65a5f66a-cb52-4056-ad3d-9cc4c895cc32","Type":"ContainerDied","Data":"880a07cf9bceccb89c825d99fbf0c4a7fc88483024d2892a7166dbf5852a7fca"}
Jul 16 12:59:29.818189 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.818089    2581 scope.go:117] "RemoveContainer" containerID="ef36a1f457667b0b54b614bfcb8a43b34cb44ef37e6c23a5edf071642b7effb0"
Jul 16 12:59:29.833271 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.833243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4swwf\" (UniqueName: \"kubernetes.io/projected/454f726e-6428-4401-a16b-316f178d517c-kube-api-access-4swwf\") pod \"test-curl-7342-140363002466928\" (UID: \"454f726e-6428-4401-a16b-316f178d517c\") " pod="opendatahub/test-curl-7342-140363002466928"
Jul 16 12:59:29.835003 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.834984    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"]
Jul 16 12:59:29.841571 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.841551    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-293c75/rate-test-model-293c75-kserve-6c5fcf684c-b42nl"]
Jul 16 12:59:29.934441 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.934423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4swwf\" (UniqueName: \"kubernetes.io/projected/454f726e-6428-4401-a16b-316f178d517c-kube-api-access-4swwf\") pod \"test-curl-7342-140363002466928\" (UID: \"454f726e-6428-4401-a16b-316f178d517c\") " pod="opendatahub/test-curl-7342-140363002466928"
Jul 16 12:59:29.943245 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:29.943224    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4swwf\" (UniqueName: \"kubernetes.io/projected/454f726e-6428-4401-a16b-316f178d517c-kube-api-access-4swwf\") pod \"test-curl-7342-140363002466928\" (UID: \"454f726e-6428-4401-a16b-316f178d517c\") " pod="opendatahub/test-curl-7342-140363002466928"
Jul 16 12:59:30.009398 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:30.009339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363002466928"
Jul 16 12:59:30.138169 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:30.138145    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7342-140363002466928"]
Jul 16 12:59:30.140839 ip-10-0-129-10 kubenswrapper[2581]: W0716 12:59:30.140811    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod454f726e_6428_4401_a16b_316f178d517c.slice/crio-f5815a5e07ce8373bb78e732dee2dc928d69ee35a0e09cbebf76be27e36ac2eb WatchSource:0}: Error finding container f5815a5e07ce8373bb78e732dee2dc928d69ee35a0e09cbebf76be27e36ac2eb: Status 404 returned error can't find the container with id f5815a5e07ce8373bb78e732dee2dc928d69ee35a0e09cbebf76be27e36ac2eb
Jul 16 12:59:30.142106 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:30.142088    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:59:30.824490 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:30.824460    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7342-140363002466928" event={"ID":"454f726e-6428-4401-a16b-316f178d517c","Type":"ContainerStarted","Data":"f5815a5e07ce8373bb78e732dee2dc928d69ee35a0e09cbebf76be27e36ac2eb"}
Jul 16 12:59:31.413615 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:31.413583    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65a5f66a-cb52-4056-ad3d-9cc4c895cc32" path="/var/lib/kubelet/pods/65a5f66a-cb52-4056-ad3d-9cc4c895cc32/volumes"
Jul 16 12:59:31.831246 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:31.831159    2581 generic.go:356] "Generic (PLEG): container finished" podID="454f726e-6428-4401-a16b-316f178d517c" containerID="37c72d6b24ec20dea0d1917ca9ab42c1ec965cf8923a644d381798ad5f124891" exitCode=0
Jul 16 12:59:31.831246 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:31.831237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7342-140363002466928" event={"ID":"454f726e-6428-4401-a16b-316f178d517c","Type":"ContainerDied","Data":"37c72d6b24ec20dea0d1917ca9ab42c1ec965cf8923a644d381798ad5f124891"}
Jul 16 12:59:32.961807 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:32.961783    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363002466928"
Jul 16 12:59:32.987048 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:32.987022    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7342-140363002466928_454f726e-6428-4401-a16b-316f178d517c/test-curl-7342-140363002466928/0.log"
Jul 16 12:59:33.012565 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:33.012542    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7342-140363002466928"]
Jul 16 12:59:33.016688 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:33.016670    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7342-140363002466928"]
Jul 16 12:59:33.064708 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:33.064684    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4swwf\" (UniqueName: \"kubernetes.io/projected/454f726e-6428-4401-a16b-316f178d517c-kube-api-access-4swwf\") pod \"454f726e-6428-4401-a16b-316f178d517c\" (UID: \"454f726e-6428-4401-a16b-316f178d517c\") "
Jul 16 12:59:33.066831 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:33.066810    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/454f726e-6428-4401-a16b-316f178d517c-kube-api-access-4swwf" (OuterVolumeSpecName: "kube-api-access-4swwf") pod "454f726e-6428-4401-a16b-316f178d517c" (UID: "454f726e-6428-4401-a16b-316f178d517c"). InnerVolumeSpecName "kube-api-access-4swwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:59:33.165962 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:33.165943    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4swwf\" (UniqueName: \"kubernetes.io/projected/454f726e-6428-4401-a16b-316f178d517c-kube-api-access-4swwf\") on node \"ip-10-0-129-10.ec2.internal\" DevicePath \"\""
Jul 16 12:59:33.413334 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:33.413300    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="454f726e-6428-4401-a16b-316f178d517c" path="/var/lib/kubelet/pods/454f726e-6428-4401-a16b-316f178d517c/volumes"
Jul 16 12:59:33.575796 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:33.575759    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:33.842029 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:33.841949    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7342-140363002466928"
Jul 16 12:59:33.842029 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:33.841970    2581 scope.go:117] "RemoveContainer" containerID="37c72d6b24ec20dea0d1917ca9ab42c1ec965cf8923a644d381798ad5f124891"
Jul 16 12:59:40.410699 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:40.410659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:40.509724 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:40.509689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:40.711486 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:40.711394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:40.940680 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:40.940644    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:41.466461 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:41.466429    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:44.872151 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:44.872119    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:59:45.737965 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:45.737932    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:45.833403 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:45.833377    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:47.956861 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:47.956829    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:48.040982 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:48.040948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:48.245880 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:48.245802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:48.492653 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:48.492619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 12:59:54.526825 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:54.526794    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-czgq2_cac46431-418e-4f57-9324-46daa414627e/manager/0.log"
Jul 16 12:59:55.045233 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:55.045209    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87d97db45-fn2js_f53e5384-9c1f-4ab1-893a-76c1f393870d/copy-manifests/0.log"
Jul 16 12:59:55.066639 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:55.066614    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87d97db45-fn2js_f53e5384-9c1f-4ab1-893a-76c1f393870d/manager/0.log"
Jul 16 12:59:55.930370 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:55.930330    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-a-467ea0-5ff5f7f59f-cd9dn_57317ce2-424f-4437-aaf7-bbc2fecdaa64/maas-api/0.log"
Jul 16 12:59:56.779068 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:56.779036    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-a-989150-548d8d7c79-b9b8q_7ad9e735-b344-4882-b08f-d9524c9ec8a1/maas-api/0.log"
Jul 16 12:59:56.900924 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:56.900895    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-b-293c75-5b86845bcc-922dw_3c079b08-54cd-42bb-8a78-0f5a51dac294/maas-api/0.log"
Jul 16 12:59:57.022768 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:57.022744    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736750-hkn48_ac4f5720-ff0f-47f2-8bd2-fa252939870e/cleanup/0.log"
Jul 16 12:59:58.784136 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:58.784106    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7rnmh"]
Jul 16 12:59:58.857813 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:58.857780    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-z8xs6_592975d7-9cf7-4df3-9ee9-9d2bc873bb3d/manager/0.log"
Jul 16 12:59:58.973469 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:58.973444    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rwk9j_de344ce6-c365-4a6e-b3f9-fa6067aa8321/kuadrant-console-plugin/0.log"
Jul 16 12:59:59.364155 ip-10-0-129-10 kubenswrapper[2581]: I0716 12:59:59.364127    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7rnmh_2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78/limitador/0.log"
Jul 16 13:00:00.096580 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.096551    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5767f667-d87nt_7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80/kube-auth-proxy/0.log"
Jul 16 13:00:00.147271 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.147243    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-467ea0-29736780-r7z2j"]
Jul 16 13:00:00.147642 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.147628    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="454f726e-6428-4401-a16b-316f178d517c" containerName="test-curl-7342-140363002466928"
Jul 16 13:00:00.147690 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.147644    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="454f726e-6428-4401-a16b-316f178d517c" containerName="test-curl-7342-140363002466928"
Jul 16 13:00:00.147724 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.147715    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="454f726e-6428-4401-a16b-316f178d517c" containerName="test-curl-7342-140363002466928"
Jul 16 13:00:00.150863 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.150849    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-467ea0-29736780-r7z2j"
Jul 16 13:00:00.153044 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.153031    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zjpqc\""
Jul 16 13:00:00.160609 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.160582    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-467ea0-29736780-r7z2j"
Jul 16 13:00:00.161057 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.161034    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5f31a77-29736780-xtclw"]
Jul 16 13:00:00.165412 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.165105    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b2b0c9-29736780-rdw57"]
Jul 16 13:00:00.165412 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.165209    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5f31a77-29736780-xtclw"
Jul 16 13:00:00.169125 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.169104    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-825c20-29736780-k6snc"]
Jul 16 13:00:00.169234 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.169218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b2b0c9-29736780-rdw57"
Jul 16 13:00:00.172584 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.172566    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-467ea0-29736780-r7z2j"]
Jul 16 13:00:00.172694 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.172666    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-825c20-29736780-k6snc"
Jul 16 13:00:00.189449 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.187454    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2e36a3ff-29736780-5pcks"]
Jul 16 13:00:00.195878 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.195744    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5f31a77-29736780-xtclw"]
Jul 16 13:00:00.195878 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.195786    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b2b0c9-29736780-rdw57"]
Jul 16 13:00:00.195878 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.195878    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2e36a3ff-29736780-5pcks"
Jul 16 13:00:00.197089 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.197028    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-825c20-29736780-k6snc"]
Jul 16 13:00:00.199260 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.199213    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-767373bc-29736780-p9hgg"]
Jul 16 13:00:00.201439 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.201048    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5f31a77-29736780-xtclw"
Jul 16 13:00:00.208825 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.204841    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2e36a3ff-29736780-5pcks"]
Jul 16 13:00:00.208825 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.204977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-767373bc-29736780-p9hgg"
Jul 16 13:00:00.212294 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.211703    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-767373bc-29736780-p9hgg"]
Jul 16 13:00:00.213118 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.213094    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b2b0c9-29736780-rdw57"
Jul 16 13:00:00.266289 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.266144    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-825c20-29736780-k6snc"
Jul 16 13:00:00.277483 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.277459    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2e36a3ff-29736780-5pcks"
Jul 16 13:00:00.290452 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.290224    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-767373bc-29736780-p9hgg"
Jul 16 13:00:00.358603 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.358529    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-467ea0-29736780-r7z2j"]
Jul 16 13:00:00.360036 ip-10-0-129-10 kubenswrapper[2581]: W0716 13:00:00.359998    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9928634b_7a13_4cf2_aeb8_fe63a2465002.slice/crio-e539fd7333b07ac4c94fc12e58eb6ef1d7d6ad1ae44f0aa7869d3c7b09b0758b WatchSource:0}: Error finding container e539fd7333b07ac4c94fc12e58eb6ef1d7d6ad1ae44f0aa7869d3c7b09b0758b: Status 404 returned error can't find the container with id e539fd7333b07ac4c94fc12e58eb6ef1d7d6ad1ae44f0aa7869d3c7b09b0758b
Jul 16 13:00:00.406499 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.406433    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5f31a77-29736780-xtclw"]
Jul 16 13:00:00.492700 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.492653    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-825c20-29736780-k6snc"]
Jul 16 13:00:00.494701 ip-10-0-129-10 kubenswrapper[2581]: W0716 13:00:00.494678    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfa63d3_87bd_46fd_bcc3_7afda64918e1.slice/crio-b0fcb3c7342104a99aac30bb2cf23105bc019f40426e7f0191d1a3f53a229fcf WatchSource:0}: Error finding container b0fcb3c7342104a99aac30bb2cf23105bc019f40426e7f0191d1a3f53a229fcf: Status 404 returned error can't find the container with id b0fcb3c7342104a99aac30bb2cf23105bc019f40426e7f0191d1a3f53a229fcf
Jul 16 13:00:00.505937 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.505912    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-767373bc-29736780-p9hgg"]
Jul 16 13:00:00.514113 ip-10-0-129-10 kubenswrapper[2581]: W0716 13:00:00.514063    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4394d28a_eae8_4201_8313_efd7dd7f325c.slice/crio-4441ac0c51b2a3c9ddfa5307d772683fb88809fe9816c12060efc1e0acdcf051 WatchSource:0}: Error finding container 4441ac0c51b2a3c9ddfa5307d772683fb88809fe9816c12060efc1e0acdcf051: Status 404 returned error can't find the container with id 4441ac0c51b2a3c9ddfa5307d772683fb88809fe9816c12060efc1e0acdcf051
Jul 16 13:00:00.534281 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.534259    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2e36a3ff-29736780-5pcks"]
Jul 16 13:00:00.535823 ip-10-0-129-10 kubenswrapper[2581]: W0716 13:00:00.535802    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6a4e9b_d276_46fc_ae51_e79606c8eda6.slice/crio-71038932948c54d5ea1221b0e73037647997fb864c251828e580ef91a4c32200 WatchSource:0}: Error finding container 71038932948c54d5ea1221b0e73037647997fb864c251828e580ef91a4c32200: Status 404 returned error can't find the container with id 71038932948c54d5ea1221b0e73037647997fb864c251828e580ef91a4c32200
Jul 16 13:00:00.655004 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.654975    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b2b0c9-29736780-rdw57"]
Jul 16 13:00:00.659619 ip-10-0-129-10 kubenswrapper[2581]: W0716 13:00:00.657423    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b30124d_dcb0_4a7c_940c_341ca7f86ccc.slice/crio-c9ada412086954e266e9a481101a415eddebee89cfceebf5cdc2631c794954f2 WatchSource:0}: Error finding container c9ada412086954e266e9a481101a415eddebee89cfceebf5cdc2631c794954f2: Status 404 returned error can't find the container with id c9ada412086954e266e9a481101a415eddebee89cfceebf5cdc2631c794954f2
Jul 16 13:00:00.970042 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.970016    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-825c20-29736780-k6snc" event={"ID":"5cfa63d3-87bd-46fd-bcc3-7afda64918e1","Type":"ContainerStarted","Data":"56452f2a79618ac805a2cbed60471763bb122520c4e6879c6e134c6bd2a67c1e"}
Jul 16 13:00:00.970160 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.970071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-825c20-29736780-k6snc" event={"ID":"5cfa63d3-87bd-46fd-bcc3-7afda64918e1","Type":"ContainerStarted","Data":"b0fcb3c7342104a99aac30bb2cf23105bc019f40426e7f0191d1a3f53a229fcf"}
Jul 16 13:00:00.971516 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.971490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5f31a77-29736780-xtclw" event={"ID":"f8e49c04-e8fd-4175-9558-2d988a45c991","Type":"ContainerStarted","Data":"8a989f4792f13fc976b75246ba095148708934b9ada9e4b7a1677fafa1d48974"}
Jul 16 13:00:00.971615 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.971536    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5f31a77-29736780-xtclw" event={"ID":"f8e49c04-e8fd-4175-9558-2d988a45c991","Type":"ContainerStarted","Data":"d852c32311517456fc8a69a0b38058162aff559bf1f8af129b91a3111feab500"}
Jul 16 13:00:00.972929 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.972907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-767373bc-29736780-p9hgg" event={"ID":"4394d28a-eae8-4201-8313-efd7dd7f325c","Type":"ContainerStarted","Data":"605f2f7cb9c82895681292ba5b6ca5d130fa9dad44a82e5a4775c16ea37f13ec"}
Jul 16 13:00:00.973009 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.972958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-767373bc-29736780-p9hgg" event={"ID":"4394d28a-eae8-4201-8313-efd7dd7f325c","Type":"ContainerStarted","Data":"4441ac0c51b2a3c9ddfa5307d772683fb88809fe9816c12060efc1e0acdcf051"}
Jul 16 13:00:00.974290 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.974267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2e36a3ff-29736780-5pcks" event={"ID":"7b6a4e9b-d276-46fc-ae51-e79606c8eda6","Type":"ContainerStarted","Data":"71038932948c54d5ea1221b0e73037647997fb864c251828e580ef91a4c32200"}
Jul 16 13:00:00.975283 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.975260    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b2b0c9-29736780-rdw57" event={"ID":"0b30124d-dcb0-4a7c-940c-341ca7f86ccc","Type":"ContainerStarted","Data":"c9ada412086954e266e9a481101a415eddebee89cfceebf5cdc2631c794954f2"}
Jul 16 13:00:00.976479 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.976462    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-467ea0-29736780-r7z2j" event={"ID":"9928634b-7a13-4cf2-aeb8-fe63a2465002","Type":"ContainerStarted","Data":"205940858fa0732cbc4886a9cc88737480f9631966fb61874d8b8a4902132988"}
Jul 16 13:00:00.976552 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.976497    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-467ea0-29736780-r7z2j" event={"ID":"9928634b-7a13-4cf2-aeb8-fe63a2465002","Type":"ContainerStarted","Data":"e539fd7333b07ac4c94fc12e58eb6ef1d7d6ad1ae44f0aa7869d3c7b09b0758b"}
Jul 16 13:00:00.987434 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:00.987395    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-825c20-29736780-k6snc" podStartSLOduration=0.987381833 podStartE2EDuration="987.381833ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:00:00.985026253 +0000 UTC m=+2364.765600287" watchObservedRunningTime="2026-07-16 13:00:00.987381833 +0000 UTC m=+2364.767955873"
Jul 16 13:00:01.003702 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.003664    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2e36a3ff-29736780-5pcks" podStartSLOduration=1.003652493 podStartE2EDuration="1.003652493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:00:01.001850408 +0000 UTC m=+2364.782424799" watchObservedRunningTime="2026-07-16 13:00:01.003652493 +0000 UTC m=+2364.784226574"
Jul 16 13:00:01.018162 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.018127    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-767373bc-29736780-p9hgg" podStartSLOduration=1.018115535 podStartE2EDuration="1.018115535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:00:01.016556278 +0000 UTC m=+2364.797130319" watchObservedRunningTime="2026-07-16 13:00:01.018115535 +0000 UTC m=+2364.798689633"
Jul 16 13:00:01.049000 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.048968    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-467ea0-29736780-r7z2j" podStartSLOduration=1.048955772 podStartE2EDuration="1.048955772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:00:01.048105846 +0000 UTC m=+2364.828679887" watchObservedRunningTime="2026-07-16 13:00:01.048955772 +0000 UTC m=+2364.829529813"
Jul 16 13:00:01.066661 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.066627    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5f31a77-29736780-xtclw" podStartSLOduration=1.066618534 podStartE2EDuration="1.066618534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:00:01.06589806 +0000 UTC m=+2364.846472099" watchObservedRunningTime="2026-07-16 13:00:01.066618534 +0000 UTC m=+2364.847192573"
Jul 16 13:00:01.207997 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.207956    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-754kh_4d6bddf9-1a78-4960-9821-f44f5184c65c/main/0.log"
Jul 16 13:00:01.560615 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.560574    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4pdfr_fb5785c9-32f2-4909-8612-5d220aa3c956/main/0.log"
Jul 16 13:00:01.683417 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.683343    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-jnmkg_a23bf383-5461-482a-8c0b-6b890dc0125c/main/0.log"
Jul 16 13:00:01.983251 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.983172    2581 generic.go:356] "Generic (PLEG): container finished" podID="5cfa63d3-87bd-46fd-bcc3-7afda64918e1" containerID="56452f2a79618ac805a2cbed60471763bb122520c4e6879c6e134c6bd2a67c1e" exitCode=0
Jul 16 13:00:01.983251 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.983243    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-825c20-29736780-k6snc" event={"ID":"5cfa63d3-87bd-46fd-bcc3-7afda64918e1","Type":"ContainerDied","Data":"56452f2a79618ac805a2cbed60471763bb122520c4e6879c6e134c6bd2a67c1e"}
Jul 16 13:00:01.984753 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.984730    2581 generic.go:356] "Generic (PLEG): container finished" podID="f8e49c04-e8fd-4175-9558-2d988a45c991" containerID="8a989f4792f13fc976b75246ba095148708934b9ada9e4b7a1677fafa1d48974" exitCode=0
Jul 16 13:00:01.984866 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.984798    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5f31a77-29736780-xtclw" event={"ID":"f8e49c04-e8fd-4175-9558-2d988a45c991","Type":"ContainerDied","Data":"8a989f4792f13fc976b75246ba095148708934b9ada9e4b7a1677fafa1d48974"}
Jul 16 13:00:01.986148 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.986127    2581 generic.go:356] "Generic (PLEG): container finished" podID="4394d28a-eae8-4201-8313-efd7dd7f325c" containerID="605f2f7cb9c82895681292ba5b6ca5d130fa9dad44a82e5a4775c16ea37f13ec" exitCode=0
Jul 16 13:00:01.986217 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.986194    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-767373bc-29736780-p9hgg" event={"ID":"4394d28a-eae8-4201-8313-efd7dd7f325c","Type":"ContainerDied","Data":"605f2f7cb9c82895681292ba5b6ca5d130fa9dad44a82e5a4775c16ea37f13ec"}
Jul 16 13:00:01.987437 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.987419    2581 generic.go:356] "Generic (PLEG): container finished" podID="7b6a4e9b-d276-46fc-ae51-e79606c8eda6" containerID="968237a7dc48a2ea6e9ac7bfd9340e3af202d6ddcd4c2130179e08663b8e210e" exitCode=0
Jul 16 13:00:01.987521 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.987487    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2e36a3ff-29736780-5pcks" event={"ID":"7b6a4e9b-d276-46fc-ae51-e79606c8eda6","Type":"ContainerDied","Data":"968237a7dc48a2ea6e9ac7bfd9340e3af202d6ddcd4c2130179e08663b8e210e"}
Jul 16 13:00:01.988755 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.988738    2581 generic.go:356] "Generic (PLEG): container finished" podID="0b30124d-dcb0-4a7c-940c-341ca7f86ccc" containerID="204cb91c6d993544fbbe771261b9c03bacb94ca78aa0ed792359da75b4142020" exitCode=0
Jul 16 13:00:01.988825 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.988804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b2b0c9-29736780-rdw57" event={"ID":"0b30124d-dcb0-4a7c-940c-341ca7f86ccc","Type":"ContainerDied","Data":"204cb91c6d993544fbbe771261b9c03bacb94ca78aa0ed792359da75b4142020"}
Jul 16 13:00:01.990161 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.990143    2581 generic.go:356] "Generic (PLEG): container finished" podID="9928634b-7a13-4cf2-aeb8-fe63a2465002" containerID="205940858fa0732cbc4886a9cc88737480f9631966fb61874d8b8a4902132988" exitCode=0
Jul 16 13:00:01.990237 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:01.990188    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-467ea0-29736780-r7z2j" event={"ID":"9928634b-7a13-4cf2-aeb8-fe63a2465002","Type":"ContainerDied","Data":"205940858fa0732cbc4886a9cc88737480f9631966fb61874d8b8a4902132988"}
Jul 16 13:00:03.153827 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:03.153805    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2e36a3ff-29736780-5pcks"
Jul 16 13:00:03.224116 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:03.224071    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5f31a77-29736780-xtclw"
Jul 16 13:00:03.253053 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:03.252985    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-825c20-29736780-k6snc"
Jul 16 13:00:03.263788 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:03.263770    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b2b0c9-29736780-rdw57"
Jul 16 13:00:03.276593 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:03.276560    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-767373bc-29736780-p9hgg"
Jul 16 13:00:03.278571 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:03.278553    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-467ea0-29736780-r7z2j"
Jul 16 13:00:04.004706 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.004674    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5f31a77-29736780-xtclw"
Jul 16 13:00:04.004706 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.004687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f5f31a77-29736780-xtclw" event={"ID":"f8e49c04-e8fd-4175-9558-2d988a45c991","Type":"ContainerDied","Data":"d852c32311517456fc8a69a0b38058162aff559bf1f8af129b91a3111feab500"}
Jul 16 13:00:04.004950 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.004766    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d852c32311517456fc8a69a0b38058162aff559bf1f8af129b91a3111feab500"
Jul 16 13:00:04.006219 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.006200    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-767373bc-29736780-p9hgg"
Jul 16 13:00:04.006377 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.006241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-767373bc-29736780-p9hgg" event={"ID":"4394d28a-eae8-4201-8313-efd7dd7f325c","Type":"ContainerDied","Data":"4441ac0c51b2a3c9ddfa5307d772683fb88809fe9816c12060efc1e0acdcf051"}
Jul 16 13:00:04.006377 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.006287    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4441ac0c51b2a3c9ddfa5307d772683fb88809fe9816c12060efc1e0acdcf051"
Jul 16 13:00:04.007676 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.007655    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2e36a3ff-29736780-5pcks"
Jul 16 13:00:04.007795 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.007680    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-2e36a3ff-29736780-5pcks" event={"ID":"7b6a4e9b-d276-46fc-ae51-e79606c8eda6","Type":"ContainerDied","Data":"71038932948c54d5ea1221b0e73037647997fb864c251828e580ef91a4c32200"}
Jul 16 13:00:04.007795 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.007721    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71038932948c54d5ea1221b0e73037647997fb864c251828e580ef91a4c32200"
Jul 16 13:00:04.009076 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.009061    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b2b0c9-29736780-rdw57"
Jul 16 13:00:04.009171 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.009087    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-b2b0c9-29736780-rdw57" event={"ID":"0b30124d-dcb0-4a7c-940c-341ca7f86ccc","Type":"ContainerDied","Data":"c9ada412086954e266e9a481101a415eddebee89cfceebf5cdc2631c794954f2"}
Jul 16 13:00:04.009171 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.009123    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9ada412086954e266e9a481101a415eddebee89cfceebf5cdc2631c794954f2"
Jul 16 13:00:04.010483 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.010469    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-467ea0-29736780-r7z2j"
Jul 16 13:00:04.010483 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.010477    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-467ea0-29736780-r7z2j" event={"ID":"9928634b-7a13-4cf2-aeb8-fe63a2465002","Type":"ContainerDied","Data":"e539fd7333b07ac4c94fc12e58eb6ef1d7d6ad1ae44f0aa7869d3c7b09b0758b"}
Jul 16 13:00:04.010625 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.010508    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e539fd7333b07ac4c94fc12e58eb6ef1d7d6ad1ae44f0aa7869d3c7b09b0758b"
Jul 16 13:00:04.011786 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.011767    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-825c20-29736780-k6snc" event={"ID":"5cfa63d3-87bd-46fd-bcc3-7afda64918e1","Type":"ContainerDied","Data":"b0fcb3c7342104a99aac30bb2cf23105bc019f40426e7f0191d1a3f53a229fcf"}
Jul 16 13:00:04.011880 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.011794    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-825c20-29736780-k6snc"
Jul 16 13:00:04.011880 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:04.011798    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0fcb3c7342104a99aac30bb2cf23105bc019f40426e7f0191d1a3f53a229fcf"
Jul 16 13:00:07.073885 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.073848    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ndv85/must-gather-8klbn"]
Jul 16 13:00:07.074270 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074209    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cfa63d3-87bd-46fd-bcc3-7afda64918e1" containerName="cleanup"
Jul 16 13:00:07.074270 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074220    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cfa63d3-87bd-46fd-bcc3-7afda64918e1" containerName="cleanup"
Jul 16 13:00:07.074270 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074232    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9928634b-7a13-4cf2-aeb8-fe63a2465002" containerName="cleanup"
Jul 16 13:00:07.074270 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074237    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9928634b-7a13-4cf2-aeb8-fe63a2465002" containerName="cleanup"
Jul 16 13:00:07.074270 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074254    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b6a4e9b-d276-46fc-ae51-e79606c8eda6" containerName="cleanup"
Jul 16 13:00:07.074270 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074259    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b6a4e9b-d276-46fc-ae51-e79606c8eda6" containerName="cleanup"
Jul 16 13:00:07.074270 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074265    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4394d28a-eae8-4201-8313-efd7dd7f325c" containerName="cleanup"
Jul 16 13:00:07.074270 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074270    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4394d28a-eae8-4201-8313-efd7dd7f325c" containerName="cleanup"
Jul 16 13:00:07.074270 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074275    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e49c04-e8fd-4175-9558-2d988a45c991" containerName="cleanup"
Jul 16 13:00:07.074634 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074280    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e49c04-e8fd-4175-9558-2d988a45c991" containerName="cleanup"
Jul 16 13:00:07.074634 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074289    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b30124d-dcb0-4a7c-940c-341ca7f86ccc" containerName="cleanup"
Jul 16 13:00:07.074634 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074294    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b30124d-dcb0-4a7c-940c-341ca7f86ccc" containerName="cleanup"
Jul 16 13:00:07.074634 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074346    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8e49c04-e8fd-4175-9558-2d988a45c991" containerName="cleanup"
Jul 16 13:00:07.074634 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074366    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cfa63d3-87bd-46fd-bcc3-7afda64918e1" containerName="cleanup"
Jul 16 13:00:07.074634 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074371    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b30124d-dcb0-4a7c-940c-341ca7f86ccc" containerName="cleanup"
Jul 16 13:00:07.074634 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074377    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4394d28a-eae8-4201-8313-efd7dd7f325c" containerName="cleanup"
Jul 16 13:00:07.074634 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074384    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b6a4e9b-d276-46fc-ae51-e79606c8eda6" containerName="cleanup"
Jul 16 13:00:07.074634 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.074389    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9928634b-7a13-4cf2-aeb8-fe63a2465002" containerName="cleanup"
Jul 16 13:00:07.079294 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.079272    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ndv85/must-gather-8klbn"
Jul 16 13:00:07.081435 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.081409    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ndv85\"/\"default-dockercfg-7mnpt\""
Jul 16 13:00:07.081540 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.081474    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ndv85\"/\"kube-root-ca.crt\""
Jul 16 13:00:07.082371 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.082336    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ndv85\"/\"openshift-service-ca.crt\""
Jul 16 13:00:07.086349 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.086328    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ndv85/must-gather-8klbn"]
Jul 16 13:00:07.108901 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.108874    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 13:00:07.152770 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.152742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d-must-gather-output\") pod \"must-gather-8klbn\" (UID: \"7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d\") " pod="openshift-must-gather-ndv85/must-gather-8klbn"
Jul 16 13:00:07.152917 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.152779    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnk9z\" (UniqueName: \"kubernetes.io/projected/7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d-kube-api-access-bnk9z\") pod \"must-gather-8klbn\" (UID: \"7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d\") " pod="openshift-must-gather-ndv85/must-gather-8klbn"
Jul 16 13:00:07.220770 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.220739    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 13:00:07.254107 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.254085    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d-must-gather-output\") pod \"must-gather-8klbn\" (UID: \"7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d\") " pod="openshift-must-gather-ndv85/must-gather-8klbn"
Jul 16 13:00:07.254237 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.254122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnk9z\" (UniqueName: \"kubernetes.io/projected/7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d-kube-api-access-bnk9z\") pod \"must-gather-8klbn\" (UID: \"7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d\") " pod="openshift-must-gather-ndv85/must-gather-8klbn"
Jul 16 13:00:07.254498 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.254480    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d-must-gather-output\") pod \"must-gather-8klbn\" (UID: \"7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d\") " pod="openshift-must-gather-ndv85/must-gather-8klbn"
Jul 16 13:00:07.263479 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.263456    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnk9z\" (UniqueName: \"kubernetes.io/projected/7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d-kube-api-access-bnk9z\") pod \"must-gather-8klbn\" (UID: \"7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d\") " pod="openshift-must-gather-ndv85/must-gather-8klbn"
Jul 16 13:00:07.389136 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.389106    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ndv85/must-gather-8klbn"
Jul 16 13:00:07.524685 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:07.524661    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ndv85/must-gather-8klbn"]
Jul 16 13:00:07.526396 ip-10-0-129-10 kubenswrapper[2581]: W0716 13:00:07.526352    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ff2bed4_eeb5_4f48_8f15_5f2ad8cba57d.slice/crio-1d28b8d573e5d4a6505e8ad7f5461cfcca3c009cb4367f4a43ccf0c88a824e95 WatchSource:0}: Error finding container 1d28b8d573e5d4a6505e8ad7f5461cfcca3c009cb4367f4a43ccf0c88a824e95: Status 404 returned error can't find the container with id 1d28b8d573e5d4a6505e8ad7f5461cfcca3c009cb4367f4a43ccf0c88a824e95
Jul 16 13:00:08.033414 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:08.033381    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ndv85/must-gather-8klbn" event={"ID":"7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d","Type":"ContainerStarted","Data":"1d28b8d573e5d4a6505e8ad7f5461cfcca3c009cb4367f4a43ccf0c88a824e95"}
Jul 16 13:00:09.044234 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:09.044186    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ndv85/must-gather-8klbn" event={"ID":"7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d","Type":"ContainerStarted","Data":"51e05d6fd788b513b09ab2acc74c3631034890498e12c77ede6872778f8b7db6"}
Jul 16 13:00:09.044740 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:09.044258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ndv85/must-gather-8klbn" event={"ID":"7ff2bed4-eeb5-4f48-8f15-5f2ad8cba57d","Type":"ContainerStarted","Data":"2fc43e0fb498755f0f7ab04e614f87704025d319e9860915497a6063f55c31d0"}
Jul 16 13:00:09.066108 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:09.066038    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ndv85/must-gather-8klbn" podStartSLOduration=1.246025449 podStartE2EDuration="2.066014809s" totalImagesPullingTime="819.98936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:00:09.061931207 +0000 UTC m=+2372.842505247" watchObservedRunningTime="2026-07-16 13:00:09.066014809 +0000 UTC m=+2372.846588850"
Jul 16 13:00:09.984732 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:09.984692    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mw6lt_09aca51a-379f-49af-bb70-476a85243914/global-pull-secret-syncer/0.log"
Jul 16 13:00:10.082346 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:10.082318    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log"
Jul 16 13:00:10.189070 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:10.189037    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-10.ec2.internal_0755975f4b2d3e701c655b70a8e50e7d/haproxy/0.log"
Jul 16 13:00:15.139602 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:15.139565    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-z8xs6_592975d7-9cf7-4df3-9ee9-9d2bc873bb3d/manager/0.log"
Jul 16 13:00:15.188913 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:15.188871    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rwk9j_de344ce6-c365-4a6e-b3f9-fa6067aa8321/kuadrant-console-plugin/0.log"
Jul 16 13:00:15.465342 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:15.465263    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7rnmh_2c508ea9-cb8c-40e5-98b9-1bbc34d2dc78/limitador/0.log"
Jul 16 13:00:17.122306 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.122280    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262/alertmanager/0.log"
Jul 16 13:00:17.163390 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.163342    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262/config-reloader/0.log"
Jul 16 13:00:17.210281 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.210248    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262/kube-rbac-proxy-web/0.log"
Jul 16 13:00:17.235281 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.235253    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262/kube-rbac-proxy/0.log"
Jul 16 13:00:17.264652 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.264533    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262/kube-rbac-proxy-metric/0.log"
Jul 16 13:00:17.292585 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.292560    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262/prom-label-proxy/0.log"
Jul 16 13:00:17.320188 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.320157    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1cae8db7-b06c-4d33-bd7f-cc6ea8ab3262/init-config-reloader/0.log"
Jul 16 13:00:17.405512 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.405478    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-tv7xb_39345e6d-4056-4547-895e-1869784d43d3/kube-state-metrics/0.log"
Jul 16 13:00:17.432264 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.432209    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-tv7xb_39345e6d-4056-4547-895e-1869784d43d3/kube-rbac-proxy-main/0.log"
Jul 16 13:00:17.455641 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.455614    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-tv7xb_39345e6d-4056-4547-895e-1869784d43d3/kube-rbac-proxy-self/0.log"
Jul 16 13:00:17.681706 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.681681    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nct6s_7472d7b2-e452-4e88-a38d-0889c3bcff95/node-exporter/0.log"
Jul 16 13:00:17.721089 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.721057    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nct6s_7472d7b2-e452-4e88-a38d-0889c3bcff95/kube-rbac-proxy/0.log"
Jul 16 13:00:17.745608 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.745579    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nct6s_7472d7b2-e452-4e88-a38d-0889c3bcff95/init-textfile/0.log"
Jul 16 13:00:17.868719 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.868689    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-fnjnf_a75c9ff5-480e-49dc-a951-1c419d3db66d/kube-rbac-proxy-main/0.log"
Jul 16 13:00:17.894244 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.894211    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-fnjnf_a75c9ff5-480e-49dc-a951-1c419d3db66d/kube-rbac-proxy-self/0.log"
Jul 16 13:00:17.917335 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.917309    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-fnjnf_a75c9ff5-480e-49dc-a951-1c419d3db66d/openshift-state-metrics/0.log"
Jul 16 13:00:17.960608 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.960524    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_174c2dca-87be-44e4-aaba-9dd39aa728b1/prometheus/0.log"
Jul 16 13:00:17.987605 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:17.987531    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_174c2dca-87be-44e4-aaba-9dd39aa728b1/config-reloader/0.log"
Jul 16 13:00:18.015498 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:18.015473    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_174c2dca-87be-44e4-aaba-9dd39aa728b1/thanos-sidecar/0.log"
Jul 16 13:00:18.046741 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:18.046715    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_174c2dca-87be-44e4-aaba-9dd39aa728b1/kube-rbac-proxy-web/0.log"
Jul 16 13:00:18.070992 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:18.070962    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_174c2dca-87be-44e4-aaba-9dd39aa728b1/kube-rbac-proxy/0.log"
Jul 16 13:00:18.095232 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:18.095197    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_174c2dca-87be-44e4-aaba-9dd39aa728b1/kube-rbac-proxy-thanos/0.log"
Jul 16 13:00:18.119306 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:18.119277    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_174c2dca-87be-44e4-aaba-9dd39aa728b1/init-config-reloader/0.log"
Jul 16 13:00:18.154907 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:18.154864    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-cxcpk_3cded6c1-c905-4edd-9436-c97e20f18158/prometheus-operator/0.log"
Jul 16 13:00:18.172029 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:18.172006    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-cxcpk_3cded6c1-c905-4edd-9436-c97e20f18158/kube-rbac-proxy/0.log"
Jul 16 13:00:18.231477 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:18.231405    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fb9cbb74b-4pck6_961b0be8-3985-47c8-a33f-c84f1678a7f8/telemeter-client/0.log"
Jul 16 13:00:18.257844 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:18.257820    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fb9cbb74b-4pck6_961b0be8-3985-47c8-a33f-c84f1678a7f8/reload/0.log"
Jul 16 13:00:18.280892 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:18.280866    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fb9cbb74b-4pck6_961b0be8-3985-47c8-a33f-c84f1678a7f8/kube-rbac-proxy/0.log"
Jul 16 13:00:19.650053 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.650018    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"]
Jul 16 13:00:19.653191 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.653169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.666120 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.666083    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"]
Jul 16 13:00:19.802329 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.802298    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/491be176-cb92-4372-94be-f7234d30950b-lib-modules\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.802491 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.802337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mbt7\" (UniqueName: \"kubernetes.io/projected/491be176-cb92-4372-94be-f7234d30950b-kube-api-access-8mbt7\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.802491 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.802408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/491be176-cb92-4372-94be-f7234d30950b-podres\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.802491 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.802462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/491be176-cb92-4372-94be-f7234d30950b-proc\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.802591 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.802518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/491be176-cb92-4372-94be-f7234d30950b-sys\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.903453 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.903350    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/491be176-cb92-4372-94be-f7234d30950b-sys\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.903453 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.903432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/491be176-cb92-4372-94be-f7234d30950b-lib-modules\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.903678 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.903473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mbt7\" (UniqueName: \"kubernetes.io/projected/491be176-cb92-4372-94be-f7234d30950b-kube-api-access-8mbt7\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.903678 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.903522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/491be176-cb92-4372-94be-f7234d30950b-podres\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.903678 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.903568    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/491be176-cb92-4372-94be-f7234d30950b-proc\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.903678 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.903665    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/491be176-cb92-4372-94be-f7234d30950b-proc\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.903888 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.903727    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/491be176-cb92-4372-94be-f7234d30950b-sys\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.903888 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.903849    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/491be176-cb92-4372-94be-f7234d30950b-lib-modules\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.904240 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.904214    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/491be176-cb92-4372-94be-f7234d30950b-podres\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.912911 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.912872    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mbt7\" (UniqueName: \"kubernetes.io/projected/491be176-cb92-4372-94be-f7234d30950b-kube-api-access-8mbt7\") pod \"perf-node-gather-daemonset-btq78\" (UID: \"491be176-cb92-4372-94be-f7234d30950b\") " pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:19.966755 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:19.966725    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:20.172120 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:20.169553    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"]
Jul 16 13:00:20.173118 ip-10-0-129-10 kubenswrapper[2581]: W0716 13:00:20.173070    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod491be176_cb92_4372_94be_f7234d30950b.slice/crio-f13322a50921cf9799f487946f758a4f5f52324e1e8d28837e242fdacb702fc5 WatchSource:0}: Error finding container f13322a50921cf9799f487946f758a4f5f52324e1e8d28837e242fdacb702fc5: Status 404 returned error can't find the container with id f13322a50921cf9799f487946f758a4f5f52324e1e8d28837e242fdacb702fc5
Jul 16 13:00:21.131237 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:21.131199    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78" event={"ID":"491be176-cb92-4372-94be-f7234d30950b","Type":"ContainerStarted","Data":"d6bb69557f7dc967ef77e9b37b8410f9904bc24ec91c21b3cee6a6f48dabfe5c"}
Jul 16 13:00:21.131812 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:21.131793    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:21.131976 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:21.131959    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78" event={"ID":"491be176-cb92-4372-94be-f7234d30950b","Type":"ContainerStarted","Data":"f13322a50921cf9799f487946f758a4f5f52324e1e8d28837e242fdacb702fc5"}
Jul 16 13:00:22.453684 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:22.453659    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7srpq_d94d4702-5f0d-45c0-a0a1-cb6a52535262/dns/0.log"
Jul 16 13:00:22.478066 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:22.478036    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7srpq_d94d4702-5f0d-45c0-a0a1-cb6a52535262/kube-rbac-proxy/0.log"
Jul 16 13:00:22.622429 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:22.622393    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g6rpx_f9cb3771-2487-4422-80d4-c4ff92e3bf78/dns-node-resolver/0.log"
Jul 16 13:00:23.257306 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:23.257276    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-htnbf_fe588988-9e5b-45e5-8518-9da0271e9ae0/node-ca/0.log"
Jul 16 13:00:24.373399 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:24.373369    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5767f667-d87nt_7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80/kube-auth-proxy/0.log"
Jul 16 13:00:25.248859 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:25.248828    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pnnbx_0313a4b2-2982-4888-b15f-a1f28ef35fda/serve-healthcheck-canary/0.log"
Jul 16 13:00:25.964819 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:25.964788    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flrd4_e6c792c7-1144-48eb-b763-1a907863cdcd/kube-rbac-proxy/0.log"
Jul 16 13:00:25.986526 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:25.986475    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flrd4_e6c792c7-1144-48eb-b763-1a907863cdcd/exporter/0.log"
Jul 16 13:00:26.012885 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:26.012857    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flrd4_e6c792c7-1144-48eb-b763-1a907863cdcd/extractor/0.log"
Jul 16 13:00:28.163071 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:28.163035    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78"
Jul 16 13:00:28.183774 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:28.183671    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ndv85/perf-node-gather-daemonset-btq78" podStartSLOduration=9.183651081 podStartE2EDuration="9.183651081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:00:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:00:21.155374409 +0000 UTC m=+2384.935948446" watchObservedRunningTime="2026-07-16 13:00:28.183651081 +0000 UTC m=+2391.964225121"
Jul 16 13:00:28.378466 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:28.378435    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-czgq2_cac46431-418e-4f57-9324-46daa414627e/manager/0.log"
Jul 16 13:00:28.693679 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:28.693645    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87d97db45-fn2js_f53e5384-9c1f-4ab1-893a-76c1f393870d/manager/0.log"
Jul 16 13:00:28.712643 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:28.712614    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87d97db45-fn2js_f53e5384-9c1f-4ab1-893a-76c1f393870d/copy-manifests/0.log"
Jul 16 13:00:29.309892 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:29.309858    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5767f667-d87nt_7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80/kube-auth-proxy/0.log"
Jul 16 13:00:30.191625 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:30.191587    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-698fdd4469-7ks5z_00556a1a-0844-4882-a0b0-176167190346/manager/0.log"
Jul 16 13:00:30.939262 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:30.939233    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5767f667-d87nt_7e4f80cb-d31b-4aac-8ea7-3bb8291e9d80/kube-auth-proxy/0.log"
Jul 16 13:00:34.916341 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:34.916304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82k62_dffae1ce-4b17-400c-94d7-0656a5753abf/konnectivity-agent/0.log" limit=1024
Jul 16 13:00:36.866058 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:36.866035    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2q4w_88017837-2cfd-4c0c-98f1-fe5ca6cff0e6/kube-multus-additional-cni-plugins/0.log"
Jul 16 13:00:36.889635 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:36.889603    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2q4w_88017837-2cfd-4c0c-98f1-fe5ca6cff0e6/egress-router-binary-copy/0.log"
Jul 16 13:00:36.912284 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:36.912259    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2q4w_88017837-2cfd-4c0c-98f1-fe5ca6cff0e6/cni-plugins/0.log"
Jul 16 13:00:36.939538 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:36.939519    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2q4w_88017837-2cfd-4c0c-98f1-fe5ca6cff0e6/bond-cni-plugin/0.log"
Jul 16 13:00:36.963272 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:36.963253    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2q4w_88017837-2cfd-4c0c-98f1-fe5ca6cff0e6/routeoverride-cni/0.log"
Jul 16 13:00:36.988401 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:36.988373    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2q4w_88017837-2cfd-4c0c-98f1-fe5ca6cff0e6/whereabouts-cni-bincopy/0.log"
Jul 16 13:00:37.012613 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:37.012520    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2q4w_88017837-2cfd-4c0c-98f1-fe5ca6cff0e6/whereabouts-cni/0.log"
Jul 16 13:00:37.492681 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:37.492615    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-scqpj_8d8b66dc-eb63-43aa-8627-f34262ddbe36/kube-multus/0.log"
Jul 16 13:00:37.579520 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:37.579389    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 13:00:37.596082 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:37.596043    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k7jbr_b7d5b95e-f49a-4fcd-ae33-aa4540a18232/network-metrics-daemon/0.log"
Jul 16 13:00:37.597419 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:37.597395    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9v2hh_d62cac56-91fe-4b15-a7d8-43bb074b9d79/ovn-acl-logging/0.log"
Jul 16 13:00:37.619059 ip-10-0-129-10 kubenswrapper[2581]: I0716 13:00:37.619035    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k7jbr_b7d5b95e-f49a-4fcd-ae33-aa4540a18232/kube-rbac-proxy/0.log"