Jul 08 06:53:19.547798 ip-10-0-132-191 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 06:53:19.547809 ip-10-0-132-191 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 06:53:19.547816 ip-10-0-132-191 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 06:53:19.548045 ip-10-0-132-191 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 06:53:29.716830 ip-10-0-132-191 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 06:53:29.716853 ip-10-0-132-191 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4882f703863d497d9def88cf22396a72 --
Jul 08 06:55:29.184368 ip-10-0-132-191 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 06:55:30.749209 ip-10-0-132-191 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 06:55:30.749209 ip-10-0-132-191 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 06:55:30.749209 ip-10-0-132-191 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 06:55:30.749209 ip-10-0-132-191 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 06:55:30.749856 ip-10-0-132-191 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 06:55:30.750109 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.750000    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 06:55:30.754036 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754019    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:55:30.754069 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754039    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:55:30.754069 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754044    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:55:30.754069 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754048    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:55:30.754069 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754051    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:55:30.754069 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754055    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:55:30.754069 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754058    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:55:30.754069 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754061    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:55:30.754069 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754064    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:55:30.754069 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754067    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:55:30.754069 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754070    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:55:30.754069 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754073    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754077    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754081    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754085    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754087    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754090    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754093    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754096    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754098    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754101    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754104    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754107    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754112    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754115    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754118    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754121    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754124    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754127    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754129    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:55:30.754366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754132    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754135    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754138    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754142    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754145    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754160    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754163    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754166    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754169    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754171    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754175    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754179    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754182    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754185    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754188    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754191    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754194    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754196    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754199    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754202    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:55:30.754846 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754205    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754208    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754211    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754213    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754216    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754219    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754222    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754225    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754230    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754234    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754237    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754240    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754243    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754246    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754249    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754251    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754254    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754257    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754259    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:55:30.755373 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754262    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754265    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754268    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754271    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754274    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754276    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754280    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754284    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754287    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754289    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754292    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754295    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754298    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754301    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754303    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754306    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754308    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754311    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754314    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754316    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:55:30.755851 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754319    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754322    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754324    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754327    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754329    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754332    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754335    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754337    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754341    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.754343    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755123    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755130    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755135    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755138    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755142    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755145    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755164    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755168    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755171    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755175    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:55:30.756381 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755179    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755182    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755185    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755188    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755191    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755194    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755197    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755199    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755202    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755205    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755207    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755210    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755213    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755215    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755218    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755220    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755223    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755226    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755229    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755232    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:55:30.756876 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755235    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755237    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755240    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755243    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755246    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755249    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755252    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755255    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755258    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755261    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755264    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755266    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755269    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755272    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755275    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755278    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755281    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755284    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755287    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755289    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:55:30.757416 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755294    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755298    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755301    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755303    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755306    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755309    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755312    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755314    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755317    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755321    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755324    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755326    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755329    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755332    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755335    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755338    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755340    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755343    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755345    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:55:30.757924 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755348    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755351    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755354    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755357    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755360    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755363    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755366    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755369    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755373    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755377    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755380    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755383    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755385    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755388    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755391    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755393    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755396    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755399    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755401    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:55:30.758422 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755404    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755408    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755411    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755414    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755417    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755421    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755424    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755427    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755430    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755434    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755437    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755856    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755861    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755865    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755869    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755873    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755876    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755878    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755881    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:55:30.758944 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755886    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755890    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755893    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755896    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755899    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755902    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755905    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755908    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755911    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755914    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755916    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755919    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755922    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755925    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755928    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755930    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755933    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755936    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755938    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755942    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:55:30.759435 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755945    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755948    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755951    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755954    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755957    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755959    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755962    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755965    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755968    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755971    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755974    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755976    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755979    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755982    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755985    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755988    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755991    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755994    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755996    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.755999    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:55:30.759946 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756002    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756005    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756008    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756011    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756015    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756020    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756022    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756025    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756028    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756030    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756033    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756036    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756038    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756041    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756044    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756046    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756049    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756052    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756054    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756057    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:55:30.760500 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756060    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756063    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756066    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756068    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756072    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756076    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756079    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756082    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756086    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756089    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756091    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756094    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756097    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756099    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756102    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756104    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756107    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756110    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756112    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:55:30.761002 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756115    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756117    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756120    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756123    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756126    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756129    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756131    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756134    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756137    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756140    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756142    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756145    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756229    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756236    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756243    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756247    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756251    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756255    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756259    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756264    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756268    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 06:55:30.761496 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756272    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756275    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756279    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756282    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756285    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756288    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756291    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756294    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756297    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756302    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756305    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756309    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756312    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756315    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756319    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756322    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756325    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756329    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756332    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756337    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756341    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756344    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756347    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756351    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 06:55:30.762058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756355    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756358    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756360    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756364    2565 flags.go:64] FLAG: --enable-server="true"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756367    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756371    2565 flags.go:64] FLAG: --event-burst="100"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756375    2565 flags.go:64] FLAG: --event-qps="50"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756378    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756382    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756386    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756390    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756394    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756397    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756400    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756403    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756407    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756410    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756413    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756417    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756419    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756422    2565 flags.go:64] FLAG: --feature-gates=""
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756426    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756429    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756433    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756436    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756439    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 06:55:30.762671 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756442    2565 flags.go:64] FLAG: --help="false"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756447    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-132-191.ec2.internal"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756451    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756454    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756457    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756461    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756465    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756468    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756471    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756474    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756477    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756481    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756486    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756489    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756492    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756495    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756499    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756502    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756505    2565 flags.go:64] FLAG: --lock-file=""
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756508    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756511    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756515    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756520    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 06:55:30.763379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756523    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756526    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756529    2565 flags.go:64] FLAG: --logging-format="text"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756532    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756536    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756539    2565 flags.go:64] FLAG: --manifest-url=""
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756543    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756547    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756550    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756554    2565 flags.go:64] FLAG: --max-pods="110"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756559    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756562    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756565    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756569    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756572    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756575    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756578    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756585    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756588    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756592    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756595    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756599    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756604    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756608    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 06:55:30.763968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756611    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756615    2565 flags.go:64] FLAG: --port="10250"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756618    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756621    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ff39018ffa872be5"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756625    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756628    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756631    2565 flags.go:64] FLAG: --register-node="true"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756634    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756638    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756641    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756643    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756646    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756651    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756654    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756657    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756660    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756663    2565 flags.go:64] FLAG: --runonce="false"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756666    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756669    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756674    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756677    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756680    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756683    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756686    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756690    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756693    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 06:55:30.764694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756696    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756699    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756702    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756707    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756710    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756713    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756718    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756721    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756725    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756729    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756732    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756735    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756738    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756741    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756745    2565 flags.go:64] FLAG: --v="2"
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756749    2565 flags.go:64] FLAG: --version="false"
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756753    2565 flags.go:64] FLAG: --vmodule=""
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756757    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.756760    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756881    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756884    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756888    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756892    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756895    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:55:30.765370 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756898    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756902    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756905    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756908    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756911    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756913    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756916    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756919    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756922    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756924    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756927    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756935    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756938    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756941    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756944    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756946    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756949    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756952    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756955    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756958    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:55:30.766014 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756961    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756965    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756969    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756971    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756974    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756977    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756980    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756982    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756985    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756988    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756992    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756994    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.756997    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757001    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757004    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757007    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757010    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757013    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757016    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:55:30.766564 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757018    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757021    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757024    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757027    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757031    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757035    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757039    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757042    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757045    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757049    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757052    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757055    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757058    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757061    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757064    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757067    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757070    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757074    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757076    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757079    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:55:30.767057 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757082    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757084    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757087    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757091    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757095    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757098    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757102    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757104    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757107    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757110    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757113    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757115    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757118    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757121    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757124    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757127    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757132    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757134    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757137    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:55:30.767614 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757140    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757143    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757159    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757162    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757166    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757169    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757172    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757175    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757178    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757180    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757183    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757186    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757188    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757191    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757194    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:55:30.768096 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.757197    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.757203    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.764587    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.764604    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.764626    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.764632    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764692    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764699    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764703    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764707    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764711    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764714    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764717    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764721    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:55:30.768497 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764724    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764727    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764729    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764732    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764735    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764738    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764741    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764744    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764747    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764750    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764753    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764756    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764759    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764761    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764765    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764769    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764772    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764775    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764778    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764780    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:55:30.768882 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764783    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764788    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764791    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764794    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764797    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764799    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764804    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764807    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764810    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764814    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764817    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764820    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764823    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764826    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764828    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764831    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764834    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764837    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764839    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:55:30.769408 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764842    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764845    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764847    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764850    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764853    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764856    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764859    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764861    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764864    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764867    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764870    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764872    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764875    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764878    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764881    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764884    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764888    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764890    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764893    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764896    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:55:30.769889 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764898    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764901    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764904    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764906    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764909    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764912    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764914    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764917    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764920    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764922    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764925    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764928    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764931    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764934    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764936    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764939    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764942    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764944    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764947    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764950    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:55:30.770577 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764953    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764956    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764958    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764961    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764964    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764968    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764971    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764974    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764977    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764980    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764982    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.764985    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.764991    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765113    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765119    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 06:55:30.771095 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765122    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765125    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765128    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765131    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765134    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765137    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765140    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765142    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765160    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765163    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765166    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765169    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765172    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765175    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765177    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765182    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765186    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765190    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765193    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765197    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 06:55:30.771532 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765200    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765203    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765207    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765210    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765214    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765217    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765221    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765224    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765226    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765229    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765232    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765235    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765237    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765240    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765243    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765245    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765248    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765251    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765254    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765256    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 06:55:30.772079 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765259    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765262    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765265    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765267    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765271    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765275    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765278    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765281    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765284    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765287    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765289    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765292    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765295    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765298    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765301    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765304    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765307    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765310    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765313    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765316    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 06:55:30.772626 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765319    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765322    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765325    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765328    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765331    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765334    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765336    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765339    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765342    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765346    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765349    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765352    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765356    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765359    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765362    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765365    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765367    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765370    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765373    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 06:55:30.773135 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765376    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765379    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765381    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765384    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765388    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765391    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765393    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765397    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765400    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765403    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765406    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765408    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765411    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765414    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765417    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765420    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765423    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 06:55:30.773645 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:30.765425    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 06:55:30.774100 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.765431    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 06:55:30.774100 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.765567    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 06:55:30.774100 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.767813    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 06:55:30.774100 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.769315    2565 server.go:1019] "Starting client certificate rotation"
Jul 08 06:55:30.774100 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.769427    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 06:55:30.774100 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.769462    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 06:55:30.774100 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.771832    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 06:55:30.776696 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.776673    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 06:55:30.785248 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.785231    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 08 06:55:30.788920 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.788904    2565 log.go:25] "Validated CRI v1 image API"
Jul 08 06:55:30.789814 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.789800    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 06:55:30.792052 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.792029    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cab9bcda-fe3a-4079-9ee9-cfd8670e5344:/dev/nvme0n1p4 f77fd636-399c-42ca-bb84-aec7d0ed6bcf:/dev/nvme0n1p3]
Jul 08 06:55:30.792125 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.792050    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 06:55:30.797167 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.797039    2565 manager.go:216] Machine: {Timestamp:2026-07-08 06:55:30.796547792 +0000 UTC m=+1.505830899 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100689 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b1bbbaa7141c0b0a0ce504efd899d SystemUUID:ec2b1bbb-aa71-41c0-b0a0-ce504efd899d BootID:4882f703-863d-497d-9def-88cf22396a72 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ce:65:b7:aa:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ce:65:b7:aa:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:e2:77:79:bc:f7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 06:55:30.797264 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.797170    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 06:55:30.797264 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.797250    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 06:55:30.799935 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.799884    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 06:55:30.800050 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.799915    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-191.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 06:55:30.800588 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.800578    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 06:55:30.800623 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.800590    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 06:55:30.800623 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.800599    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 06:55:30.801240 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.801229    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 06:55:30.801707 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.801693    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 06:55:30.802918 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.802905    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 06:55:30.806138 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.806125    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 06:55:30.806283 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.806273    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 06:55:30.806324 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.806307    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 06:55:30.806324 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.806320    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 06:55:30.806382 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.806336    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 06:55:30.806382 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.806345    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 08 06:55:30.806382 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.806356    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 06:55:30.806724 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.806710    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 06:55:30.806792 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.806729    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 06:55:30.809221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.809205    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 06:55:30.812984 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.812957    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 06:55:30.813065 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.813017    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 06:55:30.814241 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814226    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 06:55:30.814241 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814246    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 06:55:30.814359 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814257    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 06:55:30.814359 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814266    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 06:55:30.814359 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814278    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 06:55:30.814359 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814283    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 06:55:30.814359 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814292    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 06:55:30.814359 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814297    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 06:55:30.814359 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814304    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 06:55:30.814359 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814310    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 06:55:30.814359 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814325    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 06:55:30.814359 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814331    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 06:55:30.814359 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814357    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 06:55:30.814359 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.814362    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 06:55:30.816747 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:30.816723    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 06:55:30.816913 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.816851    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-191.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 06:55:30.816977 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:30.816955    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 06:55:30.817568 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.817555    2565 server.go:1268] "Started kubelet"
Jul 08 06:55:30.817663 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.817637    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 06:55:30.817928 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.817789    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 06:55:30.818106 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.817949    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 06:55:30.818492 ip-10-0-132-191 systemd[1]: Started Kubernetes Kubelet.
Jul 08 06:55:30.820898 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.820800    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 06:55:30.821841 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.821822    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 06:55:30.823677 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:30.823659    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 06:55:30.828732 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.828719    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 06:55:30.828832 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.828737    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 06:55:30.828832 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:30.828799    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
Jul 08 06:55:30.829849 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.829448    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 06:55:30.829849 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.829466    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 06:55:30.829849 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.829636    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 06:55:30.829849 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.829644    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 06:55:30.829849 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.829646    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 06:55:30.829849 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.829762    2565 factory.go:55] Registering systemd factory
Jul 08 06:55:30.829849 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.829778    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 08 06:55:30.830366 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.830220    2565 factory.go:153] Registering CRI-O factory
Jul 08 06:55:30.830366 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.830236    2565 factory.go:223] Registration of the crio container factory successfully
Jul 08 06:55:30.830366 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.830290    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 06:55:30.830366 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.830314    2565 factory.go:103] Registering Raw factory
Jul 08 06:55:30.830366 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.830329    2565 manager.go:1196] Started watching for new ooms in manager
Jul 08 06:55:30.830816 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.830730    2565 manager.go:349] Starting recovery of all containers
Jul 08 06:55:30.831846 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:30.829804    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-191.ec2.internal.18c03e194c83ceac  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-191.ec2.internal,UID:ip-10-0-132-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-191.ec2.internal,},FirstTimestamp:2026-07-08 06:55:30.817527468 +0000 UTC m=+1.526810572,LastTimestamp:2026-07-08 06:55:30.817527468 +0000 UTC m=+1.526810572,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-191.ec2.internal,}"
Jul 08 06:55:30.832487 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.832458    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hshgz"
Jul 08 06:55:30.839192 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.839116    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 06:55:30.840473 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:30.840444    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 06:55:30.840600 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:30.840471    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 06:55:30.841331 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.841304    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hshgz"
Jul 08 06:55:30.844246 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.844223    2565 manager.go:354] Recovery completed
Jul 08 06:55:30.848501 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.848486    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:30.850333 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.850318    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:30.850399 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.850348    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:30.850399 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.850362    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:30.850929 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.850914    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 06:55:30.850929 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.850923    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:30.850929 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.850929    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 06:55:30.851140 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.850948    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 06:55:30.851600 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.851586    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:30.851662 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.851611    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:30.851662 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.851620    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:30.851993 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.851979    2565 policy_none.go:49] "None policy: Start"
Jul 08 06:55:30.852028 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.851998    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 06:55:30.852028 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.852012    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 06:55:30.852961 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.852949    2565 policy_none.go:47] "Start"
Jul 08 06:55:30.892872 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.892731    2565 manager.go:337] "Starting Device Plugin manager"
Jul 08 06:55:30.892967 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:30.892904    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 06:55:30.892967 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.892920    2565 server.go:87] "Starting device plugin registration server"
Jul 08 06:55:30.893193 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.893181    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 06:55:30.893243 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.893195    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 06:55:30.893346 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.893311    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 06:55:30.893484 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.893416    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 06:55:30.893484 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.893426    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 06:55:30.893908 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:30.893888    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 06:55:30.893991 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:30.893950    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-191.ec2.internal\" not found"
Jul 08 06:55:30.993644 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.993616    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:30.994712 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.994657    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:30.994712 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.994695    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:30.994712 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.994709    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:30.994847 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:30.994736    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.003391 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.003368    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.003511 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.003396    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-191.ec2.internal\": node \"ip-10-0-132-191.ec2.internal\" not found"
Jul 08 06:55:31.029249 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.029216    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 06:55:31.029375 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.029260    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 06:55:31.029375 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.029282    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 06:55:31.029375 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.029313    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 06:55:31.031454 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.031431    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:55:31.047339 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.047319    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
Jul 08 06:55:31.134626 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.134534    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal"]
Jul 08 06:55:31.134750 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.134640    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:31.136145 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.136128    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:31.136238 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.136164    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:31.136238 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.136177    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:31.137484 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.137471    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:31.137602 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.137574    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.137652 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.137607    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:31.138324 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.138309    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:31.138448 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.138340    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:31.138448 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.138354    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:31.138448 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.138312    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:31.138448 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.138404    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:31.138448 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.138420    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:31.140022 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.140002    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.140104 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.140040    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 06:55:31.140767 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.140743    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 06:55:31.140767 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.140768    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 06:55:31.140951 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.140782    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeHasSufficientPID"
Jul 08 06:55:31.148262 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.148246    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
Jul 08 06:55:31.163907 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.163886    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-191.ec2.internal\" not found" node="ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.168688 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.168673    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-191.ec2.internal\" not found" node="ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.235173 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.235144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b42444b7e0c741e5903c2be5ebcd8af2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-191.ec2.internal\" (UID: \"b42444b7e0c741e5903c2be5ebcd8af2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.235173 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.235175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/911bdb8872e4635cd562e9ddf347f774-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal\" (UID: \"911bdb8872e4635cd562e9ddf347f774\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.235372 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.235195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/911bdb8872e4635cd562e9ddf347f774-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal\" (UID: \"911bdb8872e4635cd562e9ddf347f774\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.249309 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.249281    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
Jul 08 06:55:31.336120 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.335992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b42444b7e0c741e5903c2be5ebcd8af2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-191.ec2.internal\" (UID: \"b42444b7e0c741e5903c2be5ebcd8af2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.336120 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.336023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/911bdb8872e4635cd562e9ddf347f774-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal\" (UID: \"911bdb8872e4635cd562e9ddf347f774\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.336120 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.336043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/911bdb8872e4635cd562e9ddf347f774-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal\" (UID: \"911bdb8872e4635cd562e9ddf347f774\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.336120 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.336049    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b42444b7e0c741e5903c2be5ebcd8af2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-191.ec2.internal\" (UID: \"b42444b7e0c741e5903c2be5ebcd8af2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.336120 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.336107    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/911bdb8872e4635cd562e9ddf347f774-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal\" (UID: \"911bdb8872e4635cd562e9ddf347f774\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.336120 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.336107    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/911bdb8872e4635cd562e9ddf347f774-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal\" (UID: \"911bdb8872e4635cd562e9ddf347f774\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.350151 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.350117    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
Jul 08 06:55:31.451328 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.451241    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
Jul 08 06:55:31.468698 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.468673    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.472830 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.472770    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.552036 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.551998    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
Jul 08 06:55:31.652557 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.652512    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-191.ec2.internal\" not found"
Jul 08 06:55:31.655925 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.655906    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:55:31.730588 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.730505    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.747155 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.747133    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 06:55:31.748985 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.748972    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal"
Jul 08 06:55:31.756379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.756360    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 06:55:31.768379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.768344    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 06:55:31.768491 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.768474    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 06:55:31.768558 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.768528    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 06:55:31.808696 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.808671    2565 apiserver.go:52] "Watching apiserver"
Jul 08 06:55:31.829851 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.829828    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 06:55:31.830707 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.830689    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 06:55:31.831050 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.831032    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-njffd","openshift-multus/multus-zzg72","openshift-network-operator/iptables-alerter-crxbm","openshift-ovn-kubernetes/ovnkube-node-tst7z","kube-system/konnectivity-agent-82kbn","kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28","openshift-dns/node-resolver-xxrtv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal","openshift-multus/network-metrics-daemon-tjrq6","openshift-network-diagnostics/network-check-target-5kqw5","kube-system/global-pull-secret-syncer-4lm92","openshift-cluster-node-tuning-operator/tuned-2rpkm","openshift-image-registry/node-ca-9bwjx"]
Jul 08 06:55:31.832549 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.832535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:31.833618 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.833602    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:31.833710 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.833691    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:31.834793 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.834769    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-crxbm"
Jul 08 06:55:31.835974 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.835956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.836562 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.836546    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 06:55:31.836843 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.836831    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 06:55:31.837134 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.837123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bwjx"
Jul 08 06:55:31.838038 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.838015    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 06:55:31.838112 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.838073    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fhgnt\""
Jul 08 06:55:31.838196 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.838015    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 06:55:31.838196 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.838129    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 06:55:31.838388 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.838371    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xxrtv"
Jul 08 06:55:31.838448 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.838402    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t5tj7\""
Jul 08 06:55:31.839516 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.839500    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 06:55:31.839598 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.839520    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 06:55:31.839731 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.839715    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:31.840921 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.840904    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.841384 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.841362    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 06:55:31.841481 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.841385    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 06:55:31.841481 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.841459    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 06:55:31.841694 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.841679    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 06:55:31.841759 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.841693    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-54q54\""
Jul 08 06:55:31.841759 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.841752    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 06:55:31.841843 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.841806    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 06:55:31.842129 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.842101    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 06:55:31.842304 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.842151    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-788q7\""
Jul 08 06:55:31.842304 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.842230    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.842304 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.842286    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 06:55:31.843403 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.843384    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:31.843485 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.843452    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:31.843533 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.843481    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 06:50:31 +0000 UTC" deadline="2028-04-01 16:11:13.269958226 +0000 UTC"
Jul 08 06:55:31.843533 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.843503    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15201h15m41.426459953s"
Jul 08 06:55:31.845712 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.845649    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:31.845798 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:31.845731    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:31.846764 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.846742    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 06:55:31.846860 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.846767    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 06:55:31.846860 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.846775    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 06:55:31.847174 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.847153    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4hglb\""
Jul 08 06:55:31.847653 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.847634    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 06:55:31.847719 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.847704    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-82kbn"
Jul 08 06:55:31.847824 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.847704    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xpvzr\""
Jul 08 06:55:31.848670 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.848645    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 06:55:31.849817 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.849799    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 06:55:31.855389 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.855370    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 06:55:31.855681 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.855665    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 06:55:31.855743 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.855732    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 06:55:31.855882 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.855859    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5xnn8\""
Jul 08 06:55:31.855979 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.855910    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 06:55:31.855979 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.855910    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 06:55:31.855979 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.855947    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l9d42\""
Jul 08 06:55:31.856153 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.856126    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vhf46\""
Jul 08 06:55:31.856215 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.856151    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 06:55:31.870514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.870491    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 06:55:31.910732 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.910711    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6w88p"
Jul 08 06:55:31.920747 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.920725    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6w88p"
Jul 08 06:55:31.931367 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.931349    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 06:55:31.939477 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-sysctl-d\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.939592 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvbjj\" (UniqueName: \"kubernetes.io/projected/d780ed3d-6d78-4bb2-be7a-ea241cd28185-kube-api-access-fvbjj\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:31.939592 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-multus-socket-dir-parent\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.939592 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkljv\" (UniqueName: \"kubernetes.io/projected/4c325dbc-01f4-408b-b00f-ffe0e053aeed-kube-api-access-zkljv\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.939592 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:31.939592 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea7b2554-9f59-4dd0-9f16-6c6203fff2ff-host-slash\") pod \"iptables-alerter-crxbm\" (UID: \"ea7b2554-9f59-4dd0-9f16-6c6203fff2ff\") " pod="openshift-network-operator/iptables-alerter-crxbm"
Jul 08 06:55:31.939873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-node-log\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.939873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnks5\" (UniqueName: \"kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5\") pod \"network-check-target-5kqw5\" (UID: \"9be122b9-70f7-40c5-a0f2-8e6d43def7f1\") " pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:31.939873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939655    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-sysctl-conf\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.939873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-log-socket\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.939873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939695    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-run-ovn-kubernetes\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.939873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md2c9\" (UniqueName: \"kubernetes.io/projected/0f740e8d-ee64-4940-9d2b-c9d13d687f07-kube-api-access-md2c9\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.939873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-system-cni-dir\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.939873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939756    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-hostroot\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.939873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-etc-selinux\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:31.939873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7c22\" (UniqueName: \"kubernetes.io/projected/ea7b2554-9f59-4dd0-9f16-6c6203fff2ff-kube-api-access-n7c22\") pod \"iptables-alerter-crxbm\" (UID: \"ea7b2554-9f59-4dd0-9f16-6c6203fff2ff\") " pod="openshift-network-operator/iptables-alerter-crxbm"
Jul 08 06:55:31.939873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlcbg\" (UniqueName: \"kubernetes.io/projected/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-kube-api-access-tlcbg\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:31.939873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-cni-bin\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.939873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-host\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-slash\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-etc-openvswitch\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f740e8d-ee64-4940-9d2b-c9d13d687f07-ovnkube-config\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-var-lib-kubelet\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs\") pod \"network-metrics-daemon-tjrq6\" (UID: \"472c4a73-2d24-400f-ae39-45695d6af154\") " pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.939995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/edea2342-84be-47c9-ba0e-a1cc69e50a54-konnectivity-ca\") pod \"konnectivity-agent-82kbn\" (UID: \"edea2342-84be-47c9-ba0e-a1cc69e50a54\") " pod="kube-system/konnectivity-agent-82kbn"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea7b2554-9f59-4dd0-9f16-6c6203fff2ff-iptables-alerter-script\") pod \"iptables-alerter-crxbm\" (UID: \"ea7b2554-9f59-4dd0-9f16-6c6203fff2ff\") " pod="openshift-network-operator/iptables-alerter-crxbm"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-cni-netd\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18f91b3f-47a9-4eb6-8547-eee59181ac7d-dbus\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940107    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-device-dir\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-cnibin\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-os-release\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x69cn\" (UniqueName: \"kubernetes.io/projected/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-kube-api-access-x69cn\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-kubelet\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.940550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c325dbc-01f4-408b-b00f-ffe0e053aeed-cni-binary-copy\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-var-lib-cni-bin\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-var-lib-cni-multus\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-run-multus-certs\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-kubernetes\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-systemd\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-cnibin\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-system-cni-dir\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-systemd-units\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-var-lib-openvswitch\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-os-release\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-run-k8s-cni-cncf-io\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svqjm\" (UniqueName: \"kubernetes.io/projected/2d97c0f1-d007-4f7b-a19e-3dcce094357a-kube-api-access-svqjm\") pod \"node-ca-9bwjx\" (UID: \"2d97c0f1-d007-4f7b-a19e-3dcce094357a\") " pod="openshift-image-registry/node-ca-9bwjx"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b930586c-e3b5-49ed-831a-3bb0ceb55958-tmp-dir\") pod \"node-resolver-xxrtv\" (UID: \"b930586c-e3b5-49ed-831a-3bb0ceb55958\") " pod="openshift-dns/node-resolver-xxrtv"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940597    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-tuned\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-tmp\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.941412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-sysconfig\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-run\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-sys-fs\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-run-openvswitch\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-run-systemd\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f740e8d-ee64-4940-9d2b-c9d13d687f07-ovn-node-metrics-cert\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940821    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-socket-dir\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5ggn\" (UniqueName: \"kubernetes.io/projected/b930586c-e3b5-49ed-831a-3bb0ceb55958-kube-api-access-c5ggn\") pod \"node-resolver-xxrtv\" (UID: \"b930586c-e3b5-49ed-831a-3bb0ceb55958\") " pod="openshift-dns/node-resolver-xxrtv"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f740e8d-ee64-4940-9d2b-c9d13d687f07-env-overrides\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-multus-conf-dir\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18f91b3f-47a9-4eb6-8547-eee59181ac7d-kubelet-config\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.940983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/edea2342-84be-47c9-ba0e-a1cc69e50a54-agent-certs\") pod \"konnectivity-agent-82kbn\" (UID: \"edea2342-84be-47c9-ba0e-a1cc69e50a54\") " pod="kube-system/konnectivity-agent-82kbn"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-sys\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-run-netns\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941041    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-registration-dir\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:31.942309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941066    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d97c0f1-d007-4f7b-a19e-3dcce094357a-host\") pod \"node-ca-9bwjx\" (UID: \"2d97c0f1-d007-4f7b-a19e-3dcce094357a\") " pod="openshift-image-registry/node-ca-9bwjx"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941107    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-var-lib-kubelet\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-run-netns\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-run-ovn\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941213    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c325dbc-01f4-408b-b00f-ffe0e053aeed-multus-daemon-config\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d97c0f1-d007-4f7b-a19e-3dcce094357a-serviceca\") pod \"node-ca-9bwjx\" (UID: \"2d97c0f1-d007-4f7b-a19e-3dcce094357a\") " pod="openshift-image-registry/node-ca-9bwjx"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-lib-modules\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrdc8\" (UniqueName: \"kubernetes.io/projected/472c4a73-2d24-400f-ae39-45695d6af154-kube-api-access-jrdc8\") pod \"network-metrics-daemon-tjrq6\" (UID: \"472c4a73-2d24-400f-ae39-45695d6af154\") " pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b930586c-e3b5-49ed-831a-3bb0ceb55958-hosts-file\") pod \"node-resolver-xxrtv\" (UID: \"b930586c-e3b5-49ed-831a-3bb0ceb55958\") " pod="openshift-dns/node-resolver-xxrtv"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-modprobe-d\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f740e8d-ee64-4940-9d2b-c9d13d687f07-ovnkube-script-lib\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-multus-cni-dir\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:31.943221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:31.941452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-etc-kubernetes\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.004165 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.004085    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:55:32.016998 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:32.016970    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911bdb8872e4635cd562e9ddf347f774.slice/crio-0d7e9a7111a944b1ae23930b0f9b643add9c451912fef99fcda666ad12b433e1 WatchSource:0}: Error finding container 0d7e9a7111a944b1ae23930b0f9b643add9c451912fef99fcda666ad12b433e1: Status 404 returned error can't find the container with id 0d7e9a7111a944b1ae23930b0f9b643add9c451912fef99fcda666ad12b433e1
Jul 08 06:55:32.017439 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:32.017420    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb42444b7e0c741e5903c2be5ebcd8af2.slice/crio-bc5176b40e7ede7e70edc960290861139f481d16cceec913ef4871ecb121c9ce WatchSource:0}: Error finding container bc5176b40e7ede7e70edc960290861139f481d16cceec913ef4871ecb121c9ce: Status 404 returned error can't find the container with id bc5176b40e7ede7e70edc960290861139f481d16cceec913ef4871ecb121c9ce
Jul 08 06:55:32.021308 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.021291    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 06:55:32.032577 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.032527    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal" event={"ID":"911bdb8872e4635cd562e9ddf347f774","Type":"ContainerStarted","Data":"0d7e9a7111a944b1ae23930b0f9b643add9c451912fef99fcda666ad12b433e1"}
Jul 08 06:55:32.033486 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.033461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal" event={"ID":"b42444b7e0c741e5903c2be5ebcd8af2","Type":"ContainerStarted","Data":"bc5176b40e7ede7e70edc960290861139f481d16cceec913ef4871ecb121c9ce"}
Jul 08 06:55:32.041931 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.041910    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-run-systemd\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.042022 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.041943    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f740e8d-ee64-4940-9d2b-c9d13d687f07-ovn-node-metrics-cert\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.042022 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.041960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:32.042022 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.041976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-socket-dir\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.042022 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.041997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5ggn\" (UniqueName: \"kubernetes.io/projected/b930586c-e3b5-49ed-831a-3bb0ceb55958-kube-api-access-c5ggn\") pod \"node-resolver-xxrtv\" (UID: \"b930586c-e3b5-49ed-831a-3bb0ceb55958\") " pod="openshift-dns/node-resolver-xxrtv"
Jul 08 06:55:32.042262 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f740e8d-ee64-4940-9d2b-c9d13d687f07-env-overrides\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.042262 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-multus-conf-dir\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.042262 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18f91b3f-47a9-4eb6-8547-eee59181ac7d-kubelet-config\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:32.042262 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/edea2342-84be-47c9-ba0e-a1cc69e50a54-agent-certs\") pod \"konnectivity-agent-82kbn\" (UID: \"edea2342-84be-47c9-ba0e-a1cc69e50a54\") " pod="kube-system/konnectivity-agent-82kbn"
Jul 08 06:55:32.042262 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.042123    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:32.042262 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042140    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-sys\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.042262 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042152    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-socket-dir\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.042262 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042154    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-multus-conf-dir\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.042262 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-run-netns\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.042262 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.042219    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret podName:18f91b3f-47a9-4eb6-8547-eee59181ac7d nodeName:}" failed. No retries permitted until 2026-07-08 06:55:32.542175704 +0000 UTC m=+3.251458806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret") pod "global-pull-secret-syncer-4lm92" (UID: "18f91b3f-47a9-4eb6-8547-eee59181ac7d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:32.042262 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042232    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-sys\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.042262 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042238    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18f91b3f-47a9-4eb6-8547-eee59181ac7d-kubelet-config\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042286    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-run-netns\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-registration-dir\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d97c0f1-d007-4f7b-a19e-3dcce094357a-host\") pod \"node-ca-9bwjx\" (UID: \"2d97c0f1-d007-4f7b-a19e-3dcce094357a\") " pod="openshift-image-registry/node-ca-9bwjx"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042327    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-registration-dir\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042381    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042387    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d97c0f1-d007-4f7b-a19e-3dcce094357a-host\") pod \"node-ca-9bwjx\" (UID: \"2d97c0f1-d007-4f7b-a19e-3dcce094357a\") " pod="openshift-image-registry/node-ca-9bwjx"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-var-lib-kubelet\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-run-netns\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-run-ovn\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042546    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042576    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-var-lib-kubelet\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c325dbc-01f4-408b-b00f-ffe0e053aeed-multus-daemon-config\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042601    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-run-ovn\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042607    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f740e8d-ee64-4940-9d2b-c9d13d687f07-env-overrides\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d97c0f1-d007-4f7b-a19e-3dcce094357a-serviceca\") pod \"node-ca-9bwjx\" (UID: \"2d97c0f1-d007-4f7b-a19e-3dcce094357a\") " pod="openshift-image-registry/node-ca-9bwjx"
Jul 08 06:55:32.042865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042642    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-run-netns\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-lib-modules\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042707    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-run-systemd\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrdc8\" (UniqueName: \"kubernetes.io/projected/472c4a73-2d24-400f-ae39-45695d6af154-kube-api-access-jrdc8\") pod \"network-metrics-daemon-tjrq6\" (UID: \"472c4a73-2d24-400f-ae39-45695d6af154\") " pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b930586c-e3b5-49ed-831a-3bb0ceb55958-hosts-file\") pod \"node-resolver-xxrtv\" (UID: \"b930586c-e3b5-49ed-831a-3bb0ceb55958\") " pod="openshift-dns/node-resolver-xxrtv"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-modprobe-d\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043132    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d97c0f1-d007-4f7b-a19e-3dcce094357a-serviceca\") pod \"node-ca-9bwjx\" (UID: \"2d97c0f1-d007-4f7b-a19e-3dcce094357a\") " pod="openshift-image-registry/node-ca-9bwjx"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f740e8d-ee64-4940-9d2b-c9d13d687f07-ovnkube-script-lib\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.042968    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043003    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-lib-modules\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-multus-cni-dir\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-etc-kubernetes\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043252    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-sysctl-d\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043253    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b930586c-e3b5-49ed-831a-3bb0ceb55958-hosts-file\") pod \"node-resolver-xxrtv\" (UID: \"b930586c-e3b5-49ed-831a-3bb0ceb55958\") " pod="openshift-dns/node-resolver-xxrtv"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043256    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-modprobe-d\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.043760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvbjj\" (UniqueName: \"kubernetes.io/projected/d780ed3d-6d78-4bb2-be7a-ea241cd28185-kube-api-access-fvbjj\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-multus-socket-dir-parent\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043313    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-etc-kubernetes\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkljv\" (UniqueName: \"kubernetes.io/projected/4c325dbc-01f4-408b-b00f-ffe0e053aeed-kube-api-access-zkljv\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043353    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043361    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-sysctl-d\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043370    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-multus-cni-dir\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea7b2554-9f59-4dd0-9f16-6c6203fff2ff-host-slash\") pod \"iptables-alerter-crxbm\" (UID: \"ea7b2554-9f59-4dd0-9f16-6c6203fff2ff\") " pod="openshift-network-operator/iptables-alerter-crxbm"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043406    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-node-log\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043411    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-multus-socket-dir-parent\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043417    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnks5\" (UniqueName: \"kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5\") pod \"network-check-target-5kqw5\" (UID: \"9be122b9-70f7-40c5-a0f2-8e6d43def7f1\") " pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043463    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-node-log\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-sysctl-conf\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-log-socket\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-run-ovn-kubernetes\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md2c9\" (UniqueName: \"kubernetes.io/projected/0f740e8d-ee64-4940-9d2b-c9d13d687f07-kube-api-access-md2c9\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.044627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043583    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-log-socket\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-system-cni-dir\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043624    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-sysctl-conf\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043630    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-run-ovn-kubernetes\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043626    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-hostroot\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-etc-selinux\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043673    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-hostroot\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7c22\" (UniqueName: \"kubernetes.io/projected/ea7b2554-9f59-4dd0-9f16-6c6203fff2ff-kube-api-access-n7c22\") pod \"iptables-alerter-crxbm\" (UID: \"ea7b2554-9f59-4dd0-9f16-6c6203fff2ff\") " pod="openshift-network-operator/iptables-alerter-crxbm"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043687    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-system-cni-dir\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043725    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlcbg\" (UniqueName: \"kubernetes.io/projected/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-kube-api-access-tlcbg\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-cni-bin\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-host\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043756    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-etc-selinux\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043815    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-cni-bin\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043827    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-host\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043830    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c325dbc-01f4-408b-b00f-ffe0e053aeed-multus-daemon-config\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-slash\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043863    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea7b2554-9f59-4dd0-9f16-6c6203fff2ff-host-slash\") pod \"iptables-alerter-crxbm\" (UID: \"ea7b2554-9f59-4dd0-9f16-6c6203fff2ff\") " pod="openshift-network-operator/iptables-alerter-crxbm"
Jul 08 06:55:32.045514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043866    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-slash\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-etc-openvswitch\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f740e8d-ee64-4940-9d2b-c9d13d687f07-ovnkube-config\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043919    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-etc-openvswitch\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043935    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-var-lib-kubelet\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.043962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs\") pod \"network-metrics-daemon-tjrq6\" (UID: \"472c4a73-2d24-400f-ae39-45695d6af154\") " pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/edea2342-84be-47c9-ba0e-a1cc69e50a54-konnectivity-ca\") pod \"konnectivity-agent-82kbn\" (UID: \"edea2342-84be-47c9-ba0e-a1cc69e50a54\") " pod="kube-system/konnectivity-agent-82kbn"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.044039    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044049    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-var-lib-kubelet\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea7b2554-9f59-4dd0-9f16-6c6203fff2ff-iptables-alerter-script\") pod \"iptables-alerter-crxbm\" (UID: \"ea7b2554-9f59-4dd0-9f16-6c6203fff2ff\") " pod="openshift-network-operator/iptables-alerter-crxbm"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.044089    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs podName:472c4a73-2d24-400f-ae39-45695d6af154 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:32.544071846 +0000 UTC m=+3.253354941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs") pod "network-metrics-daemon-tjrq6" (UID: "472c4a73-2d24-400f-ae39-45695d6af154") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-cni-netd\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18f91b3f-47a9-4eb6-8547-eee59181ac7d-dbus\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-device-dir\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-cnibin\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-os-release\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.046527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x69cn\" (UniqueName: \"kubernetes.io/projected/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-kube-api-access-x69cn\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-kubelet\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c325dbc-01f4-408b-b00f-ffe0e053aeed-cni-binary-copy\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044407    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f740e8d-ee64-4940-9d2b-c9d13d687f07-ovnkube-script-lib\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-var-lib-cni-bin\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-var-lib-cni-multus\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-run-multus-certs\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044488    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-os-release\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-kubernetes\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044520    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f740e8d-ee64-4940-9d2b-c9d13d687f07-ovnkube-config\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-systemd\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044546    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-kubernetes\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044561    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044583    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-var-lib-cni-bin\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-cnibin\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044624    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-system-cni-dir\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-systemd-units\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.047423 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044657    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-run-multus-certs\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044677    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/edea2342-84be-47c9-ba0e-a1cc69e50a54-konnectivity-ca\") pod \"konnectivity-agent-82kbn\" (UID: \"edea2342-84be-47c9-ba0e-a1cc69e50a54\") " pod="kube-system/konnectivity-agent-82kbn"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044696    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea7b2554-9f59-4dd0-9f16-6c6203fff2ff-iptables-alerter-script\") pod \"iptables-alerter-crxbm\" (UID: \"ea7b2554-9f59-4dd0-9f16-6c6203fff2ff\") " pod="openshift-network-operator/iptables-alerter-crxbm"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044702    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-cni-netd\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044719    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18f91b3f-47a9-4eb6-8547-eee59181ac7d-dbus\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044732    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-var-lib-openvswitch\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044747    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-kubelet\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044757    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-systemd-units\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-os-release\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-run-k8s-cni-cncf-io\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044795    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044806    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-cnibin\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svqjm\" (UniqueName: \"kubernetes.io/projected/2d97c0f1-d007-4f7b-a19e-3dcce094357a-kube-api-access-svqjm\") pod \"node-ca-9bwjx\" (UID: \"2d97c0f1-d007-4f7b-a19e-3dcce094357a\") " pod="openshift-image-registry/node-ca-9bwjx"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044841    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-cnibin\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b930586c-e3b5-49ed-831a-3bb0ceb55958-tmp-dir\") pod \"node-resolver-xxrtv\" (UID: \"b930586c-e3b5-49ed-831a-3bb0ceb55958\") " pod="openshift-dns/node-resolver-xxrtv"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044849    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-device-dir\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044626    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-var-lib-cni-multus\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044879    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-tuned\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.047960 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-tmp\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044937    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-host-run-k8s-cni-cncf-io\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044941    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c325dbc-01f4-408b-b00f-ffe0e053aeed-os-release\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-sysconfig\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044985    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-run\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.044986    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-var-lib-openvswitch\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.045001    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c325dbc-01f4-408b-b00f-ffe0e053aeed-cni-binary-copy\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.045015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-sys-fs\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.045035    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-systemd\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.045043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-run-openvswitch\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.045081    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-sysconfig\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.045109    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f740e8d-ee64-4940-9d2b-c9d13d687f07-run-openvswitch\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.045125    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-run\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.045171    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d780ed3d-6d78-4bb2-be7a-ea241cd28185-sys-fs\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.045186    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-system-cni-dir\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.045281    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b930586c-e3b5-49ed-831a-3bb0ceb55958-tmp-dir\") pod \"node-resolver-xxrtv\" (UID: \"b930586c-e3b5-49ed-831a-3bb0ceb55958\") " pod="openshift-dns/node-resolver-xxrtv"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.045616    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.046316    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f740e8d-ee64-4940-9d2b-c9d13d687f07-ovn-node-metrics-cert\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.048511 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.046494    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/edea2342-84be-47c9-ba0e-a1cc69e50a54-agent-certs\") pod \"konnectivity-agent-82kbn\" (UID: \"edea2342-84be-47c9-ba0e-a1cc69e50a54\") " pod="kube-system/konnectivity-agent-82kbn"
Jul 08 06:55:32.049034 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.047317    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-etc-tuned\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.049034 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.047481    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-tmp\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.053824 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.053791    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:32.053824 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.053815    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:32.053983 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.053829    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnks5 for pod openshift-network-diagnostics/network-check-target-5kqw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:32.054613 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.054286    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5 podName:9be122b9-70f7-40c5-a0f2-8e6d43def7f1 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:32.554263272 +0000 UTC m=+3.263546396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pnks5" (UniqueName: "kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5") pod "network-check-target-5kqw5" (UID: "9be122b9-70f7-40c5-a0f2-8e6d43def7f1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:32.055835 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.055815    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvbjj\" (UniqueName: \"kubernetes.io/projected/d780ed3d-6d78-4bb2-be7a-ea241cd28185-kube-api-access-fvbjj\") pod \"aws-ebs-csi-driver-node-jzv28\" (UID: \"d780ed3d-6d78-4bb2-be7a-ea241cd28185\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.055935 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.055887    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5ggn\" (UniqueName: \"kubernetes.io/projected/b930586c-e3b5-49ed-831a-3bb0ceb55958-kube-api-access-c5ggn\") pod \"node-resolver-xxrtv\" (UID: \"b930586c-e3b5-49ed-831a-3bb0ceb55958\") " pod="openshift-dns/node-resolver-xxrtv"
Jul 08 06:55:32.056199 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.056173    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkljv\" (UniqueName: \"kubernetes.io/projected/4c325dbc-01f4-408b-b00f-ffe0e053aeed-kube-api-access-zkljv\") pod \"multus-zzg72\" (UID: \"4c325dbc-01f4-408b-b00f-ffe0e053aeed\") " pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.056667 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.056642    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svqjm\" (UniqueName: \"kubernetes.io/projected/2d97c0f1-d007-4f7b-a19e-3dcce094357a-kube-api-access-svqjm\") pod \"node-ca-9bwjx\" (UID: \"2d97c0f1-d007-4f7b-a19e-3dcce094357a\") " pod="openshift-image-registry/node-ca-9bwjx"
Jul 08 06:55:32.056759 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.056725    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md2c9\" (UniqueName: \"kubernetes.io/projected/0f740e8d-ee64-4940-9d2b-c9d13d687f07-kube-api-access-md2c9\") pod \"ovnkube-node-tst7z\" (UID: \"0f740e8d-ee64-4940-9d2b-c9d13d687f07\") " pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.056940 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.056909    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7c22\" (UniqueName: \"kubernetes.io/projected/ea7b2554-9f59-4dd0-9f16-6c6203fff2ff-kube-api-access-n7c22\") pod \"iptables-alerter-crxbm\" (UID: \"ea7b2554-9f59-4dd0-9f16-6c6203fff2ff\") " pod="openshift-network-operator/iptables-alerter-crxbm"
Jul 08 06:55:32.057342 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.057324    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrdc8\" (UniqueName: \"kubernetes.io/projected/472c4a73-2d24-400f-ae39-45695d6af154-kube-api-access-jrdc8\") pod \"network-metrics-daemon-tjrq6\" (UID: \"472c4a73-2d24-400f-ae39-45695d6af154\") " pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:32.058616 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.058595    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlcbg\" (UniqueName: \"kubernetes.io/projected/18c4910d-2dc7-4b52-a0c5-1b3b52c976c9-kube-api-access-tlcbg\") pod \"multus-additional-cni-plugins-njffd\" (UID: \"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9\") " pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.058697 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.058595    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x69cn\" (UniqueName: \"kubernetes.io/projected/081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4-kube-api-access-x69cn\") pod \"tuned-2rpkm\" (UID: \"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4\") " pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.154631 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.154583    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28"
Jul 08 06:55:32.165987 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:32.165961    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd780ed3d_6d78_4bb2_be7a_ea241cd28185.slice/crio-8a9607c05e61dedab38ed663220cd0f52c67b26e53e33f45c6bf874006f57ace WatchSource:0}: Error finding container 8a9607c05e61dedab38ed663220cd0f52c67b26e53e33f45c6bf874006f57ace: Status 404 returned error can't find the container with id 8a9607c05e61dedab38ed663220cd0f52c67b26e53e33f45c6bf874006f57ace
Jul 08 06:55:32.169300 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.169276    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-crxbm"
Jul 08 06:55:32.177566 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:32.177543    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea7b2554_9f59_4dd0_9f16_6c6203fff2ff.slice/crio-1be1544df3bb526f00a4ea2f3c499f095d9b31e95381ee61935f093f0a159dd4 WatchSource:0}: Error finding container 1be1544df3bb526f00a4ea2f3c499f095d9b31e95381ee61935f093f0a159dd4: Status 404 returned error can't find the container with id 1be1544df3bb526f00a4ea2f3c499f095d9b31e95381ee61935f093f0a159dd4
Jul 08 06:55:32.185795 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.185775    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:55:32.194119 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:32.194095    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f740e8d_ee64_4940_9d2b_c9d13d687f07.slice/crio-bc946146eba39b250c2d7c4e45bdc34ed89871f3973297b18b04009f6b60ed20 WatchSource:0}: Error finding container bc946146eba39b250c2d7c4e45bdc34ed89871f3973297b18b04009f6b60ed20: Status 404 returned error can't find the container with id bc946146eba39b250c2d7c4e45bdc34ed89871f3973297b18b04009f6b60ed20
Jul 08 06:55:32.207548 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.207530    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bwjx"
Jul 08 06:55:32.215754 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:32.215728    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d97c0f1_d007_4f7b_a19e_3dcce094357a.slice/crio-41d580724ec64a1bca873ccf3576e02d2acc449a718bf746a0cb31c76150f97b WatchSource:0}: Error finding container 41d580724ec64a1bca873ccf3576e02d2acc449a718bf746a0cb31c76150f97b: Status 404 returned error can't find the container with id 41d580724ec64a1bca873ccf3576e02d2acc449a718bf746a0cb31c76150f97b
Jul 08 06:55:32.222867 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.222849    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xxrtv"
Jul 08 06:55:32.231366 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:32.231345    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb930586c_e3b5_49ed_831a_3bb0ceb55958.slice/crio-8ca18fb64dda5e6937434cbc5bd1c75d28dc718fae6f3094be04c77852da528a WatchSource:0}: Error finding container 8ca18fb64dda5e6937434cbc5bd1c75d28dc718fae6f3094be04c77852da528a: Status 404 returned error can't find the container with id 8ca18fb64dda5e6937434cbc5bd1c75d28dc718fae6f3094be04c77852da528a
Jul 08 06:55:32.237303 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.237285    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-njffd"
Jul 08 06:55:32.245010 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.244980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2rpkm"
Jul 08 06:55:32.245220 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:32.245202    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c4910d_2dc7_4b52_a0c5_1b3b52c976c9.slice/crio-b333215ff4691f0459429bc2e511cc416e8bb92b621617b0f2aac87affb0ef08 WatchSource:0}: Error finding container b333215ff4691f0459429bc2e511cc416e8bb92b621617b0f2aac87affb0ef08: Status 404 returned error can't find the container with id b333215ff4691f0459429bc2e511cc416e8bb92b621617b0f2aac87affb0ef08
Jul 08 06:55:32.254668 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:32.254611    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081bc8b0_3fd7_46d8_a8aa_94cc64e9bbd4.slice/crio-1d39a3ba03da15acbfd4ac56931dbfbc6661fa752ad7befaa5b0e1b9541439ec WatchSource:0}: Error finding container 1d39a3ba03da15acbfd4ac56931dbfbc6661fa752ad7befaa5b0e1b9541439ec: Status 404 returned error can't find the container with id 1d39a3ba03da15acbfd4ac56931dbfbc6661fa752ad7befaa5b0e1b9541439ec
Jul 08 06:55:32.257575 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.257556    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zzg72"
Jul 08 06:55:32.262477 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.262458    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-82kbn"
Jul 08 06:55:32.267419 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:32.267399    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c325dbc_01f4_408b_b00f_ffe0e053aeed.slice/crio-80343ee4895855c59b0c7f61836140947d9f409fd1449d6089ec0cef1918a69d WatchSource:0}: Error finding container 80343ee4895855c59b0c7f61836140947d9f409fd1449d6089ec0cef1918a69d: Status 404 returned error can't find the container with id 80343ee4895855c59b0c7f61836140947d9f409fd1449d6089ec0cef1918a69d
Jul 08 06:55:32.272493 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:55:32.272473    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedea2342_84be_47c9_ba0e_a1cc69e50a54.slice/crio-7582c0809f2fdd18394e2235c5ee753df4965cd76aac339266cc25a1f03fb2af WatchSource:0}: Error finding container 7582c0809f2fdd18394e2235c5ee753df4965cd76aac339266cc25a1f03fb2af: Status 404 returned error can't find the container with id 7582c0809f2fdd18394e2235c5ee753df4965cd76aac339266cc25a1f03fb2af
Jul 08 06:55:32.372743 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.372711    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:55:32.549585 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.549321    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:32.549585 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.549421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs\") pod \"network-metrics-daemon-tjrq6\" (UID: \"472c4a73-2d24-400f-ae39-45695d6af154\") " pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:32.549806 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.549600    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:32.549806 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.549667    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs podName:472c4a73-2d24-400f-ae39-45695d6af154 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:33.549648293 +0000 UTC m=+4.258931388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs") pod "network-metrics-daemon-tjrq6" (UID: "472c4a73-2d24-400f-ae39-45695d6af154") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:32.549925 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.549836    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:32.549925 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.549882    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret podName:18f91b3f-47a9-4eb6-8547-eee59181ac7d nodeName:}" failed. No retries permitted until 2026-07-08 06:55:33.549868813 +0000 UTC m=+4.259151918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret") pod "global-pull-secret-syncer-4lm92" (UID: "18f91b3f-47a9-4eb6-8547-eee59181ac7d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:32.650820 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.650664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnks5\" (UniqueName: \"kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5\") pod \"network-check-target-5kqw5\" (UID: \"9be122b9-70f7-40c5-a0f2-8e6d43def7f1\") " pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:32.651009 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.650940    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:32.651109 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.651014    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:32.651109 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.651030    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnks5 for pod openshift-network-diagnostics/network-check-target-5kqw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:32.651109 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:32.651092    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5 podName:9be122b9-70f7-40c5-a0f2-8e6d43def7f1 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:33.651071786 +0000 UTC m=+4.360354892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnks5" (UniqueName: "kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5") pod "network-check-target-5kqw5" (UID: "9be122b9-70f7-40c5-a0f2-8e6d43def7f1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:32.923247 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.923114    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 06:50:32 +0000 UTC" deadline="2028-03-25 20:48:02.969088834 +0000 UTC"
Jul 08 06:55:32.923247 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:32.923196    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15037h52m30.045899002s"
Jul 08 06:55:33.033188 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.033108    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:33.033377 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:33.033276    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:33.033707 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.033684    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:33.033821 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:33.033795    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:33.068029 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.067993    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z" event={"ID":"0f740e8d-ee64-4940-9d2b-c9d13d687f07","Type":"ContainerStarted","Data":"bc946146eba39b250c2d7c4e45bdc34ed89871f3973297b18b04009f6b60ed20"}
Jul 08 06:55:33.079067 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.079031    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-crxbm" event={"ID":"ea7b2554-9f59-4dd0-9f16-6c6203fff2ff","Type":"ContainerStarted","Data":"1be1544df3bb526f00a4ea2f3c499f095d9b31e95381ee61935f093f0a159dd4"}
Jul 08 06:55:33.100801 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.100694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28" event={"ID":"d780ed3d-6d78-4bb2-be7a-ea241cd28185","Type":"ContainerStarted","Data":"8a9607c05e61dedab38ed663220cd0f52c67b26e53e33f45c6bf874006f57ace"}
Jul 08 06:55:33.136106 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.136067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zzg72" event={"ID":"4c325dbc-01f4-408b-b00f-ffe0e053aeed","Type":"ContainerStarted","Data":"80343ee4895855c59b0c7f61836140947d9f409fd1449d6089ec0cef1918a69d"}
Jul 08 06:55:33.158264 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.158040    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:55:33.159091 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.159041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2rpkm" event={"ID":"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4","Type":"ContainerStarted","Data":"1d39a3ba03da15acbfd4ac56931dbfbc6661fa752ad7befaa5b0e1b9541439ec"}
Jul 08 06:55:33.170886 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.170854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njffd" event={"ID":"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9","Type":"ContainerStarted","Data":"b333215ff4691f0459429bc2e511cc416e8bb92b621617b0f2aac87affb0ef08"}
Jul 08 06:55:33.182896 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.182828    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xxrtv" event={"ID":"b930586c-e3b5-49ed-831a-3bb0ceb55958","Type":"ContainerStarted","Data":"8ca18fb64dda5e6937434cbc5bd1c75d28dc718fae6f3094be04c77852da528a"}
Jul 08 06:55:33.209546 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.209507    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bwjx" event={"ID":"2d97c0f1-d007-4f7b-a19e-3dcce094357a","Type":"ContainerStarted","Data":"41d580724ec64a1bca873ccf3576e02d2acc449a718bf746a0cb31c76150f97b"}
Jul 08 06:55:33.227836 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.227796    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-82kbn" event={"ID":"edea2342-84be-47c9-ba0e-a1cc69e50a54","Type":"ContainerStarted","Data":"7582c0809f2fdd18394e2235c5ee753df4965cd76aac339266cc25a1f03fb2af"}
Jul 08 06:55:33.559250 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.559205    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:33.559443 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.559312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs\") pod \"network-metrics-daemon-tjrq6\" (UID: \"472c4a73-2d24-400f-ae39-45695d6af154\") " pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:33.559499 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:33.559481    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:33.559557 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:33.559548    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs podName:472c4a73-2d24-400f-ae39-45695d6af154 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:35.559529066 +0000 UTC m=+6.268812181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs") pod "network-metrics-daemon-tjrq6" (UID: "472c4a73-2d24-400f-ae39-45695d6af154") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:33.561044 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:33.559955    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:33.561044 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:33.560011    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret podName:18f91b3f-47a9-4eb6-8547-eee59181ac7d nodeName:}" failed. No retries permitted until 2026-07-08 06:55:35.559995162 +0000 UTC m=+6.269278255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret") pod "global-pull-secret-syncer-4lm92" (UID: "18f91b3f-47a9-4eb6-8547-eee59181ac7d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:33.660128 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.660071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnks5\" (UniqueName: \"kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5\") pod \"network-check-target-5kqw5\" (UID: \"9be122b9-70f7-40c5-a0f2-8e6d43def7f1\") " pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:33.660499 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:33.660310    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:33.660499 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:33.660340    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:33.660499 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:33.660354    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnks5 for pod openshift-network-diagnostics/network-check-target-5kqw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:33.660499 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:33.660414    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5 podName:9be122b9-70f7-40c5-a0f2-8e6d43def7f1 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:35.66039444 +0000 UTC m=+6.369677535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnks5" (UniqueName: "kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5") pod "network-check-target-5kqw5" (UID: "9be122b9-70f7-40c5-a0f2-8e6d43def7f1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:33.924298 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.924155    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 06:50:32 +0000 UTC" deadline="2028-03-14 09:19:43.033378689 +0000 UTC"
Jul 08 06:55:33.924298 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.924197    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14762h24m9.109186914s"
Jul 08 06:55:33.993340 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:33.993114    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 06:55:34.029879 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:34.029814    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:34.030063 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:34.029954    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:35.032863 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:35.032137    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:35.032863 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:35.032296    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:35.032863 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:35.032685    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:35.032863 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:35.032799    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:35.576958 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:35.576919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs\") pod \"network-metrics-daemon-tjrq6\" (UID: \"472c4a73-2d24-400f-ae39-45695d6af154\") " pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:35.577141 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:35.576995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:35.577243 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:35.577173    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:35.577243 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:35.577239    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret podName:18f91b3f-47a9-4eb6-8547-eee59181ac7d nodeName:}" failed. No retries permitted until 2026-07-08 06:55:39.577218984 +0000 UTC m=+10.286502079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret") pod "global-pull-secret-syncer-4lm92" (UID: "18f91b3f-47a9-4eb6-8547-eee59181ac7d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:35.577817 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:35.577796    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:35.577917 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:35.577865    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs podName:472c4a73-2d24-400f-ae39-45695d6af154 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:39.577844417 +0000 UTC m=+10.287127512 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs") pod "network-metrics-daemon-tjrq6" (UID: "472c4a73-2d24-400f-ae39-45695d6af154") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:35.678058 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:35.678008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnks5\" (UniqueName: \"kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5\") pod \"network-check-target-5kqw5\" (UID: \"9be122b9-70f7-40c5-a0f2-8e6d43def7f1\") " pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:35.678260 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:35.678245    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:35.678325 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:35.678267    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:35.678325 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:35.678282    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnks5 for pod openshift-network-diagnostics/network-check-target-5kqw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:35.678418 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:35.678373    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5 podName:9be122b9-70f7-40c5-a0f2-8e6d43def7f1 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:39.678352183 +0000 UTC m=+10.387635298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnks5" (UniqueName: "kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5") pod "network-check-target-5kqw5" (UID: "9be122b9-70f7-40c5-a0f2-8e6d43def7f1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:36.029925 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:36.029835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:36.030085 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:36.029989    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:37.030773 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:37.030730    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:37.030773 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:37.030771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:37.031349 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:37.030878    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:37.031349 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:37.030983    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:38.029776 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:38.029737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:38.029994 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:38.029870    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:39.031071 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:39.029973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:39.031071 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:39.030185    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:39.031071 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:39.030270    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:39.031071 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:39.030391    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:39.613053 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:39.612770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:39.613053 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:39.612863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs\") pod \"network-metrics-daemon-tjrq6\" (UID: \"472c4a73-2d24-400f-ae39-45695d6af154\") " pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:39.613053 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:39.612985    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:39.613053 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:39.613052    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs podName:472c4a73-2d24-400f-ae39-45695d6af154 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:47.613033307 +0000 UTC m=+18.322316402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs") pod "network-metrics-daemon-tjrq6" (UID: "472c4a73-2d24-400f-ae39-45695d6af154") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:39.613393 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:39.612985    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:39.613453 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:39.613431    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret podName:18f91b3f-47a9-4eb6-8547-eee59181ac7d nodeName:}" failed. No retries permitted until 2026-07-08 06:55:47.613412688 +0000 UTC m=+18.322695796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret") pod "global-pull-secret-syncer-4lm92" (UID: "18f91b3f-47a9-4eb6-8547-eee59181ac7d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:39.713265 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:39.713222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnks5\" (UniqueName: \"kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5\") pod \"network-check-target-5kqw5\" (UID: \"9be122b9-70f7-40c5-a0f2-8e6d43def7f1\") " pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:39.713451 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:39.713389    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:39.713451 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:39.713414    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:39.713451 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:39.713427    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnks5 for pod openshift-network-diagnostics/network-check-target-5kqw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:39.713609 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:39.713485    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5 podName:9be122b9-70f7-40c5-a0f2-8e6d43def7f1 nodeName:}" failed. No retries permitted until 2026-07-08 06:55:47.713466987 +0000 UTC m=+18.422750091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnks5" (UniqueName: "kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5") pod "network-check-target-5kqw5" (UID: "9be122b9-70f7-40c5-a0f2-8e6d43def7f1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:40.030285 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:40.030214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:40.030429 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:40.030335    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:41.032199 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:41.031593    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:41.032199 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:41.031736    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:41.032199 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:41.032049    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:41.032900 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:41.032214    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:42.030277 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:42.030191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:42.030516 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:42.030329    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:43.030014 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:43.029980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:43.030489 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:43.030124    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:43.030489 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:43.030176    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:43.030489 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:43.030305    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:44.029673 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:44.029634    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:44.029849 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:44.029774    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:45.029584 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:45.029545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:45.030037 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:45.029680    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:45.030037 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:45.029743    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:45.030037 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:45.029875    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:46.029626 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:46.029587    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:46.030096 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:46.029724    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:47.030473 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:47.030430    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:47.030951 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:47.030450    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:47.030951 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:47.030566    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:47.030951 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:47.030654    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:47.674955 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:47.674913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs\") pod \"network-metrics-daemon-tjrq6\" (UID: \"472c4a73-2d24-400f-ae39-45695d6af154\") " pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:47.675231 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:47.674980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:47.675231 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:47.675091    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:47.675231 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:47.675109    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:47.675231 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:47.675157    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs podName:472c4a73-2d24-400f-ae39-45695d6af154 nodeName:}" failed. No retries permitted until 2026-07-08 06:56:03.675139384 +0000 UTC m=+34.384422474 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs") pod "network-metrics-daemon-tjrq6" (UID: "472c4a73-2d24-400f-ae39-45695d6af154") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:55:47.675231 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:47.675176    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret podName:18f91b3f-47a9-4eb6-8547-eee59181ac7d nodeName:}" failed. No retries permitted until 2026-07-08 06:56:03.675167246 +0000 UTC m=+34.384450334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret") pod "global-pull-secret-syncer-4lm92" (UID: "18f91b3f-47a9-4eb6-8547-eee59181ac7d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:55:47.776101 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:47.776052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnks5\" (UniqueName: \"kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5\") pod \"network-check-target-5kqw5\" (UID: \"9be122b9-70f7-40c5-a0f2-8e6d43def7f1\") " pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:47.776276 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:47.776217    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:55:47.776276 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:47.776244    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:55:47.776276 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:47.776258    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnks5 for pod openshift-network-diagnostics/network-check-target-5kqw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:47.776412 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:47.776314    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5 podName:9be122b9-70f7-40c5-a0f2-8e6d43def7f1 nodeName:}" failed. No retries permitted until 2026-07-08 06:56:03.776297828 +0000 UTC m=+34.485580916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnks5" (UniqueName: "kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5") pod "network-check-target-5kqw5" (UID: "9be122b9-70f7-40c5-a0f2-8e6d43def7f1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:55:48.030118 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:48.030031    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:48.030252 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:48.030154    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:49.029896 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:49.029861    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:49.030336 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:49.029995    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:49.030336 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:49.030053    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:49.030336 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:49.030179    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:50.030463 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:50.030430    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:50.030871 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:50.030583    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:51.030495 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:51.030459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:51.030953 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:51.030589    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:51.030953 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:51.030648    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:51.030953 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:51.030765    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:52.030167 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:52.030129    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:52.030339 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:52.030255    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:53.029757 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:53.029714    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:53.030183 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:53.029859    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:53.030183 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:53.029898    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:53.030183 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:53.029968    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:53.279451 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:53.279423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal" event={"ID":"b42444b7e0c741e5903c2be5ebcd8af2","Type":"ContainerStarted","Data":"c703863662443f49a5bab58187f23a2b025b7abf05e0c38c4267231cfb04f234"}
Jul 08 06:55:53.281348 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:53.281314    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zzg72" event={"ID":"4c325dbc-01f4-408b-b00f-ffe0e053aeed","Type":"ContainerStarted","Data":"5c345c274f5d209408ef01eb001aba4f98ba9b9d57137048201030e382e4b680"}
Jul 08 06:55:53.283119 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:53.283054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2rpkm" event={"ID":"081bc8b0-3fd7-46d8-a8aa-94cc64e9bbd4","Type":"ContainerStarted","Data":"c40fd4f27cd9316b8d52726ec44a35d62c4013dc435f3683cbbb54c8e4e6cf35"}
Jul 08 06:55:53.294066 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:53.294026    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-191.ec2.internal" podStartSLOduration=21.294013679 podStartE2EDuration="21.294013679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:53.293448376 +0000 UTC m=+24.002731485" watchObservedRunningTime="2026-07-08 06:55:53.294013679 +0000 UTC m=+24.003296789"
Jul 08 06:55:53.309517 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:53.309478    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zzg72" podStartSLOduration=1.908252329 podStartE2EDuration="22.309463851s" totalImagesPullingTime="20.401211522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:53.309088641 +0000 UTC m=+24.018371742" watchObservedRunningTime="2026-07-08 06:55:53.309463851 +0000 UTC m=+24.018746961"
Jul 08 06:55:53.325753 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:53.325715    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2rpkm" podStartSLOduration=1.925171331 podStartE2EDuration="22.325701937s" totalImagesPullingTime="20.400530606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:53.325657657 +0000 UTC m=+24.034940768" watchObservedRunningTime="2026-07-08 06:55:53.325701937 +0000 UTC m=+24.034985047"
Jul 08 06:55:54.030195 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:54.029956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:54.030698 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:54.030244    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:54.287831 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:54.287781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njffd" event={"ID":"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9","Type":"ContainerStarted","Data":"a55df34cff6cfed674872cf21c4442db62bfd81a86acd8dd7f1fa4b0a84d1481"}
Jul 08 06:55:54.295488 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:54.295457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-82kbn" event={"ID":"edea2342-84be-47c9-ba0e-a1cc69e50a54","Type":"ContainerStarted","Data":"d30b816bba6268cd1576bffcbfef1a6d4fcf84e6a4cb1b07d037ffd95e8ca75a"}
Jul 08 06:55:54.298697 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:54.298637    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 06:55:54.298995 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:54.298973    2565 generic.go:356] "Generic (PLEG): container finished" podID="0f740e8d-ee64-4940-9d2b-c9d13d687f07" containerID="d0fd126dbadb6b1c38a58610a86235ac395e51bece874b70e192f1ab314d5dff" exitCode=1
Jul 08 06:55:54.299108 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:54.299037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z" event={"ID":"0f740e8d-ee64-4940-9d2b-c9d13d687f07","Type":"ContainerStarted","Data":"9d58c0e8f9bd3a27156c6e0d749fcd216d8e86af411230ae4339682f8e853f96"}
Jul 08 06:55:54.299169 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:54.299108    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z" event={"ID":"0f740e8d-ee64-4940-9d2b-c9d13d687f07","Type":"ContainerStarted","Data":"3a03d54a341c772ab7a5aac26e5d9bc70f9a85eb1a905f80b92a52f9c26dcfba"}
Jul 08 06:55:54.299169 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:54.299139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z" event={"ID":"0f740e8d-ee64-4940-9d2b-c9d13d687f07","Type":"ContainerStarted","Data":"05573f0e4649202254e59d52b5d79fc5e5521f0b7cfe1803c58b6bab10db284e"}
Jul 08 06:55:54.299169 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:54.299168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z" event={"ID":"0f740e8d-ee64-4940-9d2b-c9d13d687f07","Type":"ContainerStarted","Data":"09bd8e888b7d647e3eeb17121d76e76db16b32594d36faf46f8c342f283a1343"}
Jul 08 06:55:54.299258 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:54.299197    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z" event={"ID":"0f740e8d-ee64-4940-9d2b-c9d13d687f07","Type":"ContainerDied","Data":"d0fd126dbadb6b1c38a58610a86235ac395e51bece874b70e192f1ab314d5dff"}
Jul 08 06:55:54.299258 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:54.299225    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z" event={"ID":"0f740e8d-ee64-4940-9d2b-c9d13d687f07","Type":"ContainerStarted","Data":"d015b62c38251d03e13a3962d2de8c4a676ffa6621eca4a4acc8640d517344e7"}
Jul 08 06:55:54.301651 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:54.301211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-crxbm" event={"ID":"ea7b2554-9f59-4dd0-9f16-6c6203fff2ff","Type":"ContainerStarted","Data":"5e1a78dabd7d78696a2060958ddaf32df2d84cb543996383795f17ce3f15ed8c"}
Jul 08 06:55:54.310653 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:54.310610    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-82kbn" podStartSLOduration=1.94664489 podStartE2EDuration="22.310572175s" totalImagesPullingTime="20.363927285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:54.310103964 +0000 UTC m=+25.019387076" watchObservedRunningTime="2026-07-08 06:55:54.310572175 +0000 UTC m=+25.019855286"
Jul 08 06:55:55.030356 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.030318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:55.031086 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.030367    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:55.031086 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:55.030462    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:55.031086 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:55.030593    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:55.211827 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.211781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:55.307057 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.307028    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28" event={"ID":"d780ed3d-6d78-4bb2-be7a-ea241cd28185","Type":"ContainerStarted","Data":"a6c5eaf424e723b7293af9771d65fe7d604b6c8225b8cb43431704318825d565"}
Jul 08 06:55:55.308493 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.308471    2565 generic.go:356] "Generic (PLEG): container finished" podID="18c4910d-2dc7-4b52-a0c5-1b3b52c976c9" containerID="a55df34cff6cfed674872cf21c4442db62bfd81a86acd8dd7f1fa4b0a84d1481" exitCode=0
Jul 08 06:55:55.308607 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.308539    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njffd" event={"ID":"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9","Type":"ContainerDied","Data":"a55df34cff6cfed674872cf21c4442db62bfd81a86acd8dd7f1fa4b0a84d1481"}
Jul 08 06:55:55.309942 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.309925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xxrtv" event={"ID":"b930586c-e3b5-49ed-831a-3bb0ceb55958","Type":"ContainerStarted","Data":"9b9b6f7fe5a08945a6a4ce13895ebaacd30090cc82dd153c924669c0a78a7fe3"}
Jul 08 06:55:55.311337 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.311318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bwjx" event={"ID":"2d97c0f1-d007-4f7b-a19e-3dcce094357a","Type":"ContainerStarted","Data":"02c5268e0ec2eef9028c356321a8df72eb66a4c9974db34a7b33f18852aaaef3"}
Jul 08 06:55:55.312683 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.312663    2565 generic.go:356] "Generic (PLEG): container finished" podID="911bdb8872e4635cd562e9ddf347f774" containerID="015483dc8e442ec3db88f521cf9a008b913b9376257c243a93cf381cda11015e" exitCode=0
Jul 08 06:55:55.312778 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.312746    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal" event={"ID":"911bdb8872e4635cd562e9ddf347f774","Type":"ContainerDied","Data":"015483dc8e442ec3db88f521cf9a008b913b9376257c243a93cf381cda11015e"}
Jul 08 06:55:55.331996 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.331825    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-crxbm" podStartSLOduration=3.850628301 podStartE2EDuration="24.331812569s" totalImagesPullingTime="20.481184268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:54.325212886 +0000 UTC m=+25.034496020" watchObservedRunningTime="2026-07-08 06:55:55.331812569 +0000 UTC m=+26.041095678"
Jul 08 06:55:55.350205 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.350164    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9bwjx" podStartSLOduration=3.929720535 podStartE2EDuration="24.350145645s" totalImagesPullingTime="20.42042511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:55.350030335 +0000 UTC m=+26.059313445" watchObservedRunningTime="2026-07-08 06:55:55.350145645 +0000 UTC m=+26.059428756"
Jul 08 06:55:55.365723 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.365667    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xxrtv" podStartSLOduration=3.9607464759999997 podStartE2EDuration="24.365647057s" totalImagesPullingTime="20.404900581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:55.364998163 +0000 UTC m=+26.074281274" watchObservedRunningTime="2026-07-08 06:55:55.365647057 +0000 UTC m=+26.074930169"
Jul 08 06:55:55.407937 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.407914    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:55.429753 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.429389    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 06:55:55.480640 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.480594    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:55.581022 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.580993    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:55.639097 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.639051    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:55.906159 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.905973    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T06:55:55.429405895Z","UUID":"38b1c49c-2413-4d50-a0c7-411757011b83","Handler":null,"Name":"","Endpoint":""}
Jul 08 06:55:55.907718 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.907684    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 06:55:55.907718 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:55.907724    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 06:55:56.029802 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:56.029780    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:56.029929 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:56.029904    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:56.317335 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:56.317244    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal" event={"ID":"911bdb8872e4635cd562e9ddf347f774","Type":"ContainerStarted","Data":"55f07c90bee000a1ba29740e91791ad443bee087ad36e688f3d6078a534e1b89"}
Jul 08 06:55:56.320873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:56.320845    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 06:55:56.321361 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:56.321335    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z" event={"ID":"0f740e8d-ee64-4940-9d2b-c9d13d687f07","Type":"ContainerStarted","Data":"fb8143494cf77a0667fde4ca13f306162ebbb1a87a4f88d6a17d74c0b24c1f71"}
Jul 08 06:55:56.323153 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:56.323113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28" event={"ID":"d780ed3d-6d78-4bb2-be7a-ea241cd28185","Type":"ContainerStarted","Data":"c48685a0584f6a0b571de66735df111e6a94e2bf03a693248b383c1437f9236f"}
Jul 08 06:55:56.331588 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:56.331542    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-191.ec2.internal" podStartSLOduration=24.331524808 podStartE2EDuration="24.331524808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:56.331473314 +0000 UTC m=+27.040756424" watchObservedRunningTime="2026-07-08 06:55:56.331524808 +0000 UTC m=+27.040807935"
Jul 08 06:55:56.438978 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:56.438944    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-82kbn"
Jul 08 06:55:56.439548 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:56.439527    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-82kbn"
Jul 08 06:55:57.030117 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:57.030021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:57.030117 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:57.030050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:57.030422 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:57.030157    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:57.030422 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:57.030288    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:57.328117 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:57.328041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28" event={"ID":"d780ed3d-6d78-4bb2-be7a-ea241cd28185","Type":"ContainerStarted","Data":"02961239cc8e7d0878d7193846dc9d8df69cc6d3db994a658a7721d72ec29cc3"}
Jul 08 06:55:57.328637 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:57.328615    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-82kbn"
Jul 08 06:55:57.329020 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:57.329000    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-82kbn"
Jul 08 06:55:57.348117 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:57.348052    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jzv28" podStartSLOduration=3.8023874109999998 podStartE2EDuration="26.348036408s" totalImagesPullingTime="22.545648997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:55:57.347491679 +0000 UTC m=+28.056774794" watchObservedRunningTime="2026-07-08 06:55:57.348036408 +0000 UTC m=+28.057319551"
Jul 08 06:55:57.426532 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:57.426503    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:57.830435 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:57.830400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:57.980011 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:57.979972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:58.029803 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:58.029774    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:55:58.029976 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:58.029890    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:55:58.064859 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:58.064804    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:58.155392 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:58.155362    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:58.226311 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:58.226276    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:58.700017 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:58.699981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:58.795996 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:58.795948    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:59.029967 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:59.029899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:55:59.030127 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:59.030015    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:55:59.030127 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:59.030067    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:55:59.030241 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:55:59.030169    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:55:59.115611 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:59.115581    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:59.217417 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:59.217384    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:59.391041 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:59.391010    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:59.489091 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:59.488981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:59.666255 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:59.666232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:59.767831 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:59.767801    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:55:59.931570 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:55:59.931540    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:00.030274 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.030248    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:00.030395 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:00.030357    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:56:00.035458 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.035435    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:00.324360 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.324339    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xxrtv_b930586c-e3b5-49ed-831a-3bb0ceb55958/dns-node-resolver/0.log"
Jul 08 06:56:00.336677 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.336646    2565 generic.go:356] "Generic (PLEG): container finished" podID="18c4910d-2dc7-4b52-a0c5-1b3b52c976c9" containerID="8384e393e40490e64b779786114bba327e84d77b656fef5155fb6faea2422a09" exitCode=0
Jul 08 06:56:00.336813 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.336729    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njffd" event={"ID":"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9","Type":"ContainerDied","Data":"8384e393e40490e64b779786114bba327e84d77b656fef5155fb6faea2422a09"}
Jul 08 06:56:00.340246 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.340219    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 06:56:00.340606 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.340585    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z" event={"ID":"0f740e8d-ee64-4940-9d2b-c9d13d687f07","Type":"ContainerStarted","Data":"fcc4ea70e19e0ee54660b3be6746370c359c1a1ea1c9e510c403e1009a581b7b"}
Jul 08 06:56:00.340864 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.340837    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:56:00.340961 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.340902    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:56:00.340961 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.340950    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:56:00.341084 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.341018    2565 scope.go:117] "RemoveContainer" containerID="d0fd126dbadb6b1c38a58610a86235ac395e51bece874b70e192f1ab314d5dff"
Jul 08 06:56:00.356699 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.356679    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:56:00.357088 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.357052    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:56:00.923495 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:00.923465    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bwjx_2d97c0f1-d007-4f7b-a19e-3dcce094357a/node-ca/0.log"
Jul 08 06:56:01.030627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.030595    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:01.030780 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:01.030682    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:56:01.030780 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.030729    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:01.030854 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:01.030818    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:56:01.038454 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.038431    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:01.099514 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.099483    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:01.347499 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.347472    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 06:56:01.347888 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.347857    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z" event={"ID":"0f740e8d-ee64-4940-9d2b-c9d13d687f07","Type":"ContainerStarted","Data":"29df6ca697bb33c8ba7325a83c706d2d3f2813a9ee0779521e90cbaa5de1909a"}
Jul 08 06:56:01.381246 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.381191    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z" podStartSLOduration=9.343103056 podStartE2EDuration="30.381169851s" totalImagesPullingTime="21.038066795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:01.379389396 +0000 UTC m=+32.088672538" watchObservedRunningTime="2026-07-08 06:56:01.381169851 +0000 UTC m=+32.090452961"
Jul 08 06:56:01.724682 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.724607    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4lm92"]
Jul 08 06:56:01.724871 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.724723    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:01.724871 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:01.724835    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:56:01.726951 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.726923    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tjrq6"]
Jul 08 06:56:01.727091 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.727025    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:01.727180 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:01.727159    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:56:01.727506 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.727485    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5kqw5"]
Jul 08 06:56:01.727588 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.727563    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:01.727650 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:01.727636    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:56:01.956251 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:01.956215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:02.351373 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:02.351342    2565 generic.go:356] "Generic (PLEG): container finished" podID="18c4910d-2dc7-4b52-a0c5-1b3b52c976c9" containerID="90648fa941f85a2ed063441b7af4476207738984cf33fbf6b55bde6a845f7d02" exitCode=0
Jul 08 06:56:02.351548 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:02.351436    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njffd" event={"ID":"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9","Type":"ContainerDied","Data":"90648fa941f85a2ed063441b7af4476207738984cf33fbf6b55bde6a845f7d02"}
Jul 08 06:56:03.029508 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:03.029474    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:03.029861 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:03.029475    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:03.029861 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:03.029588    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:56:03.029861 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:03.029485    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:03.029861 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:03.029670    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:56:03.029861 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:03.029720    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:56:03.355766 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:03.355736    2565 generic.go:356] "Generic (PLEG): container finished" podID="18c4910d-2dc7-4b52-a0c5-1b3b52c976c9" containerID="2ee04d91eade69c3653949aec67a225d760d363546c9dbfd98c3d85c8f2ee786" exitCode=0
Jul 08 06:56:03.355902 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:03.355777    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njffd" event={"ID":"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9","Type":"ContainerDied","Data":"2ee04d91eade69c3653949aec67a225d760d363546c9dbfd98c3d85c8f2ee786"}
Jul 08 06:56:03.694882 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:03.694842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs\") pod \"network-metrics-daemon-tjrq6\" (UID: \"472c4a73-2d24-400f-ae39-45695d6af154\") " pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:03.695047 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:03.694896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:03.695047 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:03.694986    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 06:56:03.695047 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:03.694991    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:56:03.695047 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:03.695033    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret podName:18f91b3f-47a9-4eb6-8547-eee59181ac7d nodeName:}" failed. No retries permitted until 2026-07-08 06:56:35.695019785 +0000 UTC m=+66.404302877 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret") pod "global-pull-secret-syncer-4lm92" (UID: "18f91b3f-47a9-4eb6-8547-eee59181ac7d") : object "kube-system"/"original-pull-secret" not registered
Jul 08 06:56:03.695047 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:03.695046    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs podName:472c4a73-2d24-400f-ae39-45695d6af154 nodeName:}" failed. No retries permitted until 2026-07-08 06:56:35.695039861 +0000 UTC m=+66.404322948 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs") pod "network-metrics-daemon-tjrq6" (UID: "472c4a73-2d24-400f-ae39-45695d6af154") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 06:56:03.795384 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:03.795336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnks5\" (UniqueName: \"kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5\") pod \"network-check-target-5kqw5\" (UID: \"9be122b9-70f7-40c5-a0f2-8e6d43def7f1\") " pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:03.795564 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:03.795471    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 06:56:03.795564 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:03.795490    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 06:56:03.795564 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:03.795498    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnks5 for pod openshift-network-diagnostics/network-check-target-5kqw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:56:03.795564 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:03.795547    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5 podName:9be122b9-70f7-40c5-a0f2-8e6d43def7f1 nodeName:}" failed. No retries permitted until 2026-07-08 06:56:35.795532977 +0000 UTC m=+66.504816069 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnks5" (UniqueName: "kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5") pod "network-check-target-5kqw5" (UID: "9be122b9-70f7-40c5-a0f2-8e6d43def7f1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 06:56:05.029693 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:05.029662    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:05.030150 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:05.029666    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:05.030150 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:05.029784    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:56:05.030150 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:05.029848    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:56:05.030150 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:05.029674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:05.030150 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:05.029919    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:56:05.385280 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:05.385245    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:05.485531 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:05.485494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:06.066550 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:06.066486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:06.259495 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:06.259460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:06.419546 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:06.419512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:06.520311 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:06.520276    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:06.641222 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:06.641189    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:06.775001 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:06.774910    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:07.030006 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:07.029925    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:07.030006 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:07.029944    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:07.030006 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:07.030004    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:07.030285 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:07.030134    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:56:07.030285 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:07.030253    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:56:07.030397 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:07.030349    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:56:07.382696 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:07.382668    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:07.579497 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:07.579183    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:08.369763 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:08.369730    2565 generic.go:356] "Generic (PLEG): container finished" podID="18c4910d-2dc7-4b52-a0c5-1b3b52c976c9" containerID="dbf0b408b71312321050b14df03e11a926845f8ddd8441e9ae533a61ceee7129" exitCode=0
Jul 08 06:56:08.369935 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:08.369802    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njffd" event={"ID":"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9","Type":"ContainerDied","Data":"dbf0b408b71312321050b14df03e11a926845f8ddd8441e9ae533a61ceee7129"}
Jul 08 06:56:08.581268 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:08.581238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:08.687289 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:08.687202    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:08.782416 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:08.782380    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:09.029805 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:09.029704    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:09.029805 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:09.029704    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:09.030020 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:09.029814    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:56:09.030020 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:09.029830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:09.030020 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:09.029905    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:56:09.030020 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:09.029965    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:56:09.198170 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:09.198132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:09.375054 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:09.375012    2565 generic.go:356] "Generic (PLEG): container finished" podID="18c4910d-2dc7-4b52-a0c5-1b3b52c976c9" containerID="b50c2902673c87f14d299f1e5c24b4d0f4528f65026bb82f4f5f4154b4c714b9" exitCode=0
Jul 08 06:56:09.375054 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:09.375047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njffd" event={"ID":"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9","Type":"ContainerDied","Data":"b50c2902673c87f14d299f1e5c24b4d0f4528f65026bb82f4f5f4154b4c714b9"}
Jul 08 06:56:09.380044 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:09.380011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:09.762478 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:09.762384    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:09.817994 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:09.817960    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:10.373537 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:10.373509    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:10.380099 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:10.380058    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-njffd" event={"ID":"18c4910d-2dc7-4b52-a0c5-1b3b52c976c9","Type":"ContainerStarted","Data":"d95f8a5e8211416a452604b8c1497b4fe066658d57f91edee52ac1d4fecf67fc"}
Jul 08 06:56:10.407089 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:10.407018    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-njffd" podStartSLOduration=8.620029119 podStartE2EDuration="39.407002887s" totalImagesPullingTime="30.786973768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:10.406598838 +0000 UTC m=+41.115881948" watchObservedRunningTime="2026-07-08 06:56:10.407002887 +0000 UTC m=+41.116285996"
Jul 08 06:56:10.433099 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:10.433060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:10.562606 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:10.562577    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:10.759913 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:10.759834    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:11.031188 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:11.031116    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:11.031683 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:11.031187    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:56:11.031683 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:11.031207    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:11.031683 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:11.031264    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:11.031683 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:11.031338    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:56:11.031683 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:11.031493    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:56:11.100730 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:11.100691    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:11.202209 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:11.202176    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:11.259130 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:11.259094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:11.369210 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:11.369176    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:11.964666 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:11.964633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:12.565851 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:12.565824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:12.693163 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:12.693121    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:12.792762 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:12.792732    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:13.029847 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:13.029810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:13.030047 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:13.029810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:13.030047 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:13.029912    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:56:13.030047 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:13.030007    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:56:13.030047 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:13.029819    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:13.030292 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:13.030140    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:56:13.157527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:13.157480    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:13.421230 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:13.421196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:13.720796 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:13.720712    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:13.819900 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:13.819867    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:14.359572 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:14.359536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:14.859940 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:14.859906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:15.030535 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:15.030506    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:15.030700 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:15.030518    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:15.030700 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:15.030620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:15.030700 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:15.030613    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:56:15.030792 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:15.030710    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:56:15.030823 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:15.030787    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:56:15.165345 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:15.165268    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:15.360689 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:15.360659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:15.964667 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:15.964631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:16.357666 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:16.357635    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:16.562322 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:16.562283    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:16.756857 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:16.756757    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:17.029636 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:17.029554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:17.029636 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:17.029584    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:17.030143 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:17.029564    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:17.030143 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:17.029664    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:56:17.030143 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:17.029730    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:56:17.030143 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:17.029786    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:56:19.030029 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:19.029988    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:19.030029 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:19.030013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:19.030643 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:19.030013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:19.030643 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:19.030111    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:56:19.030643 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:19.030201    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:56:19.030643 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:19.030296    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:56:21.031024 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:21.030989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:21.031527 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:21.031140    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjrq6" podUID="472c4a73-2d24-400f-ae39-45695d6af154"
Jul 08 06:56:21.031527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:21.031218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:21.031527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:21.031328    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:21.031527 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:21.031334    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4lm92" podUID="18f91b3f-47a9-4eb6-8547-eee59181ac7d"
Jul 08 06:56:21.031527 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:21.031405    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kqw5" podUID="9be122b9-70f7-40c5-a0f2-8e6d43def7f1"
Jul 08 06:56:21.229269 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:21.229233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:21.327008 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:21.326981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:22.078593 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.078568    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-191.ec2.internal" event="NodeReady"
Jul 08 06:56:22.078955 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.078681    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 06:56:22.122504 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.122474    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wjfnw"]
Jul 08 06:56:22.138837 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.138815    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6rfd8"]
Jul 08 06:56:22.138986 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.138942    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.141675 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.141653    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pz4bn\""
Jul 08 06:56:22.141814 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.141780    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 06:56:22.141814 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.141781    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 06:56:22.160761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.160735    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wjfnw"]
Jul 08 06:56:22.160876 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.160777    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6rfd8"]
Jul 08 06:56:22.160876 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.160842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.163473 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.163453    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 06:56:22.163579 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.163520    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f5bjk\""
Jul 08 06:56:22.163674 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.163659    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 06:56:22.163734 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.163719    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 06:56:22.163779 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.163725    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 06:56:22.224726 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.224691    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f54v6"]
Jul 08 06:56:22.229311 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.229286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71454413-37b6-4895-84b9-5a18e0f7c3d0-tmp-dir\") pod \"dns-default-wjfnw\" (UID: \"71454413-37b6-4895-84b9-5a18e0f7c3d0\") " pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.229439 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.229320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9426f377-c768-4f39-8c36-c83512910a83-crio-socket\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.229439 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.229351    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71454413-37b6-4895-84b9-5a18e0f7c3d0-metrics-tls\") pod \"dns-default-wjfnw\" (UID: \"71454413-37b6-4895-84b9-5a18e0f7c3d0\") " pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.229439 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.229389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9426f377-c768-4f39-8c36-c83512910a83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.229439 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.229417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qth2s\" (UniqueName: \"kubernetes.io/projected/9426f377-c768-4f39-8c36-c83512910a83-kube-api-access-qth2s\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.229439 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.229437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9426f377-c768-4f39-8c36-c83512910a83-data-volume\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.229616 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.229457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/71454413-37b6-4895-84b9-5a18e0f7c3d0-config-volume\") pod \"dns-default-wjfnw\" (UID: \"71454413-37b6-4895-84b9-5a18e0f7c3d0\") " pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.229616 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.229475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9426f377-c768-4f39-8c36-c83512910a83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.229616 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.229500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hnzk\" (UniqueName: \"kubernetes.io/projected/71454413-37b6-4895-84b9-5a18e0f7c3d0-kube-api-access-6hnzk\") pod \"dns-default-wjfnw\" (UID: \"71454413-37b6-4895-84b9-5a18e0f7c3d0\") " pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.247101 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.247065    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f54v6"]
Jul 08 06:56:22.247204 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.247158    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f54v6"
Jul 08 06:56:22.249528 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.249507    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 06:56:22.249633 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.249507    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qfqgp\""
Jul 08 06:56:22.249836 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.249819    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 06:56:22.249888 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.249854    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 06:56:22.253717 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.253674    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:22.330745 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.330653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71454413-37b6-4895-84b9-5a18e0f7c3d0-metrics-tls\") pod \"dns-default-wjfnw\" (UID: \"71454413-37b6-4895-84b9-5a18e0f7c3d0\") " pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.330745 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.330688    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9426f377-c768-4f39-8c36-c83512910a83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.330745 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.330710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qth2s\" (UniqueName: \"kubernetes.io/projected/9426f377-c768-4f39-8c36-c83512910a83-kube-api-access-qth2s\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.330745 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.330730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9426f377-c768-4f39-8c36-c83512910a83-data-volume\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.330745 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.330747    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37032234-820e-4ce1-a817-1a89dad327ad-cert\") pod \"ingress-canary-f54v6\" (UID: \"37032234-820e-4ce1-a817-1a89dad327ad\") " pod="openshift-ingress-canary/ingress-canary-f54v6"
Jul 08 06:56:22.331274 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.330764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/71454413-37b6-4895-84b9-5a18e0f7c3d0-config-volume\") pod \"dns-default-wjfnw\" (UID: \"71454413-37b6-4895-84b9-5a18e0f7c3d0\") " pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.331274 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.330785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9426f377-c768-4f39-8c36-c83512910a83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.331274 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.330856    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hnzk\" (UniqueName: \"kubernetes.io/projected/71454413-37b6-4895-84b9-5a18e0f7c3d0-kube-api-access-6hnzk\") pod \"dns-default-wjfnw\" (UID: \"71454413-37b6-4895-84b9-5a18e0f7c3d0\") " pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.331274 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.330930    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmjm2\" (UniqueName: \"kubernetes.io/projected/37032234-820e-4ce1-a817-1a89dad327ad-kube-api-access-vmjm2\") pod \"ingress-canary-f54v6\" (UID: \"37032234-820e-4ce1-a817-1a89dad327ad\") " pod="openshift-ingress-canary/ingress-canary-f54v6"
Jul 08 06:56:22.331274 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.330961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71454413-37b6-4895-84b9-5a18e0f7c3d0-tmp-dir\") pod \"dns-default-wjfnw\" (UID: \"71454413-37b6-4895-84b9-5a18e0f7c3d0\") " pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.331274 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.330993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9426f377-c768-4f39-8c36-c83512910a83-crio-socket\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.331274 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.331184    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9426f377-c768-4f39-8c36-c83512910a83-data-volume\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.331274 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.331215    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9426f377-c768-4f39-8c36-c83512910a83-crio-socket\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.331579 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.331420    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9426f377-c768-4f39-8c36-c83512910a83-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.334725 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.334709    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9426f377-c768-4f39-8c36-c83512910a83-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.339822 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.339799    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qth2s\" (UniqueName: \"kubernetes.io/projected/9426f377-c768-4f39-8c36-c83512910a83-kube-api-access-qth2s\") pod \"insights-runtime-extractor-6rfd8\" (UID: \"9426f377-c768-4f39-8c36-c83512910a83\") " pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.342878 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.342831    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71454413-37b6-4895-84b9-5a18e0f7c3d0-tmp-dir\") pod \"dns-default-wjfnw\" (UID: \"71454413-37b6-4895-84b9-5a18e0f7c3d0\") " pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.343124 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.343100    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/71454413-37b6-4895-84b9-5a18e0f7c3d0-config-volume\") pod \"dns-default-wjfnw\" (UID: \"71454413-37b6-4895-84b9-5a18e0f7c3d0\") " pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.344495 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.344476    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71454413-37b6-4895-84b9-5a18e0f7c3d0-metrics-tls\") pod \"dns-default-wjfnw\" (UID: \"71454413-37b6-4895-84b9-5a18e0f7c3d0\") " pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.344769 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.344750    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hnzk\" (UniqueName: \"kubernetes.io/projected/71454413-37b6-4895-84b9-5a18e0f7c3d0-kube-api-access-6hnzk\") pod \"dns-default-wjfnw\" (UID: \"71454413-37b6-4895-84b9-5a18e0f7c3d0\") " pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.431445 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.431414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmjm2\" (UniqueName: \"kubernetes.io/projected/37032234-820e-4ce1-a817-1a89dad327ad-kube-api-access-vmjm2\") pod \"ingress-canary-f54v6\" (UID: \"37032234-820e-4ce1-a817-1a89dad327ad\") " pod="openshift-ingress-canary/ingress-canary-f54v6"
Jul 08 06:56:22.431619 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.431484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37032234-820e-4ce1-a817-1a89dad327ad-cert\") pod \"ingress-canary-f54v6\" (UID: \"37032234-820e-4ce1-a817-1a89dad327ad\") " pod="openshift-ingress-canary/ingress-canary-f54v6"
Jul 08 06:56:22.433760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.433729    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37032234-820e-4ce1-a817-1a89dad327ad-cert\") pod \"ingress-canary-f54v6\" (UID: \"37032234-820e-4ce1-a817-1a89dad327ad\") " pod="openshift-ingress-canary/ingress-canary-f54v6"
Jul 08 06:56:22.439613 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.439588    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmjm2\" (UniqueName: \"kubernetes.io/projected/37032234-820e-4ce1-a817-1a89dad327ad-kube-api-access-vmjm2\") pod \"ingress-canary-f54v6\" (UID: \"37032234-820e-4ce1-a817-1a89dad327ad\") " pod="openshift-ingress-canary/ingress-canary-f54v6"
Jul 08 06:56:22.448419 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.448389    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:22.468506 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.468480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6rfd8"
Jul 08 06:56:22.555688 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.555653    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f54v6"
Jul 08 06:56:22.649242 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.649213    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6rfd8"]
Jul 08 06:56:22.668280 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.668257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wjfnw"]
Jul 08 06:56:22.671555 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:56:22.671525    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71454413_37b6_4895_84b9_5a18e0f7c3d0.slice/crio-726df6f646c873ba8a64d19e5b8e61bae3580afd1ed0faf2b3eaaa52b20c85de WatchSource:0}: Error finding container 726df6f646c873ba8a64d19e5b8e61bae3580afd1ed0faf2b3eaaa52b20c85de: Status 404 returned error can't find the container with id 726df6f646c873ba8a64d19e5b8e61bae3580afd1ed0faf2b3eaaa52b20c85de
Jul 08 06:56:22.711135 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:22.711109    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f54v6"]
Jul 08 06:56:22.715759 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:56:22.715734    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37032234_820e_4ce1_a817_1a89dad327ad.slice/crio-4e0d880f0a6ae09b3e22327e85b352dd6019c46935616d15159817bd9ad23092 WatchSource:0}: Error finding container 4e0d880f0a6ae09b3e22327e85b352dd6019c46935616d15159817bd9ad23092: Status 404 returned error can't find the container with id 4e0d880f0a6ae09b3e22327e85b352dd6019c46935616d15159817bd9ad23092
Jul 08 06:56:23.030203 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:23.030120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:23.030203 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:23.030154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:23.030203 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:23.030155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:23.034291 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:23.034266    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 06:56:23.034291 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:23.034266    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jfr79\""
Jul 08 06:56:23.034492 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:23.034271    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 06:56:23.034492 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:23.034310    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 06:56:23.034492 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:23.034273    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 06:56:23.034492 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:23.034311    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-97jj5\""
Jul 08 06:56:23.412210 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:23.411980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f54v6" event={"ID":"37032234-820e-4ce1-a817-1a89dad327ad","Type":"ContainerStarted","Data":"4e0d880f0a6ae09b3e22327e85b352dd6019c46935616d15159817bd9ad23092"}
Jul 08 06:56:23.414123 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:23.414021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6rfd8" event={"ID":"9426f377-c768-4f39-8c36-c83512910a83","Type":"ContainerStarted","Data":"3a68043cec776e3484641a3927c0720d38fd81ed33a276a502bc89c91f3f6ae8"}
Jul 08 06:56:23.415483 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:23.415429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wjfnw" event={"ID":"71454413-37b6-4895-84b9-5a18e0f7c3d0","Type":"ContainerStarted","Data":"726df6f646c873ba8a64d19e5b8e61bae3580afd1ed0faf2b3eaaa52b20c85de"}
Jul 08 06:56:25.067340 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:25.067307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:25.169017 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:25.168974    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:25.264166 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:25.264126    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r8mrr"]
Jul 08 06:56:25.276326 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:25.276295    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r8mrr"]
Jul 08 06:56:25.276472 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:25.276411    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r8mrr"
Jul 08 06:56:25.279065 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:25.279012    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 08 06:56:25.279227 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:25.279156    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fbxxm\""
Jul 08 06:56:25.346428 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:25.346391    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:25.358384 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:25.358354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6fce89ee-7b54-4733-81dd-bef30d934a37-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-r8mrr\" (UID: \"6fce89ee-7b54-4733-81dd-bef30d934a37\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r8mrr"
Jul 08 06:56:25.406090 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:25.406045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:25.459183 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:25.459148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6fce89ee-7b54-4733-81dd-bef30d934a37-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-r8mrr\" (UID: \"6fce89ee-7b54-4733-81dd-bef30d934a37\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r8mrr"
Jul 08 06:56:25.461833 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:25.461809    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6fce89ee-7b54-4733-81dd-bef30d934a37-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-r8mrr\" (UID: \"6fce89ee-7b54-4733-81dd-bef30d934a37\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r8mrr"
Jul 08 06:56:25.587038 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:25.586984    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r8mrr"
Jul 08 06:56:26.275714 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:26.275679    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:26.335863 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:26.335830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:28.236151 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:28.235990    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r8mrr"]
Jul 08 06:56:28.243581 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:56:28.243421    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fce89ee_7b54_4733_81dd_bef30d934a37.slice/crio-6751fe440cee0461d2e3223a0fee89deb7d26c7009007b3d172d41469e34c5ca WatchSource:0}: Error finding container 6751fe440cee0461d2e3223a0fee89deb7d26c7009007b3d172d41469e34c5ca: Status 404 returned error can't find the container with id 6751fe440cee0461d2e3223a0fee89deb7d26c7009007b3d172d41469e34c5ca
Jul 08 06:56:28.430466 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:28.430424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f54v6" event={"ID":"37032234-820e-4ce1-a817-1a89dad327ad","Type":"ContainerStarted","Data":"c4ef69dcab1232391cc48aea5acdcd952db0d44399d72748876caece968b7fae"}
Jul 08 06:56:28.432129 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:28.432103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wjfnw" event={"ID":"71454413-37b6-4895-84b9-5a18e0f7c3d0","Type":"ContainerStarted","Data":"7700fcf31023870ea5b43b6b412e1d23d8a286d56fb964aaf9c295c6375684dd"}
Jul 08 06:56:28.432263 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:28.432147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wjfnw" event={"ID":"71454413-37b6-4895-84b9-5a18e0f7c3d0","Type":"ContainerStarted","Data":"ade1f0e4a6289691222d4eb3938453858155dd4bbdf3fb6b2ffccb9855232605"}
Jul 08 06:56:28.432263 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:28.432196    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:28.433377 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:28.433358    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r8mrr" event={"ID":"6fce89ee-7b54-4733-81dd-bef30d934a37","Type":"ContainerStarted","Data":"6751fe440cee0461d2e3223a0fee89deb7d26c7009007b3d172d41469e34c5ca"}
Jul 08 06:56:28.434766 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:28.434744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6rfd8" event={"ID":"9426f377-c768-4f39-8c36-c83512910a83","Type":"ContainerStarted","Data":"5c031d07a9d2267d02ca015a1706bc98f72e8089c067f13541da59b29ee4ce16"}
Jul 08 06:56:28.447448 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:28.447407    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f54v6" podStartSLOduration=1.105205811 podStartE2EDuration="6.447393093s" totalImagesPullingTime="5.342187282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:28.446588909 +0000 UTC m=+59.155872020" watchObservedRunningTime="2026-07-08 06:56:28.447393093 +0000 UTC m=+59.156676200"
Jul 08 06:56:28.464889 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:28.464842    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wjfnw" podStartSLOduration=1.079981748 podStartE2EDuration="6.464826119s" totalImagesPullingTime="5.384844371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:28.464630031 +0000 UTC m=+59.173913143" watchObservedRunningTime="2026-07-08 06:56:28.464826119 +0000 UTC m=+59.174109228"
Jul 08 06:56:29.085351 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:29.085309    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:29.145883 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:29.145851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:29.440396 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:29.440308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6rfd8" event={"ID":"9426f377-c768-4f39-8c36-c83512910a83","Type":"ContainerStarted","Data":"2c156172f2ac406b186ef7145cf1183b58836dfd96329325c166c8c76bcf6b29"}
Jul 08 06:56:30.446837 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:30.446796    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r8mrr" event={"ID":"6fce89ee-7b54-4733-81dd-bef30d934a37","Type":"ContainerStarted","Data":"e08504db198379f448caad08f9582f52dc6a834b08112fbf295c460f465a7126"}
Jul 08 06:56:30.447286 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:30.447014    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r8mrr"
Jul 08 06:56:30.452724 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:30.452697    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r8mrr"
Jul 08 06:56:30.463040 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:30.462984    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r8mrr" podStartSLOduration=4.25125425 podStartE2EDuration="5.462963559s" totalImagesPullingTime="1.211709309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:30.462188792 +0000 UTC m=+61.171471903" watchObservedRunningTime="2026-07-08 06:56:30.462963559 +0000 UTC m=+61.172246673"
Jul 08 06:56:31.284709 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.284676    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:31.322235 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.321031    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"]
Jul 08 06:56:31.323309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.323285    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:31.326009 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.325981    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 08 06:56:31.326123 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.326009    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 06:56:31.327231 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.327208    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 06:56:31.327357 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.327262    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jnskl\""
Jul 08 06:56:31.327357 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.327270    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 06:56:31.327357 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.327219    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 08 06:56:31.334089 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.334055    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"]
Jul 08 06:56:31.353565 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.353533    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:31.408733 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.408649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plpfc\" (UniqueName: \"kubernetes.io/projected/0194b28c-33ad-4efd-811d-4b7510dced70-kube-api-access-plpfc\") pod \"prometheus-operator-567f7b8b7c-q7kb6\" (UID: \"0194b28c-33ad-4efd-811d-4b7510dced70\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:31.408873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.408750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0194b28c-33ad-4efd-811d-4b7510dced70-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-q7kb6\" (UID: \"0194b28c-33ad-4efd-811d-4b7510dced70\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:31.408873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.408777    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0194b28c-33ad-4efd-811d-4b7510dced70-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-q7kb6\" (UID: \"0194b28c-33ad-4efd-811d-4b7510dced70\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:31.408873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.408850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0194b28c-33ad-4efd-811d-4b7510dced70-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-q7kb6\" (UID: \"0194b28c-33ad-4efd-811d-4b7510dced70\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:31.451484 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.451451    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6rfd8" event={"ID":"9426f377-c768-4f39-8c36-c83512910a83","Type":"ContainerStarted","Data":"16bcb4353f2212b6010b6168b48dd56b77a937c71db1e5e73e0e6727b97e6c20"}
Jul 08 06:56:31.468712 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.468658    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6rfd8" podStartSLOduration=1.152637377 podStartE2EDuration="9.468641286s" totalImagesPullingTime="8.316003909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:56:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:31.468437361 +0000 UTC m=+62.177720471" watchObservedRunningTime="2026-07-08 06:56:31.468641286 +0000 UTC m=+62.177924396"
Jul 08 06:56:31.509706 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.509672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0194b28c-33ad-4efd-811d-4b7510dced70-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-q7kb6\" (UID: \"0194b28c-33ad-4efd-811d-4b7510dced70\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:31.509706 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.509712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0194b28c-33ad-4efd-811d-4b7510dced70-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-q7kb6\" (UID: \"0194b28c-33ad-4efd-811d-4b7510dced70\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:31.509929 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.509777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0194b28c-33ad-4efd-811d-4b7510dced70-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-q7kb6\" (UID: \"0194b28c-33ad-4efd-811d-4b7510dced70\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:31.509929 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.509819    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plpfc\" (UniqueName: \"kubernetes.io/projected/0194b28c-33ad-4efd-811d-4b7510dced70-kube-api-access-plpfc\") pod \"prometheus-operator-567f7b8b7c-q7kb6\" (UID: \"0194b28c-33ad-4efd-811d-4b7510dced70\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:31.509929 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:31.509838    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 08 06:56:31.509929 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:31.509920    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0194b28c-33ad-4efd-811d-4b7510dced70-prometheus-operator-tls podName:0194b28c-33ad-4efd-811d-4b7510dced70 nodeName:}" failed. No retries permitted until 2026-07-08 06:56:32.00989984 +0000 UTC m=+62.719182932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0194b28c-33ad-4efd-811d-4b7510dced70-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-q7kb6" (UID: "0194b28c-33ad-4efd-811d-4b7510dced70") : secret "prometheus-operator-tls" not found
Jul 08 06:56:31.510612 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.510591    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0194b28c-33ad-4efd-811d-4b7510dced70-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-q7kb6\" (UID: \"0194b28c-33ad-4efd-811d-4b7510dced70\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:31.512046 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.512025    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0194b28c-33ad-4efd-811d-4b7510dced70-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-q7kb6\" (UID: \"0194b28c-33ad-4efd-811d-4b7510dced70\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:31.518435 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.518415    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plpfc\" (UniqueName: \"kubernetes.io/projected/0194b28c-33ad-4efd-811d-4b7510dced70-kube-api-access-plpfc\") pod \"prometheus-operator-567f7b8b7c-q7kb6\" (UID: \"0194b28c-33ad-4efd-811d-4b7510dced70\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:31.571394 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:31.571350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:32.013615 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:32.013565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0194b28c-33ad-4efd-811d-4b7510dced70-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-q7kb6\" (UID: \"0194b28c-33ad-4efd-811d-4b7510dced70\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:32.015964 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:32.015929    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0194b28c-33ad-4efd-811d-4b7510dced70-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-q7kb6\" (UID: \"0194b28c-33ad-4efd-811d-4b7510dced70\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:32.231590 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:32.231556    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"
Jul 08 06:56:32.307889 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:32.307861    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:32.354464 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:32.354433    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6"]
Jul 08 06:56:32.357866 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:56:32.357838    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0194b28c_33ad_4efd_811d_4b7510dced70.slice/crio-d01975bf9ce2cf06d32df67a53a49eb31aaa85c7b64a7d11a02a8ba446d52dc3 WatchSource:0}: Error finding container d01975bf9ce2cf06d32df67a53a49eb31aaa85c7b64a7d11a02a8ba446d52dc3: Status 404 returned error can't find the container with id d01975bf9ce2cf06d32df67a53a49eb31aaa85c7b64a7d11a02a8ba446d52dc3
Jul 08 06:56:32.362394 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:32.362373    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tst7z"
Jul 08 06:56:32.395063 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:32.395029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:32.455093 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:32.455047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6" event={"ID":"0194b28c-33ad-4efd-811d-4b7510dced70","Type":"ContainerStarted","Data":"d01975bf9ce2cf06d32df67a53a49eb31aaa85c7b64a7d11a02a8ba446d52dc3"}
Jul 08 06:56:32.476802 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:32.476764    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:32.578524 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:32.578492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:33.411219 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:33.411182    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:33.467334 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:33.467303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:34.368535 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:34.368451    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:34.462867 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:34.462829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6" event={"ID":"0194b28c-33ad-4efd-811d-4b7510dced70","Type":"ContainerStarted","Data":"4a7c4b9b37a0ee85e3a79556ec5cb15a999768a5ee3660d292b88fb1d3efdad1"}
Jul 08 06:56:34.463016 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:34.462894    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6" event={"ID":"0194b28c-33ad-4efd-811d-4b7510dced70","Type":"ContainerStarted","Data":"70d0192bdf6e98524e0e2b1a701a2467c44b7ad686af1746b5fe6deed497f45c"}
Jul 08 06:56:34.478139 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:34.478068    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-q7kb6" podStartSLOduration=1.732394299 podStartE2EDuration="3.478051558s" totalImagesPullingTime="1.745657259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:34.477943295 +0000 UTC m=+65.187226404" watchObservedRunningTime="2026-07-08 06:56:34.478051558 +0000 UTC m=+65.187334667"
Jul 08 06:56:35.620124 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.620092    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-w4qwb"]
Jul 08 06:56:35.622023 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.622007    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-w4qwb"
Jul 08 06:56:35.624570 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.624543    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 06:56:35.624690 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.624623    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 06:56:35.624690 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.624651    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8n6gh\""
Jul 08 06:56:35.632626 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.632599    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-w4qwb"]
Jul 08 06:56:35.658497 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.658467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:35.743769 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.743737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:35.743927 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.743779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx2l9\" (UniqueName: \"kubernetes.io/projected/dc36ed28-4405-449c-ae85-008a63a8e555-kube-api-access-fx2l9\") pod \"downloads-685bfb5f64-w4qwb\" (UID: \"dc36ed28-4405-449c-ae85-008a63a8e555\") " pod="openshift-console/downloads-685bfb5f64-w4qwb"
Jul 08 06:56:35.743927 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.743892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs\") pod \"network-metrics-daemon-tjrq6\" (UID: \"472c4a73-2d24-400f-ae39-45695d6af154\") " pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:35.746749 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.746727    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 06:56:35.746991 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.746728    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 06:56:35.756221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.756191    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18f91b3f-47a9-4eb6-8547-eee59181ac7d-original-pull-secret\") pod \"global-pull-secret-syncer-4lm92\" (UID: \"18f91b3f-47a9-4eb6-8547-eee59181ac7d\") " pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:35.756221 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.756212    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472c4a73-2d24-400f-ae39-45695d6af154-metrics-certs\") pod \"network-metrics-daemon-tjrq6\" (UID: \"472c4a73-2d24-400f-ae39-45695d6af154\") " pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:35.761054 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.761024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:35.845156 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.845106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2l9\" (UniqueName: \"kubernetes.io/projected/dc36ed28-4405-449c-ae85-008a63a8e555-kube-api-access-fx2l9\") pod \"downloads-685bfb5f64-w4qwb\" (UID: \"dc36ed28-4405-449c-ae85-008a63a8e555\") " pod="openshift-console/downloads-685bfb5f64-w4qwb"
Jul 08 06:56:35.845156 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.845178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnks5\" (UniqueName: \"kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5\") pod \"network-check-target-5kqw5\" (UID: \"9be122b9-70f7-40c5-a0f2-8e6d43def7f1\") " pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:35.848864 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.848845    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 06:56:35.854622 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.854593    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx2l9\" (UniqueName: \"kubernetes.io/projected/dc36ed28-4405-449c-ae85-008a63a8e555-kube-api-access-fx2l9\") pod \"downloads-685bfb5f64-w4qwb\" (UID: \"dc36ed28-4405-449c-ae85-008a63a8e555\") " pod="openshift-console/downloads-685bfb5f64-w4qwb"
Jul 08 06:56:35.858686 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.858667    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 06:56:35.869405 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.869366    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnks5\" (UniqueName: \"kubernetes.io/projected/9be122b9-70f7-40c5-a0f2-8e6d43def7f1-kube-api-access-pnks5\") pod \"network-check-target-5kqw5\" (UID: \"9be122b9-70f7-40c5-a0f2-8e6d43def7f1\") " pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:35.898873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.898787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:35.930562 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.930527    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-w4qwb"
Jul 08 06:56:35.939591 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.939564    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4lm92"
Jul 08 06:56:35.952355 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.952330    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jfr79\""
Jul 08 06:56:35.955518 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.955498    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-97jj5\""
Jul 08 06:56:35.960484 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.960444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjrq6"
Jul 08 06:56:35.963979 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:35.963928    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:36.002400 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.002199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:36.102774 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.102739    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-w4qwb"]
Jul 08 06:56:36.108869 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:56:36.108838    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc36ed28_4405_449c_ae85_008a63a8e555.slice/crio-f22b100221ef037f03704b420c96ac5ae74bcb35893c4cc5d1075c8d8d87bbac WatchSource:0}: Error finding container f22b100221ef037f03704b420c96ac5ae74bcb35893c4cc5d1075c8d8d87bbac: Status 404 returned error can't find the container with id f22b100221ef037f03704b420c96ac5ae74bcb35893c4cc5d1075c8d8d87bbac
Jul 08 06:56:36.128640 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.128607    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4lm92"]
Jul 08 06:56:36.132025 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:56:36.132003    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f91b3f_47a9_4eb6_8547_eee59181ac7d.slice/crio-43cf3aac1c7699638dad34816314a1a9aaa005499cd8de8a14d2330a5ed55322 WatchSource:0}: Error finding container 43cf3aac1c7699638dad34816314a1a9aaa005499cd8de8a14d2330a5ed55322: Status 404 returned error can't find the container with id 43cf3aac1c7699638dad34816314a1a9aaa005499cd8de8a14d2330a5ed55322
Jul 08 06:56:36.150164 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.150069    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:36.336428 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.336395    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5kqw5"]
Jul 08 06:56:36.339445 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:56:36.339417    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be122b9_70f7_40c5_a0f2_8e6d43def7f1.slice/crio-7ccf75a61ae8fd7e1d01b8d9dafd4eb0c6a9b684e45c83642ed0e77bf8668fa4 WatchSource:0}: Error finding container 7ccf75a61ae8fd7e1d01b8d9dafd4eb0c6a9b684e45c83642ed0e77bf8668fa4: Status 404 returned error can't find the container with id 7ccf75a61ae8fd7e1d01b8d9dafd4eb0c6a9b684e45c83642ed0e77bf8668fa4
Jul 08 06:56:36.339532 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.339512    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tjrq6"]
Jul 08 06:56:36.342445 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:56:36.342417    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472c4a73_2d24_400f_ae39_45695d6af154.slice/crio-e74fc7926513316f98f612cda0307f9bb8da0f030a0d8a7b38bef2b61e1c2c0d WatchSource:0}: Error finding container e74fc7926513316f98f612cda0307f9bb8da0f030a0d8a7b38bef2b61e1c2c0d: Status 404 returned error can't find the container with id e74fc7926513316f98f612cda0307f9bb8da0f030a0d8a7b38bef2b61e1c2c0d
Jul 08 06:56:36.458633 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.458548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:36.469786 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.469722    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5kqw5" event={"ID":"9be122b9-70f7-40c5-a0f2-8e6d43def7f1","Type":"ContainerStarted","Data":"7ccf75a61ae8fd7e1d01b8d9dafd4eb0c6a9b684e45c83642ed0e77bf8668fa4"}
Jul 08 06:56:36.470885 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.470861    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tjrq6" event={"ID":"472c4a73-2d24-400f-ae39-45695d6af154","Type":"ContainerStarted","Data":"e74fc7926513316f98f612cda0307f9bb8da0f030a0d8a7b38bef2b61e1c2c0d"}
Jul 08 06:56:36.471897 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.471874    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4lm92" event={"ID":"18f91b3f-47a9-4eb6-8547-eee59181ac7d","Type":"ContainerStarted","Data":"43cf3aac1c7699638dad34816314a1a9aaa005499cd8de8a14d2330a5ed55322"}
Jul 08 06:56:36.472849 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.472830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-w4qwb" event={"ID":"dc36ed28-4405-449c-ae85-008a63a8e555","Type":"ContainerStarted","Data":"f22b100221ef037f03704b420c96ac5ae74bcb35893c4cc5d1075c8d8d87bbac"}
Jul 08 06:56:36.554310 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.554275    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:36.659459 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.659424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:36.712621 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.712537    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"]
Jul 08 06:56:36.714788 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.714764    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:36.718561 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.718535    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 08 06:56:36.718684 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.718614    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 08 06:56:36.720181 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.720156    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-q4mmq\""
Jul 08 06:56:36.733498 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.733473    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"]
Jul 08 06:56:36.753033 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.752994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/793cdc89-a453-40b2-ba73-05cc8e89e339-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2z42s\" (UID: \"793cdc89-a453-40b2-ba73-05cc8e89e339\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:36.753033 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.753036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/793cdc89-a453-40b2-ba73-05cc8e89e339-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2z42s\" (UID: \"793cdc89-a453-40b2-ba73-05cc8e89e339\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:36.753264 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.753068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x582p\" (UniqueName: \"kubernetes.io/projected/793cdc89-a453-40b2-ba73-05cc8e89e339-kube-api-access-x582p\") pod \"openshift-state-metrics-54cf96dfcf-2z42s\" (UID: \"793cdc89-a453-40b2-ba73-05cc8e89e339\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:36.753264 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.753169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/793cdc89-a453-40b2-ba73-05cc8e89e339-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2z42s\" (UID: \"793cdc89-a453-40b2-ba73-05cc8e89e339\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:36.754052 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.753932    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:36.790217 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.790171    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b26vb"]
Jul 08 06:56:36.792576 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.792554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.795259 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.795234    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 06:56:36.795259 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.795251    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 06:56:36.795597 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.795251    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7bnqw\""
Jul 08 06:56:36.795597 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.795246    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 06:56:36.803740 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.802691    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"]
Jul 08 06:56:36.805201 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.805181    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.808399 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.808121    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 08 06:56:36.808399 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.808230    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lpn6w\""
Jul 08 06:56:36.808399 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.808326    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 08 06:56:36.808620 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.808423    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 08 06:56:36.819772 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.819744    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"]
Jul 08 06:56:36.847419 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.847386    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:36.854588 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.854555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-accelerators-collector-config\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.854747 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.854601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.854747 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.854652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/793cdc89-a453-40b2-ba73-05cc8e89e339-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2z42s\" (UID: \"793cdc89-a453-40b2-ba73-05cc8e89e339\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:36.854747 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.854737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-tls\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.854923 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:36.854750    2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 08 06:56:36.854923 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.854780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.854923 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:36.854809    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/793cdc89-a453-40b2-ba73-05cc8e89e339-openshift-state-metrics-tls podName:793cdc89-a453-40b2-ba73-05cc8e89e339 nodeName:}" failed. No retries permitted until 2026-07-08 06:56:37.354788199 +0000 UTC m=+68.064071293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/793cdc89-a453-40b2-ba73-05cc8e89e339-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-2z42s" (UID: "793cdc89-a453-40b2-ba73-05cc8e89e339") : secret "openshift-state-metrics-tls" not found
Jul 08 06:56:36.854923 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.854850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hd2x\" (UniqueName: \"kubernetes.io/projected/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-api-access-5hd2x\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.854923 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.854878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03126ac0-9fe8-4afd-915f-57462251f622-root\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.854923 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.854903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z5wn\" (UniqueName: \"kubernetes.io/projected/03126ac0-9fe8-4afd-915f-57462251f622-kube-api-access-2z5wn\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.855276 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.854939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x582p\" (UniqueName: \"kubernetes.io/projected/793cdc89-a453-40b2-ba73-05cc8e89e339-kube-api-access-x582p\") pod \"openshift-state-metrics-54cf96dfcf-2z42s\" (UID: \"793cdc89-a453-40b2-ba73-05cc8e89e339\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:36.855276 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.854968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.855276 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.855000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-wtmp\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.855276 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.855037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-textfile\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.855276 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.855069    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.855276 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.855111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02441622-cef7-4d4f-a1e9-34722c1fcb9d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.855276 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.855137    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/02441622-cef7-4d4f-a1e9-34722c1fcb9d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.855276 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.855164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03126ac0-9fe8-4afd-915f-57462251f622-metrics-client-ca\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.855276 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.855188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03126ac0-9fe8-4afd-915f-57462251f622-sys\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.855276 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.855245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/793cdc89-a453-40b2-ba73-05cc8e89e339-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2z42s\" (UID: \"793cdc89-a453-40b2-ba73-05cc8e89e339\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:36.855276 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.855274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/793cdc89-a453-40b2-ba73-05cc8e89e339-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2z42s\" (UID: \"793cdc89-a453-40b2-ba73-05cc8e89e339\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:36.856110 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.856068    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/793cdc89-a453-40b2-ba73-05cc8e89e339-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2z42s\" (UID: \"793cdc89-a453-40b2-ba73-05cc8e89e339\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:36.865708 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.865673    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/793cdc89-a453-40b2-ba73-05cc8e89e339-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2z42s\" (UID: \"793cdc89-a453-40b2-ba73-05cc8e89e339\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:36.873097 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.868907    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x582p\" (UniqueName: \"kubernetes.io/projected/793cdc89-a453-40b2-ba73-05cc8e89e339-kube-api-access-x582p\") pod \"openshift-state-metrics-54cf96dfcf-2z42s\" (UID: \"793cdc89-a453-40b2-ba73-05cc8e89e339\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:36.956482 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-accelerators-collector-config\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.956658 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.956658 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-tls\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.956658 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.956658 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956626    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hd2x\" (UniqueName: \"kubernetes.io/projected/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-api-access-5hd2x\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.956658 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03126ac0-9fe8-4afd-915f-57462251f622-root\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.956925 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z5wn\" (UniqueName: \"kubernetes.io/projected/03126ac0-9fe8-4afd-915f-57462251f622-kube-api-access-2z5wn\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.956925 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.956925 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-wtmp\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.956925 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-textfile\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.956925 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.956925 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02441622-cef7-4d4f-a1e9-34722c1fcb9d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.956925 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/02441622-cef7-4d4f-a1e9-34722c1fcb9d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.956925 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956867    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03126ac0-9fe8-4afd-915f-57462251f622-metrics-client-ca\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.956925 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03126ac0-9fe8-4afd-915f-57462251f622-sys\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.957417 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.956987    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03126ac0-9fe8-4afd-915f-57462251f622-sys\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.957680 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.957654    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-accelerators-collector-config\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.958982 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:36.958245    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 08 06:56:36.958982 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:36.958312    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-tls podName:02441622-cef7-4d4f-a1e9-34722c1fcb9d nodeName:}" failed. No retries permitted until 2026-07-08 06:56:37.458290703 +0000 UTC m=+68.167573799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-vn8kr" (UID: "02441622-cef7-4d4f-a1e9-34722c1fcb9d") : secret "kube-state-metrics-tls" not found
Jul 08 06:56:36.958982 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.958642    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-wtmp\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.958982 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.958901    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-textfile\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.959286 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.959043    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03126ac0-9fe8-4afd-915f-57462251f622-root\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.959286 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:36.959246    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 06:56:36.959390 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:36.959299    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-tls podName:03126ac0-9fe8-4afd-915f-57462251f622 nodeName:}" failed. No retries permitted until 2026-07-08 06:56:37.459281181 +0000 UTC m=+68.168564276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-tls") pod "node-exporter-b26vb" (UID: "03126ac0-9fe8-4afd-915f-57462251f622") : secret "node-exporter-tls" not found
Jul 08 06:56:36.959444 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.959410    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/02441622-cef7-4d4f-a1e9-34722c1fcb9d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.959805 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.959777    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03126ac0-9fe8-4afd-915f-57462251f622-metrics-client-ca\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.960008 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.959935    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.960008 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.959992    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02441622-cef7-4d4f-a1e9-34722c1fcb9d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.963677 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.963587    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:36.964692 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.964667    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.976892 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.976863    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hd2x\" (UniqueName: \"kubernetes.io/projected/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-api-access-5hd2x\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:36.979153 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:36.979127    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z5wn\" (UniqueName: \"kubernetes.io/projected/03126ac0-9fe8-4afd-915f-57462251f622-kube-api-access-2z5wn\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:37.104834 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.104712    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:37.212869 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.212805    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:37.305808 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.305717    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:37.360987 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.360949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/793cdc89-a453-40b2-ba73-05cc8e89e339-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2z42s\" (UID: \"793cdc89-a453-40b2-ba73-05cc8e89e339\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:37.365469 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.365435    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/793cdc89-a453-40b2-ba73-05cc8e89e339-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2z42s\" (UID: \"793cdc89-a453-40b2-ba73-05cc8e89e339\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:37.413914 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.413798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:37.462542 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.461775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-tls\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:37.462542 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.461858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:37.462542 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:37.462018    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 08 06:56:37.462542 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:37.462100    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-tls podName:02441622-cef7-4d4f-a1e9-34722c1fcb9d nodeName:}" failed. No retries permitted until 2026-07-08 06:56:38.46206424 +0000 UTC m=+69.171347328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-vn8kr" (UID: "02441622-cef7-4d4f-a1e9-34722c1fcb9d") : secret "kube-state-metrics-tls" not found
Jul 08 06:56:37.466005 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.465965    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03126ac0-9fe8-4afd-915f-57462251f622-node-exporter-tls\") pod \"node-exporter-b26vb\" (UID: \"03126ac0-9fe8-4afd-915f-57462251f622\") " pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:37.627014 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.626745    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"
Jul 08 06:56:37.681623 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.681549    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:37.707831 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.707643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b26vb"
Jul 08 06:56:37.794013 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.793980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:37.825703 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.825675    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:56:37.828437 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.828406    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:37.833124 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.832500    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kgbgm\""
Jul 08 06:56:37.833124 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.832543    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 08 06:56:37.833124 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.832636    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 08 06:56:37.833124 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.832807    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 08 06:56:37.833124 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.832903    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 08 06:56:37.833124 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.832916    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 08 06:56:37.833124 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.832999    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 08 06:56:37.833610 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.833195    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 08 06:56:37.833610 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.833373    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 08 06:56:37.833610 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.833554    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 08 06:56:37.836154 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.835943    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s"]
Jul 08 06:56:37.853238 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.853215    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:56:37.889583 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.889494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:37.969031 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.968443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:37.969031 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.968498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:37.969031 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.968543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:37.969031 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.968587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:37.969031 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.968617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:37.969031 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.968649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:37.969031 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.968687    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-config-out\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:37.969031 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.968714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:37.969031 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.968739    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:37.969031 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.968773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2dj8\" (UniqueName: \"kubernetes.io/projected/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-kube-api-access-k2dj8\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:37.969031 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.968796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-config-volume\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:37.969031 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.968819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-web-config\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:37.969031 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:37.968845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.071253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.069885    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-config-out\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.071253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.069937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.071253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.069966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.071253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.070002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2dj8\" (UniqueName: \"kubernetes.io/projected/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-kube-api-access-k2dj8\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.071253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.070029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-config-volume\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.071253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.070051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-web-config\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.071253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.070095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.071253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.070150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.071253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.070187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.071253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.070227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.071253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.070273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.071253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.070297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.071253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.070330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.075370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.072830    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.075370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.073945    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.075370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.074285    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.075370 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.074380    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.076293 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.076266    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-web-config\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.077101 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.077024    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.077214 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.077109    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.077555 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.077532    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.077983 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.077923    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.078699 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.078633    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-config-out\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.078699 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.078654    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.079122 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.078901    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:38.083996 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.083513    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-config-volume\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.084767 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.084745    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2dj8\" (UniqueName: \"kubernetes.io/projected/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-kube-api-access-k2dj8\") pod \"alertmanager-main-0\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.152029 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.151946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:56:38.176522 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.176484    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:38.277491 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.277451    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:38.341791 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.341528    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:56:38.346985 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:56:38.346946    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7854bea9_da8d_4bc1_b7f3_9f8b58f26788.slice/crio-10589019c0b22a7dadfd01e220092a4088c652694c9c12967404b890a151ac76 WatchSource:0}: Error finding container 10589019c0b22a7dadfd01e220092a4088c652694c9c12967404b890a151ac76: Status 404 returned error can't find the container with id 10589019c0b22a7dadfd01e220092a4088c652694c9c12967404b890a151ac76
Jul 08 06:56:38.445044 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.443133    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wjfnw"
Jul 08 06:56:38.474350 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.473844    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:38.479241 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.479165    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/02441622-cef7-4d4f-a1e9-34722c1fcb9d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-vn8kr\" (UID: \"02441622-cef7-4d4f-a1e9-34722c1fcb9d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:38.488882 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.488844    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s" event={"ID":"793cdc89-a453-40b2-ba73-05cc8e89e339","Type":"ContainerStarted","Data":"10e592719721d3c0c940e823eafe93db7fe0a37eda4f5f461369b47e0dd7dcb1"}
Jul 08 06:56:38.489023 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.488920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s" event={"ID":"793cdc89-a453-40b2-ba73-05cc8e89e339","Type":"ContainerStarted","Data":"90ae45d608fe732882aa58ed3ba5960f7882f41a9f1dadfdb13af92df952907c"}
Jul 08 06:56:38.489023 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.488952    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s" event={"ID":"793cdc89-a453-40b2-ba73-05cc8e89e339","Type":"ContainerStarted","Data":"726fd6d3fc31eed1e8bf31930f9f020e32fbe70e87ef8815c56e58f2cb7a4a18"}
Jul 08 06:56:38.494471 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.494337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerStarted","Data":"10589019c0b22a7dadfd01e220092a4088c652694c9c12967404b890a151ac76"}
Jul 08 06:56:38.497990 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.497713    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tjrq6" event={"ID":"472c4a73-2d24-400f-ae39-45695d6af154","Type":"ContainerStarted","Data":"313ac1b19fd5625df2c60f0014c35ab8426730666d6df0f62e2a6398717f3bbf"}
Jul 08 06:56:38.497990 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.497771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tjrq6" event={"ID":"472c4a73-2d24-400f-ae39-45695d6af154","Type":"ContainerStarted","Data":"ed757ce5932974bfd57dc9dd1170fed9e9e35cfd082cff3650ecbda60b4660b3"}
Jul 08 06:56:38.500117 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.500021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b26vb" event={"ID":"03126ac0-9fe8-4afd-915f-57462251f622","Type":"ContainerStarted","Data":"ead6851d6266cc67e4467fd7324f916be625d6b86797e7c0225a4b0228036665"}
Jul 08 06:56:38.618440 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.618140    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"
Jul 08 06:56:38.649291 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.649203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:38.751332 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.751299    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:38.804564 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.804365    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tjrq6" podStartSLOduration=66.455196639 podStartE2EDuration="1m7.804340599s" totalImagesPullingTime="1.34914396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:38.514729328 +0000 UTC m=+69.224012439" watchObservedRunningTime="2026-07-08 06:56:38.804340599 +0000 UTC m=+69.513623710"
Jul 08 06:56:38.806039 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:38.805952    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr"]
Jul 08 06:56:38.810006 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:56:38.809975    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02441622_cef7_4d4f_a1e9_34722c1fcb9d.slice/crio-a7a132552c6349d1460bfec8a52a61570c5852c11a4dec4ce81758d2cff78eac WatchSource:0}: Error finding container a7a132552c6349d1460bfec8a52a61570c5852c11a4dec4ce81758d2cff78eac: Status 404 returned error can't find the container with id a7a132552c6349d1460bfec8a52a61570c5852c11a4dec4ce81758d2cff78eac
Jul 08 06:56:39.326068 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.325986    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:39.428609 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.428567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:39.507734 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.507699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr" event={"ID":"02441622-cef7-4d4f-a1e9-34722c1fcb9d","Type":"ContainerStarted","Data":"a7a132552c6349d1460bfec8a52a61570c5852c11a4dec4ce81758d2cff78eac"}
Jul 08 06:56:39.679781 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.679704    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:39.782752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.782632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:39.811220 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.811186    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7c598fb456-gf2gp"]
Jul 08 06:56:39.845889 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.845834    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c598fb456-gf2gp"]
Jul 08 06:56:39.846151 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.846037    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:39.849315 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.849285    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 08 06:56:39.849548 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.849527    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 08 06:56:39.849863 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.849740    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 08 06:56:39.849954 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.849883    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 08 06:56:39.849954 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.849924    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 08 06:56:39.850060 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.849948    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-526lt\""
Jul 08 06:56:39.850060 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.849954    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4oi91sm3q1cp9\""
Jul 08 06:56:39.873597 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.873561    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:39.988989 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.988896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:39.988989 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.988952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20c1a4c0-ded2-47ab-bb43-64e4a145de60-metrics-client-ca\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:39.989232 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.989007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-grpc-tls\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:39.989232 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.989067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-tls\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:39.989232 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.989132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:39.989232 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.989168    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:39.989232 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.989203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:39.989232 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:39.989228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9kg2\" (UniqueName: \"kubernetes.io/projected/20c1a4c0-ded2-47ab-bb43-64e4a145de60-kube-api-access-z9kg2\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.090439 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.090400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-grpc-tls\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.090633 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.090462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-tls\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.090633 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.090500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.090633 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.090533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.090633 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.090567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.090633 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.090592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9kg2\" (UniqueName: \"kubernetes.io/projected/20c1a4c0-ded2-47ab-bb43-64e4a145de60-kube-api-access-z9kg2\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.090874 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.090645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.090874 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.090676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20c1a4c0-ded2-47ab-bb43-64e4a145de60-metrics-client-ca\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.092317 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.092285    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20c1a4c0-ded2-47ab-bb43-64e4a145de60-metrics-client-ca\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.094986 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.094957    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.095127 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.095050    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-grpc-tls\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.095633 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.095611    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-tls\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.095734 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.095712    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.096321 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.096276    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.098345 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.098301    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20c1a4c0-ded2-47ab-bb43-64e4a145de60-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.105715 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.105666    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9kg2\" (UniqueName: \"kubernetes.io/projected/20c1a4c0-ded2-47ab-bb43-64e4a145de60-kube-api-access-z9kg2\") pod \"thanos-querier-7c598fb456-gf2gp\" (UID: \"20c1a4c0-ded2-47ab-bb43-64e4a145de60\") " pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:40.159480 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:40.159390    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:56:41.166035 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.166000    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b9f9469c9-xr26j"]
Jul 08 06:56:41.191863 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.191828    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.195597 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.195536    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b9f9469c9-xr26j"]
Jul 08 06:56:41.196783 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.196559    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-blfn5\""
Jul 08 06:56:41.196783 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.196577    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c5ipgs19mcno4\""
Jul 08 06:56:41.196783 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.196629    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 06:56:41.196783 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.196689    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 08 06:56:41.196783 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.196628    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 08 06:56:41.197137 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.196854    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 08 06:56:41.300640 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.300600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/13cfcbf1-1633-41ad-970f-31c820ee84aa-secret-metrics-server-client-certs\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.300640 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.300644    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc7lj\" (UniqueName: \"kubernetes.io/projected/13cfcbf1-1633-41ad-970f-31c820ee84aa-kube-api-access-kc7lj\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.300894 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.300668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/13cfcbf1-1633-41ad-970f-31c820ee84aa-secret-metrics-server-tls\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.300894 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.300774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13cfcbf1-1633-41ad-970f-31c820ee84aa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.300894 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.300859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/13cfcbf1-1633-41ad-970f-31c820ee84aa-audit-log\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.300894 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.300891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/13cfcbf1-1633-41ad-970f-31c820ee84aa-metrics-server-audit-profiles\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.301114 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.300915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13cfcbf1-1633-41ad-970f-31c820ee84aa-client-ca-bundle\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.334552 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.334458    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79cbd5d877-l7sqt"]
Jul 08 06:56:41.339328 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.339298    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.342178 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.342150    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 06:56:41.342316 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.342189    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 06:56:41.342316 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.342235    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 06:56:41.342431 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.342316    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qtmnv\""
Jul 08 06:56:41.342478 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.342457    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 06:56:41.342584 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.342555    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 06:56:41.348760 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.348492    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cbd5d877-l7sqt"]
Jul 08 06:56:41.400790 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.400743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:41.401978 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.401940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-oauth-serving-cert\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.402156 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.401999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-service-ca\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.402156 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.402039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/13cfcbf1-1633-41ad-970f-31c820ee84aa-secret-metrics-server-client-certs\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.402156 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.402056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc7lj\" (UniqueName: \"kubernetes.io/projected/13cfcbf1-1633-41ad-970f-31c820ee84aa-kube-api-access-kc7lj\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.402156 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.402096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/13cfcbf1-1633-41ad-970f-31c820ee84aa-secret-metrics-server-tls\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.402156 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.402121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c261806-af72-4f99-875a-cd505a47b069-console-oauth-config\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.402156 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.402149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13cfcbf1-1633-41ad-970f-31c820ee84aa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.402483 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.402188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqb8q\" (UniqueName: \"kubernetes.io/projected/5c261806-af72-4f99-875a-cd505a47b069-kube-api-access-hqb8q\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.402483 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.402227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/13cfcbf1-1633-41ad-970f-31c820ee84aa-audit-log\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.402483 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.402251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/13cfcbf1-1633-41ad-970f-31c820ee84aa-metrics-server-audit-profiles\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.402483 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.402274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13cfcbf1-1633-41ad-970f-31c820ee84aa-client-ca-bundle\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.402483 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.402305    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c261806-af72-4f99-875a-cd505a47b069-console-serving-cert\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.402483 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.402328    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-console-config\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.403285 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.403235    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/13cfcbf1-1633-41ad-970f-31c820ee84aa-audit-log\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.403792 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.403718    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13cfcbf1-1633-41ad-970f-31c820ee84aa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.403931 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.403803    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/13cfcbf1-1633-41ad-970f-31c820ee84aa-metrics-server-audit-profiles\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.405815 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.405788    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/13cfcbf1-1633-41ad-970f-31c820ee84aa-secret-metrics-server-tls\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.405909 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.405847    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13cfcbf1-1633-41ad-970f-31c820ee84aa-client-ca-bundle\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.405909 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.405854    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/13cfcbf1-1633-41ad-970f-31c820ee84aa-secret-metrics-server-client-certs\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.413256 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.413208    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc7lj\" (UniqueName: \"kubernetes.io/projected/13cfcbf1-1633-41ad-970f-31c820ee84aa-kube-api-access-kc7lj\") pod \"metrics-server-7b9f9469c9-xr26j\" (UID: \"13cfcbf1-1633-41ad-970f-31c820ee84aa\") " pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.466184 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.466149    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"]
Jul 08 06:56:41.468734 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.468707    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"
Jul 08 06:56:41.471234 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.471211    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 08 06:56:41.471356 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.471238    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6zcx5\""
Jul 08 06:56:41.479970 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.479932    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"]
Jul 08 06:56:41.490640 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.490603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:41.503676 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.503584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-console-config\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.503820 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.503695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-oauth-serving-cert\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.503820 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.503740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-service-ca\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.503820 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.503799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c261806-af72-4f99-875a-cd505a47b069-console-oauth-config\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.504045 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.503841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqb8q\" (UniqueName: \"kubernetes.io/projected/5c261806-af72-4f99-875a-cd505a47b069-kube-api-access-hqb8q\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.504045 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.503889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c261806-af72-4f99-875a-cd505a47b069-console-serving-cert\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.504572 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.504513    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-oauth-serving-cert\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.504892 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.504834    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-service-ca\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.505234 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.505213    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-console-config\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.505802 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.505763    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:56:41.507615 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.507586    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c261806-af72-4f99-875a-cd505a47b069-console-serving-cert\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.508777 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.508757    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c261806-af72-4f99-875a-cd505a47b069-console-oauth-config\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.512696 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.512676    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqb8q\" (UniqueName: \"kubernetes.io/projected/5c261806-af72-4f99-875a-cd505a47b069-kube-api-access-hqb8q\") pod \"console-79cbd5d877-l7sqt\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") " pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.604999 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.604958    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpc9h\" (UniqueName: \"kubernetes.io/projected/94e0ff2d-3bce-48dc-b4d5-f6911542095a-kube-api-access-jpc9h\") pod \"monitoring-plugin-d5dcff7cf-brk6c\" (UID: \"94e0ff2d-3bce-48dc-b4d5-f6911542095a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"
Jul 08 06:56:41.605170 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.605028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/94e0ff2d-3bce-48dc-b4d5-f6911542095a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-brk6c\" (UID: \"94e0ff2d-3bce-48dc-b4d5-f6911542095a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"
Jul 08 06:56:41.652948 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.652902    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:56:41.706665 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.706576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/94e0ff2d-3bce-48dc-b4d5-f6911542095a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-brk6c\" (UID: \"94e0ff2d-3bce-48dc-b4d5-f6911542095a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"
Jul 08 06:56:41.706825 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.706714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpc9h\" (UniqueName: \"kubernetes.io/projected/94e0ff2d-3bce-48dc-b4d5-f6911542095a-kube-api-access-jpc9h\") pod \"monitoring-plugin-d5dcff7cf-brk6c\" (UID: \"94e0ff2d-3bce-48dc-b4d5-f6911542095a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"
Jul 08 06:56:41.706825 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:41.706737    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 08 06:56:41.706825 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:56:41.706814    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94e0ff2d-3bce-48dc-b4d5-f6911542095a-monitoring-plugin-cert podName:94e0ff2d-3bce-48dc-b4d5-f6911542095a nodeName:}" failed. No retries permitted until 2026-07-08 06:56:42.206790209 +0000 UTC m=+72.916073308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/94e0ff2d-3bce-48dc-b4d5-f6911542095a-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-brk6c" (UID: "94e0ff2d-3bce-48dc-b4d5-f6911542095a") : secret "monitoring-plugin-cert" not found
Jul 08 06:56:41.716136 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.716106    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpc9h\" (UniqueName: \"kubernetes.io/projected/94e0ff2d-3bce-48dc-b4d5-f6911542095a-kube-api-access-jpc9h\") pod \"monitoring-plugin-d5dcff7cf-brk6c\" (UID: \"94e0ff2d-3bce-48dc-b4d5-f6911542095a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"
Jul 08 06:56:41.763237 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:41.763197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:42.211437 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:42.211394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/94e0ff2d-3bce-48dc-b4d5-f6911542095a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-brk6c\" (UID: \"94e0ff2d-3bce-48dc-b4d5-f6911542095a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"
Jul 08 06:56:42.214412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:42.214383    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/94e0ff2d-3bce-48dc-b4d5-f6911542095a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-brk6c\" (UID: \"94e0ff2d-3bce-48dc-b4d5-f6911542095a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"
Jul 08 06:56:42.381270 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:42.381231    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"
Jul 08 06:56:42.991470 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:42.991404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:42.994563 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:42.994006    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:56:42.997280 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:42.997257    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.002641 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.001286    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 06:56:43.002641 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.001488    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-la8bgkk8qfkj\""
Jul 08 06:56:43.002641 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.001545    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 06:56:43.002641 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.001725    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 06:56:43.002641 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.001749    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 06:56:43.003100 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.003048    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 06:56:43.004105 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.003416    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 06:56:43.004105 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.003641    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 06:56:43.004105 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.003831    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 06:56:43.004105 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.004042    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 06:56:43.004105 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.004055    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vs4lg\""
Jul 08 06:56:43.005852 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.005108    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 06:56:43.005852 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.005430    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 06:56:43.009658 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.006299    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 06:56:43.009658 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.006623    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 06:56:43.009658 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.009468    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 06:56:43.013410 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.013387    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:56:43.119630 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.119592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.119831 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.119643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.119831 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.119683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b454da6d-4254-4c43-832c-2face0cac2da-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.119831 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.119707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.119831 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.119738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.119831 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.119761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.119831 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.119812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.120157 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.119856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.120157 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.119874    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-web-config\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.120157 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.119905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.120157 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.119942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b454da6d-4254-4c43-832c-2face0cac2da-config-out\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.120157 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.119966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-config\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.120157 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.119989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4mj9\" (UniqueName: \"kubernetes.io/projected/b454da6d-4254-4c43-832c-2face0cac2da-kube-api-access-v4mj9\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.120157 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.120030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.120157 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.120055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.120157 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.120103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.120157 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.120127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.120157 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.120154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.120642 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.120191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.120642 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.120242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221054 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221054 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221560 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221560 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221560 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221560 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221560 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221560 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221560 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221560 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b454da6d-4254-4c43-832c-2face0cac2da-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221940 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221940 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221940 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221940 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221940 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221940 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-web-config\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221940 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221940 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b454da6d-4254-4c43-832c-2face0cac2da-config-out\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221940 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-config\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.221940 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.221850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4mj9\" (UniqueName: \"kubernetes.io/projected/b454da6d-4254-4c43-832c-2face0cac2da-kube-api-access-v4mj9\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.222410 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.222316    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.222906 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.222557    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.222906 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.222674    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.222906 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.222717    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.223154 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.222983    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.226768 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.226198    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.226768 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.226471    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.227734 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.227102    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.227734 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.227391    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.227734 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.227590    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.230854 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.230809    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b454da6d-4254-4c43-832c-2face0cac2da-config-out\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.231533 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.231489    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b454da6d-4254-4c43-832c-2face0cac2da-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.232101 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.232046    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-web-config\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.232601 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.232561    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.232765 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.232713    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.233249 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.233199    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-config\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.233249 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.233228    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.233390 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.233285    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.235536 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.235492    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4mj9\" (UniqueName: \"kubernetes.io/projected/b454da6d-4254-4c43-832c-2face0cac2da-kube-api-access-v4mj9\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.235869 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.235786    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.317229 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.317174    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:56:43.977333 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.973694    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c598fb456-gf2gp"]
Jul 08 06:56:43.988647 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:43.986327    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b9f9469c9-xr26j"]
Jul 08 06:56:44.014522 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:56:44.014477    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13cfcbf1_1633_41ad_970f_31c820ee84aa.slice/crio-7933bedeaeeda49b9349576ffcf70a040b9993899ccf810996d05be30150b828 WatchSource:0}: Error finding container 7933bedeaeeda49b9349576ffcf70a040b9993899ccf810996d05be30150b828: Status 404 returned error can't find the container with id 7933bedeaeeda49b9349576ffcf70a040b9993899ccf810996d05be30150b828
Jul 08 06:56:44.022812 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.019970    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"]
Jul 08 06:56:44.048522 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.048491    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cbd5d877-l7sqt"]
Jul 08 06:56:44.060424 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:56:44.060326    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e0ff2d_3bce_48dc_b4d5_f6911542095a.slice/crio-995e7998fed23de9618fd369a3d2cc9ef1580fd703a5ae4b4f3997f81ca024cf WatchSource:0}: Error finding container 995e7998fed23de9618fd369a3d2cc9ef1580fd703a5ae4b4f3997f81ca024cf: Status 404 returned error can't find the container with id 995e7998fed23de9618fd369a3d2cc9ef1580fd703a5ae4b4f3997f81ca024cf
Jul 08 06:56:44.069527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.067706    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:56:44.129255 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:56:44.129092    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb454da6d_4254_4c43_832c_2face0cac2da.slice/crio-b9a710c42d7a28ec80e838af5406899481c1015e84a1849e4261a18d72b78642 WatchSource:0}: Error finding container b9a710c42d7a28ec80e838af5406899481c1015e84a1849e4261a18d72b78642: Status 404 returned error can't find the container with id b9a710c42d7a28ec80e838af5406899481c1015e84a1849e4261a18d72b78642
Jul 08 06:56:44.411677 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.411643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:44.468417 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.468320    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:44.533494 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.533460    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp" event={"ID":"20c1a4c0-ded2-47ab-bb43-64e4a145de60","Type":"ContainerStarted","Data":"ad8d69e5eacf5171399982bab3bb96a8b844bd493091b57bbc17d35b677f9252"}
Jul 08 06:56:44.535677 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.535394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4lm92" event={"ID":"18f91b3f-47a9-4eb6-8547-eee59181ac7d","Type":"ContainerStarted","Data":"450cd1478921140643fd19e4b6c57fbbdfa44dc36cf7271950add8220837a1bc"}
Jul 08 06:56:44.538039 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.537871    2565 generic.go:356] "Generic (PLEG): container finished" podID="b454da6d-4254-4c43-832c-2face0cac2da" containerID="04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f" exitCode=0
Jul 08 06:56:44.538039 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.537970    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerDied","Data":"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"}
Jul 08 06:56:44.538039 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.538032    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerStarted","Data":"b9a710c42d7a28ec80e838af5406899481c1015e84a1849e4261a18d72b78642"}
Jul 08 06:56:44.540458 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.540168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j" event={"ID":"13cfcbf1-1633-41ad-970f-31c820ee84aa","Type":"ContainerStarted","Data":"7933bedeaeeda49b9349576ffcf70a040b9993899ccf810996d05be30150b828"}
Jul 08 06:56:44.542091 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.542027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c" event={"ID":"94e0ff2d-3bce-48dc-b4d5-f6911542095a","Type":"ContainerStarted","Data":"995e7998fed23de9618fd369a3d2cc9ef1580fd703a5ae4b4f3997f81ca024cf"}
Jul 08 06:56:44.544756 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.543981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5kqw5" event={"ID":"9be122b9-70f7-40c5-a0f2-8e6d43def7f1","Type":"ContainerStarted","Data":"34f038c9ec1472c468c44f9b83ae1499bedb57497490ecfd975cb25976573791"}
Jul 08 06:56:44.544756 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.544707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:56:44.547265 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.547164    2565 generic.go:356] "Generic (PLEG): container finished" podID="03126ac0-9fe8-4afd-915f-57462251f622" containerID="7c06fad53c39a03205df0de348747d2d9c4f754ec111284404b9ef4806259e9b" exitCode=0
Jul 08 06:56:44.547265 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.547234    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b26vb" event={"ID":"03126ac0-9fe8-4afd-915f-57462251f622","Type":"ContainerDied","Data":"7c06fad53c39a03205df0de348747d2d9c4f754ec111284404b9ef4806259e9b"}
Jul 08 06:56:44.551607 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.550741    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s" event={"ID":"793cdc89-a453-40b2-ba73-05cc8e89e339","Type":"ContainerStarted","Data":"bedc0d61a2d5f88d5309a74c0d0120b75ad6630059cbeb4c02b8822964f53b41"}
Jul 08 06:56:44.561510 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.561468    2565 generic.go:356] "Generic (PLEG): container finished" podID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerID="2572ca99cce9d36b9afbb4ce7958147d29ef761e048d61d7b20c4520ca433ff7" exitCode=0
Jul 08 06:56:44.561779 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.561748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerDied","Data":"2572ca99cce9d36b9afbb4ce7958147d29ef761e048d61d7b20c4520ca433ff7"}
Jul 08 06:56:44.570142 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.570100    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr" event={"ID":"02441622-cef7-4d4f-a1e9-34722c1fcb9d","Type":"ContainerStarted","Data":"701e6c9c6d3a4efc8f8ec805938b63a423d57ce5e393c02a7e4408e016f01816"}
Jul 08 06:56:44.570245 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.570181    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr" event={"ID":"02441622-cef7-4d4f-a1e9-34722c1fcb9d","Type":"ContainerStarted","Data":"699503358c7468e6d03800d93d6a3bf8cb9f53695fb21c10d8967ee22496d3d7"}
Jul 08 06:56:44.570245 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.570213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr" event={"ID":"02441622-cef7-4d4f-a1e9-34722c1fcb9d","Type":"ContainerStarted","Data":"da29b3de5146eca8d68fb553c286517d708c281f2186c6403678fcb644f6711e"}
Jul 08 06:56:44.572969 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.572944    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cbd5d877-l7sqt" event={"ID":"5c261806-af72-4f99-875a-cd505a47b069","Type":"ContainerStarted","Data":"cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c"}
Jul 08 06:56:44.585184 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.584919    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4lm92" podStartSLOduration=64.996603301 podStartE2EDuration="1m12.584896319s" totalImagesPullingTime="7.588293018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 06:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:44.55625948 +0000 UTC m=+75.265542605" watchObservedRunningTime="2026-07-08 06:56:44.584896319 +0000 UTC m=+75.294179430"
Jul 08 06:56:44.632416 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.632362    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5kqw5" podStartSLOduration=66.259458571 podStartE2EDuration="1m13.632340951s" totalImagesPullingTime="7.37288238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:44.631236807 +0000 UTC m=+75.340519917" watchObservedRunningTime="2026-07-08 06:56:44.632340951 +0000 UTC m=+75.341624062"
Jul 08 06:56:44.652155 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.650513    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2z42s" podStartSLOduration=2.962257636 podStartE2EDuration="8.650492151s" totalImagesPullingTime="5.688234515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:44.647995369 +0000 UTC m=+75.357278490" watchObservedRunningTime="2026-07-08 06:56:44.650492151 +0000 UTC m=+75.359775265"
Jul 08 06:56:44.698893 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:44.696780    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vn8kr" podStartSLOduration=3.677347798 podStartE2EDuration="8.69675884s" totalImagesPullingTime="5.019411042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:44.671115419 +0000 UTC m=+75.380398529" watchObservedRunningTime="2026-07-08 06:56:44.69675884 +0000 UTC m=+75.406041952"
Jul 08 06:56:45.588814 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:45.588709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b26vb" event={"ID":"03126ac0-9fe8-4afd-915f-57462251f622","Type":"ContainerStarted","Data":"af2c3e4ebe3859e5a59aa049ee09f9a298dbc25161cc8571cde16e3a8bf7bd2f"}
Jul 08 06:56:45.588814 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:45.588773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b26vb" event={"ID":"03126ac0-9fe8-4afd-915f-57462251f622","Type":"ContainerStarted","Data":"a9bfb72fbd3fa0430deb80f1279e315d1b5a531e9c8f758ac9e88eda5eaf3de1"}
Jul 08 06:56:45.611285 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:45.610277    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b26vb" podStartSLOduration=3.948006716 podStartE2EDuration="9.610256638s" totalImagesPullingTime="5.561857209s" totalInitContainerRuntime="100.392713ms" isStatefulPod=true podCreationTimestamp="2026-07-08 06:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:45.608402606 +0000 UTC m=+76.317685729" watchObservedRunningTime="2026-07-08 06:56:45.610256638 +0000 UTC m=+76.319539750"
Jul 08 06:56:46.133744 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:46.133673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:46.200344 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:46.200227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:47.568402 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:47.568362    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:47.627747 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:47.627703    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:48.936053 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:48.936017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:54.118032 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:54.117901    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:54.176061 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:54.176011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:58.532608 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.532566    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:58.598277 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.598238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:58.655932 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.655665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp" event={"ID":"20c1a4c0-ded2-47ab-bb43-64e4a145de60","Type":"ContainerStarted","Data":"a2e9edb0f7bf5c472b0ebc1355d3632edfcadb6b4cb1de3c207bbad5b92093ec"}
Jul 08 06:56:58.655932 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.655761    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp" event={"ID":"20c1a4c0-ded2-47ab-bb43-64e4a145de60","Type":"ContainerStarted","Data":"1c0977eccbc1b1d9dfd2feb9b39bdbaa6a347644fab1eb94cc574c6ce4f5fe4d"}
Jul 08 06:56:58.655932 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.655807    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp" event={"ID":"20c1a4c0-ded2-47ab-bb43-64e4a145de60","Type":"ContainerStarted","Data":"1232c4d24c85810706bc1cbe583fb381164c8cb849c24e7cb9bf268c5b4ed9ca"}
Jul 08 06:56:58.665308 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.665272    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerStarted","Data":"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"}
Jul 08 06:56:58.665620 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.665596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerStarted","Data":"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"}
Jul 08 06:56:58.666376 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.666353    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerStarted","Data":"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"}
Jul 08 06:56:58.666903 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.666882    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerStarted","Data":"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"}
Jul 08 06:56:58.667105 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.667086    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerStarted","Data":"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"}
Jul 08 06:56:58.667453 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.667433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerStarted","Data":"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"}
Jul 08 06:56:58.667635 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.667608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-w4qwb" event={"ID":"dc36ed28-4405-449c-ae85-008a63a8e555","Type":"ContainerStarted","Data":"73b6b8a6b8ea82c3f7f95bf5e0261d0f9f68ac9f6f7a2f58295498aa0ce7e0d0"}
Jul 08 06:56:58.668854 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.668601    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-w4qwb"
Jul 08 06:56:58.670795 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.670773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j" event={"ID":"13cfcbf1-1633-41ad-970f-31c820ee84aa","Type":"ContainerStarted","Data":"9392c89fdbb9223efa3700cfc49ab377f6591ad082a9d418b605b9d08a2fc705"}
Jul 08 06:56:58.672734 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.672711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c" event={"ID":"94e0ff2d-3bce-48dc-b4d5-f6911542095a","Type":"ContainerStarted","Data":"7d9bf32c2e20f1621036bd52e0f834b788c0df41a7f557e93ad9f7c2ca37c2d0"}
Jul 08 06:56:58.673407 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.673238    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"
Jul 08 06:56:58.684202 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.684176    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c"
Jul 08 06:56:58.685161 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.685143    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-w4qwb"
Jul 08 06:56:58.689396 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.689368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerStarted","Data":"4d233a89bca6259004848e732276c18ebe9c6ba9e0266447059c6ef157f2ec39"}
Jul 08 06:56:58.689594 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.689575    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerStarted","Data":"7d01f8855e3d9ae2226e3fc843c7d97d5f57dbaddc09c74410ea20121ed66b54"}
Jul 08 06:56:58.689755 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.689740    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerStarted","Data":"333bf3db2f1678f66ba5fa1057fb8360b97b3569b0ae2f401648042c04d8c881"}
Jul 08 06:56:58.689883 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.689869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerStarted","Data":"d807bffd0603a54358f768918248976f7d909ccd32b3cbd98bbfcc94f13730e0"}
Jul 08 06:56:58.689999 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.689985    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerStarted","Data":"6b91a786bf23bed675628999a805f5b3cc355ff1a3f189354e55383c994dc984"}
Jul 08 06:56:58.694679 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.694653    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cbd5d877-l7sqt" event={"ID":"5c261806-af72-4f99-875a-cd505a47b069","Type":"ContainerStarted","Data":"03f14605283771b6094b7fa7c7ee1981b0ce284b4ae14eeb8e879e27d23a68dc"}
Jul 08 06:56:58.702528 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.702484    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.554203763 podStartE2EDuration="16.702470565s" totalImagesPullingTime="13.108007643s" totalInitContainerRuntime="40.259159ms" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:58.699536248 +0000 UTC m=+89.408819357" watchObservedRunningTime="2026-07-08 06:56:58.702470565 +0000 UTC m=+89.411753675"
Jul 08 06:56:58.723765 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.723614    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j" podStartSLOduration=4.101709023 podStartE2EDuration="17.723592104s" totalImagesPullingTime="13.621883081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:58.721124697 +0000 UTC m=+89.430407808" watchObservedRunningTime="2026-07-08 06:56:58.723592104 +0000 UTC m=+89.432875216"
Jul 08 06:56:58.733364 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.733327    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:56:58.745355 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.745292    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-w4qwb" podStartSLOduration=1.8920301099999999 podStartE2EDuration="23.745276605s" totalImagesPullingTime="21.853246495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:58.744578548 +0000 UTC m=+89.453861671" watchObservedRunningTime="2026-07-08 06:56:58.745276605 +0000 UTC m=+89.454559714"
Jul 08 06:56:58.767739 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.767682    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79cbd5d877-l7sqt" podStartSLOduration=4.1933483 podStartE2EDuration="17.767660835s" totalImagesPullingTime="13.574312535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:58.76401776 +0000 UTC m=+89.473300884" watchObservedRunningTime="2026-07-08 06:56:58.767660835 +0000 UTC m=+89.476943946"
Jul 08 06:56:58.787907 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.787809    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-brk6c" podStartSLOduration=11.389969249 podStartE2EDuration="17.787786312s" totalImagesPullingTime="6.397817063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:56:58.786044274 +0000 UTC m=+89.495327386" watchObservedRunningTime="2026-07-08 06:56:58.787786312 +0000 UTC m=+89.497069424"
Jul 08 06:56:58.834104 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:56:58.834046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:00.150040 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:00.150002    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:00.215698 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:00.215657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:00.713219 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:00.713177    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerStarted","Data":"547953d5af67a6797c5f25cc1895179163fa5a18f11b8eccd4750088e5f4ad78"}
Jul 08 06:57:00.717390 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:00.717349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp" event={"ID":"20c1a4c0-ded2-47ab-bb43-64e4a145de60","Type":"ContainerStarted","Data":"e9062d6ec147beb8b84399bc880778b5d3b453a06ffa0274eb042c79d8a15d7d"}
Jul 08 06:57:00.717567 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:00.717418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp" event={"ID":"20c1a4c0-ded2-47ab-bb43-64e4a145de60","Type":"ContainerStarted","Data":"dcaaa67f532bafad87ba514416da63ccced0f3f6418058c5c388c582a57706b3"}
Jul 08 06:57:00.717567 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:00.717459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp" event={"ID":"20c1a4c0-ded2-47ab-bb43-64e4a145de60","Type":"ContainerStarted","Data":"0e4dbf14eefc896a0955f92dc033959d0b6acd6911ca6b4413546d9e0adda24e"}
Jul 08 06:57:00.745045 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:00.744973    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.087050946 podStartE2EDuration="23.74494961s" totalImagesPullingTime="19.622353174s" totalInitContainerRuntime="35.54549ms" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:57:00.742487261 +0000 UTC m=+91.451770371" watchObservedRunningTime="2026-07-08 06:57:00.74494961 +0000 UTC m=+91.454232721"
Jul 08 06:57:01.506571 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:01.506530    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:57:01.507054 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:01.506613    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:57:01.653442 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:01.653403    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:57:01.653640 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:01.653569    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:57:01.659067 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:01.659043    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:57:01.677522 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:01.677470    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp" podStartSLOduration=7.601969814 podStartE2EDuration="22.677453907s" totalImagesPullingTime="15.075484093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:56:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:57:00.770179828 +0000 UTC m=+91.479462943" watchObservedRunningTime="2026-07-08 06:57:01.677453907 +0000 UTC m=+92.386737054"
Jul 08 06:57:01.722564 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:01.722534    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:57:01.727017 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:01.726991    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:57:03.141555 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:03.141505    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79cbd5d877-l7sqt"]
Jul 08 06:57:03.317464 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:03.317424    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:06.532888 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:06.532845    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:06.587619 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:06.587565    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:07.736091 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:07.736041    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7c598fb456-gf2gp"
Jul 08 06:57:08.168335 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:08.168294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:08.268279 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:08.268244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:09.223615 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:09.223576    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:09.288440 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:09.288391    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:13.323999 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:13.323964    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:13.375092 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:13.375055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:14.734849 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:14.734817    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:14.833271 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:14.833235    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:16.595968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:16.595936    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5kqw5"
Jul 08 06:57:21.511273 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:21.511244    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:57:21.515030 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:21.515001    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b9f9469c9-xr26j"
Jul 08 06:57:25.643442 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:25.643394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:25.695630 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:25.695590    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:28.727513 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:28.727477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:28.837499 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:28.837461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:29.763371 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:29.763325    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79cbd5d877-l7sqt" podUID="5c261806-af72-4f99-875a-cd505a47b069" containerName="console" containerID="cri-o://03f14605283771b6094b7fa7c7ee1981b0ce284b4ae14eeb8e879e27d23a68dc" gracePeriod=15
Jul 08 06:57:29.997595 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:29.997570    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:57:30.082220 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.082195    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqb8q\" (UniqueName: \"kubernetes.io/projected/5c261806-af72-4f99-875a-cd505a47b069-kube-api-access-hqb8q\") pod \"5c261806-af72-4f99-875a-cd505a47b069\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") "
Jul 08 06:57:30.082366 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.082255    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-service-ca\") pod \"5c261806-af72-4f99-875a-cd505a47b069\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") "
Jul 08 06:57:30.082366 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.082281    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c261806-af72-4f99-875a-cd505a47b069-console-serving-cert\") pod \"5c261806-af72-4f99-875a-cd505a47b069\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") "
Jul 08 06:57:30.082366 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.082307    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-oauth-serving-cert\") pod \"5c261806-af72-4f99-875a-cd505a47b069\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") "
Jul 08 06:57:30.082366 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.082324    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c261806-af72-4f99-875a-cd505a47b069-console-oauth-config\") pod \"5c261806-af72-4f99-875a-cd505a47b069\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") "
Jul 08 06:57:30.082366 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.082360    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-console-config\") pod \"5c261806-af72-4f99-875a-cd505a47b069\" (UID: \"5c261806-af72-4f99-875a-cd505a47b069\") "
Jul 08 06:57:30.082752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.082720    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5c261806-af72-4f99-875a-cd505a47b069" (UID: "5c261806-af72-4f99-875a-cd505a47b069"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:30.082850 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.082759    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-service-ca" (OuterVolumeSpecName: "service-ca") pod "5c261806-af72-4f99-875a-cd505a47b069" (UID: "5c261806-af72-4f99-875a-cd505a47b069"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:30.082850 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.082764    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-console-config" (OuterVolumeSpecName: "console-config") pod "5c261806-af72-4f99-875a-cd505a47b069" (UID: "5c261806-af72-4f99-875a-cd505a47b069"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:30.084607 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.084583    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c261806-af72-4f99-875a-cd505a47b069-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5c261806-af72-4f99-875a-cd505a47b069" (UID: "5c261806-af72-4f99-875a-cd505a47b069"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:30.084697 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.084613    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c261806-af72-4f99-875a-cd505a47b069-kube-api-access-hqb8q" (OuterVolumeSpecName: "kube-api-access-hqb8q") pod "5c261806-af72-4f99-875a-cd505a47b069" (UID: "5c261806-af72-4f99-875a-cd505a47b069"). InnerVolumeSpecName "kube-api-access-hqb8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:57:30.084697 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.084652    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c261806-af72-4f99-875a-cd505a47b069-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5c261806-af72-4f99-875a-cd505a47b069" (UID: "5c261806-af72-4f99-875a-cd505a47b069"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:30.183649 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.183594    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqb8q\" (UniqueName: \"kubernetes.io/projected/5c261806-af72-4f99-875a-cd505a47b069-kube-api-access-hqb8q\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:30.183649 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.183640    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-service-ca\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:30.183649 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.183651    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c261806-af72-4f99-875a-cd505a47b069-console-serving-cert\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:30.183649 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.183659    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-oauth-serving-cert\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:30.183649 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.183669    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c261806-af72-4f99-875a-cd505a47b069-console-oauth-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:30.183938 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.183677    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c261806-af72-4f99-875a-cd505a47b069-console-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:30.847229 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.847198    2565 generic.go:356] "Generic (PLEG): container finished" podID="5c261806-af72-4f99-875a-cd505a47b069" containerID="03f14605283771b6094b7fa7c7ee1981b0ce284b4ae14eeb8e879e27d23a68dc" exitCode=0
Jul 08 06:57:30.847612 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.847257    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cbd5d877-l7sqt"
Jul 08 06:57:30.847612 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.847278    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cbd5d877-l7sqt" event={"ID":"5c261806-af72-4f99-875a-cd505a47b069","Type":"ContainerDied","Data":"03f14605283771b6094b7fa7c7ee1981b0ce284b4ae14eeb8e879e27d23a68dc"}
Jul 08 06:57:30.847612 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.847337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cbd5d877-l7sqt" event={"ID":"5c261806-af72-4f99-875a-cd505a47b069","Type":"ContainerDied","Data":"cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c"}
Jul 08 06:57:30.847612 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.847358    2565 scope.go:117] "RemoveContainer" containerID="03f14605283771b6094b7fa7c7ee1981b0ce284b4ae14eeb8e879e27d23a68dc"
Jul 08 06:57:30.855765 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.855742    2565 scope.go:117] "RemoveContainer" containerID="03f14605283771b6094b7fa7c7ee1981b0ce284b4ae14eeb8e879e27d23a68dc"
Jul 08 06:57:30.856083 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:57:30.856049    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03f14605283771b6094b7fa7c7ee1981b0ce284b4ae14eeb8e879e27d23a68dc\": container with ID starting with 03f14605283771b6094b7fa7c7ee1981b0ce284b4ae14eeb8e879e27d23a68dc not found: ID does not exist" containerID="03f14605283771b6094b7fa7c7ee1981b0ce284b4ae14eeb8e879e27d23a68dc"
Jul 08 06:57:30.856146 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.856094    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03f14605283771b6094b7fa7c7ee1981b0ce284b4ae14eeb8e879e27d23a68dc"} err="failed to get container status \"03f14605283771b6094b7fa7c7ee1981b0ce284b4ae14eeb8e879e27d23a68dc\": rpc error: code = NotFound desc = could not find container \"03f14605283771b6094b7fa7c7ee1981b0ce284b4ae14eeb8e879e27d23a68dc\": container with ID starting with 03f14605283771b6094b7fa7c7ee1981b0ce284b4ae14eeb8e879e27d23a68dc not found: ID does not exist"
Jul 08 06:57:30.871166 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.871135    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79cbd5d877-l7sqt"]
Jul 08 06:57:30.876123 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:30.876097    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79cbd5d877-l7sqt"]
Jul 08 06:57:31.034997 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:31.034954    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c261806-af72-4f99-875a-cd505a47b069" path="/var/lib/kubelet/pods/5c261806-af72-4f99-875a-cd505a47b069/volumes"
Jul 08 06:57:31.165069 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:57:31.164976    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice/crio-cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice\": RecentStats: unable to find data in memory cache]"
Jul 08 06:57:41.210153 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:57:41.210109    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice/crio-cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c\": RecentStats: unable to find data in memory cache]"
Jul 08 06:57:43.318094 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:43.318039    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:43.403792 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:43.403763    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:43.634388 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:57:43.634348    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice/crio-cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c\": RecentStats: unable to find data in memory cache]"
Jul 08 06:57:43.924183 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:43.924102    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:57:51.249232 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:57:51.249189    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice/crio-cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice\": RecentStats: unable to find data in memory cache]"
Jul 08 06:57:56.008184 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:56.008141    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:56.221965 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:56.221927    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:57:57.021580 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.021549    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:57:57.022108 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.021856    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="alertmanager" containerID="cri-o://6b91a786bf23bed675628999a805f5b3cc355ff1a3f189354e55383c994dc984" gracePeriod=120
Jul 08 06:57:57.022108 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.021934    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="kube-rbac-proxy-metric" containerID="cri-o://4d233a89bca6259004848e732276c18ebe9c6ba9e0266447059c6ef157f2ec39" gracePeriod=120
Jul 08 06:57:57.022108 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.021985    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="config-reloader" containerID="cri-o://d807bffd0603a54358f768918248976f7d909ccd32b3cbd98bbfcc94f13730e0" gracePeriod=120
Jul 08 06:57:57.022108 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.022000    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="prom-label-proxy" containerID="cri-o://547953d5af67a6797c5f25cc1895179163fa5a18f11b8eccd4750088e5f4ad78" gracePeriod=120
Jul 08 06:57:57.022108 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.021983    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="kube-rbac-proxy-web" containerID="cri-o://333bf3db2f1678f66ba5fa1057fb8360b97b3569b0ae2f401648042c04d8c881" gracePeriod=120
Jul 08 06:57:57.022108 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.022026    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="kube-rbac-proxy" containerID="cri-o://7d01f8855e3d9ae2226e3fc843c7d97d5f57dbaddc09c74410ea20121ed66b54" gracePeriod=120
Jul 08 06:57:57.966588 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.966556    2565 generic.go:356] "Generic (PLEG): container finished" podID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerID="547953d5af67a6797c5f25cc1895179163fa5a18f11b8eccd4750088e5f4ad78" exitCode=0
Jul 08 06:57:57.966588 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.966582    2565 generic.go:356] "Generic (PLEG): container finished" podID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerID="4d233a89bca6259004848e732276c18ebe9c6ba9e0266447059c6ef157f2ec39" exitCode=0
Jul 08 06:57:57.966588 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.966590    2565 generic.go:356] "Generic (PLEG): container finished" podID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerID="7d01f8855e3d9ae2226e3fc843c7d97d5f57dbaddc09c74410ea20121ed66b54" exitCode=0
Jul 08 06:57:57.966588 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.966596    2565 generic.go:356] "Generic (PLEG): container finished" podID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerID="d807bffd0603a54358f768918248976f7d909ccd32b3cbd98bbfcc94f13730e0" exitCode=0
Jul 08 06:57:57.966847 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.966608    2565 generic.go:356] "Generic (PLEG): container finished" podID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerID="6b91a786bf23bed675628999a805f5b3cc355ff1a3f189354e55383c994dc984" exitCode=0
Jul 08 06:57:57.966847 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.966625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerDied","Data":"547953d5af67a6797c5f25cc1895179163fa5a18f11b8eccd4750088e5f4ad78"}
Jul 08 06:57:57.966847 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.966686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerDied","Data":"4d233a89bca6259004848e732276c18ebe9c6ba9e0266447059c6ef157f2ec39"}
Jul 08 06:57:57.966847 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.966716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerDied","Data":"7d01f8855e3d9ae2226e3fc843c7d97d5f57dbaddc09c74410ea20121ed66b54"}
Jul 08 06:57:57.966847 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.966740    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerDied","Data":"d807bffd0603a54358f768918248976f7d909ccd32b3cbd98bbfcc94f13730e0"}
Jul 08 06:57:57.966847 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:57.966763    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerDied","Data":"6b91a786bf23bed675628999a805f5b3cc355ff1a3f189354e55383c994dc984"}
Jul 08 06:57:58.260106 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.260066    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:58.336513 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.336482    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy-web\") pod \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") "
Jul 08 06:57:58.336513 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.336516    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2dj8\" (UniqueName: \"kubernetes.io/projected/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-kube-api-access-k2dj8\") pod \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") "
Jul 08 06:57:58.336777 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.336552    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-cluster-tls-config\") pod \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") "
Jul 08 06:57:58.336777 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.336604    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-config-out\") pod \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") "
Jul 08 06:57:58.336777 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.336634    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-metrics-client-ca\") pod \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") "
Jul 08 06:57:58.336777 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.336668    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") "
Jul 08 06:57:58.336777 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.336703    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-tls-assets\") pod \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") "
Jul 08 06:57:58.336777 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.336729    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-config-volume\") pod \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") "
Jul 08 06:57:58.336777 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.336758    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-alertmanager-trusted-ca-bundle\") pod \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") "
Jul 08 06:57:58.337176 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.336807    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-web-config\") pod \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") "
Jul 08 06:57:58.337176 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.336840    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-main-tls\") pod \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") "
Jul 08 06:57:58.337176 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.336887    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy\") pod \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") "
Jul 08 06:57:58.337176 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.336931    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-alertmanager-main-db\") pod \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\" (UID: \"7854bea9-da8d-4bc1-b7f3-9f8b58f26788\") "
Jul 08 06:57:58.337686 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.337514    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7854bea9-da8d-4bc1-b7f3-9f8b58f26788" (UID: "7854bea9-da8d-4bc1-b7f3-9f8b58f26788"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 06:57:58.337686 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.337578    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7854bea9-da8d-4bc1-b7f3-9f8b58f26788" (UID: "7854bea9-da8d-4bc1-b7f3-9f8b58f26788"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:58.338609 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.338579    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7854bea9-da8d-4bc1-b7f3-9f8b58f26788" (UID: "7854bea9-da8d-4bc1-b7f3-9f8b58f26788"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:57:58.342501 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.342460    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-config-out" (OuterVolumeSpecName: "config-out") pod "7854bea9-da8d-4bc1-b7f3-9f8b58f26788" (UID: "7854bea9-da8d-4bc1-b7f3-9f8b58f26788"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 06:57:58.342609 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.342557    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7854bea9-da8d-4bc1-b7f3-9f8b58f26788" (UID: "7854bea9-da8d-4bc1-b7f3-9f8b58f26788"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:58.343016 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.342979    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-kube-api-access-k2dj8" (OuterVolumeSpecName: "kube-api-access-k2dj8") pod "7854bea9-da8d-4bc1-b7f3-9f8b58f26788" (UID: "7854bea9-da8d-4bc1-b7f3-9f8b58f26788"). InnerVolumeSpecName "kube-api-access-k2dj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:57:58.343253 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.343223    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7854bea9-da8d-4bc1-b7f3-9f8b58f26788" (UID: "7854bea9-da8d-4bc1-b7f3-9f8b58f26788"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:57:58.343358 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.343297    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7854bea9-da8d-4bc1-b7f3-9f8b58f26788" (UID: "7854bea9-da8d-4bc1-b7f3-9f8b58f26788"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:58.344007 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.343967    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7854bea9-da8d-4bc1-b7f3-9f8b58f26788" (UID: "7854bea9-da8d-4bc1-b7f3-9f8b58f26788"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:58.344182 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.344150    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7854bea9-da8d-4bc1-b7f3-9f8b58f26788" (UID: "7854bea9-da8d-4bc1-b7f3-9f8b58f26788"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:58.344616 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.344592    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-config-volume" (OuterVolumeSpecName: "config-volume") pod "7854bea9-da8d-4bc1-b7f3-9f8b58f26788" (UID: "7854bea9-da8d-4bc1-b7f3-9f8b58f26788"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:58.347262 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.347236    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7854bea9-da8d-4bc1-b7f3-9f8b58f26788" (UID: "7854bea9-da8d-4bc1-b7f3-9f8b58f26788"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:58.353959 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.353932    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-web-config" (OuterVolumeSpecName: "web-config") pod "7854bea9-da8d-4bc1-b7f3-9f8b58f26788" (UID: "7854bea9-da8d-4bc1-b7f3-9f8b58f26788"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:57:58.437934 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.437894    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-config-out\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:58.437934 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.437926    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-metrics-client-ca\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:58.437934 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.437938    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:58.437934 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.437947    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-tls-assets\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:58.438223 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.437955    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-config-volume\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:58.438223 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.437964    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:58.438223 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.437973    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-web-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:58.438223 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.437981    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-main-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:58.438223 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.437991    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:58.438223 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.438000    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-alertmanager-main-db\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:58.438223 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.438008    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:58.438223 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.438016    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2dj8\" (UniqueName: \"kubernetes.io/projected/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-kube-api-access-k2dj8\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:58.438223 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.438024    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7854bea9-da8d-4bc1-b7f3-9f8b58f26788-cluster-tls-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:57:58.652221 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:57:58.652181    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice/crio-cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice\": RecentStats: unable to find data in memory cache]"
Jul 08 06:57:58.974457 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.974366    2565 generic.go:356] "Generic (PLEG): container finished" podID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerID="333bf3db2f1678f66ba5fa1057fb8360b97b3569b0ae2f401648042c04d8c881" exitCode=0
Jul 08 06:57:58.974457 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.974424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerDied","Data":"333bf3db2f1678f66ba5fa1057fb8360b97b3569b0ae2f401648042c04d8c881"}
Jul 08 06:57:58.974682 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.974474    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:58.974682 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.974498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7854bea9-da8d-4bc1-b7f3-9f8b58f26788","Type":"ContainerDied","Data":"10589019c0b22a7dadfd01e220092a4088c652694c9c12967404b890a151ac76"}
Jul 08 06:57:58.974682 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.974533    2565 scope.go:117] "RemoveContainer" containerID="547953d5af67a6797c5f25cc1895179163fa5a18f11b8eccd4750088e5f4ad78"
Jul 08 06:57:58.983097 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.983048    2565 scope.go:117] "RemoveContainer" containerID="4d233a89bca6259004848e732276c18ebe9c6ba9e0266447059c6ef157f2ec39"
Jul 08 06:57:58.990502 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.990481    2565 scope.go:117] "RemoveContainer" containerID="7d01f8855e3d9ae2226e3fc843c7d97d5f57dbaddc09c74410ea20121ed66b54"
Jul 08 06:57:58.998483 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.998422    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:57:58.998548 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:58.998497    2565 scope.go:117] "RemoveContainer" containerID="333bf3db2f1678f66ba5fa1057fb8360b97b3569b0ae2f401648042c04d8c881"
Jul 08 06:57:59.004929 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.004896    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:57:59.011262 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.011239    2565 scope.go:117] "RemoveContainer" containerID="d807bffd0603a54358f768918248976f7d909ccd32b3cbd98bbfcc94f13730e0"
Jul 08 06:57:59.019045 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.019023    2565 scope.go:117] "RemoveContainer" containerID="6b91a786bf23bed675628999a805f5b3cc355ff1a3f189354e55383c994dc984"
Jul 08 06:57:59.026282 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026259    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:57:59.026590 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026566    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="kube-rbac-proxy-web"
Jul 08 06:57:59.026590 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026583    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="kube-rbac-proxy-web"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026596    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="kube-rbac-proxy-metric"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026604    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="kube-rbac-proxy-metric"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026625    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="prom-label-proxy"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026633    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="prom-label-proxy"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026646    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="kube-rbac-proxy"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026654    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="kube-rbac-proxy"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026682    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="init-config-reloader"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026690    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="init-config-reloader"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026700    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c261806-af72-4f99-875a-cd505a47b069" containerName="console"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026708    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c261806-af72-4f99-875a-cd505a47b069" containerName="console"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026718    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="config-reloader"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026726    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="config-reloader"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026738    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="alertmanager"
Jul 08 06:57:59.026752 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026746    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="alertmanager"
Jul 08 06:57:59.027439 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026818    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="kube-rbac-proxy-metric"
Jul 08 06:57:59.027439 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026831    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="kube-rbac-proxy"
Jul 08 06:57:59.027439 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026841    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="alertmanager"
Jul 08 06:57:59.027439 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026850    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="config-reloader"
Jul 08 06:57:59.027439 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026862    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c261806-af72-4f99-875a-cd505a47b069" containerName="console"
Jul 08 06:57:59.027439 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026873    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="prom-label-proxy"
Jul 08 06:57:59.027439 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.026883    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" containerName="kube-rbac-proxy-web"
Jul 08 06:57:59.028464 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.028442    2565 scope.go:117] "RemoveContainer" containerID="2572ca99cce9d36b9afbb4ce7958147d29ef761e048d61d7b20c4520ca433ff7"
Jul 08 06:57:59.031776 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.031756    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.034656 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.034629    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 08 06:57:59.034762 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.034680    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 08 06:57:59.034762 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.034629    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 08 06:57:59.034762 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.034705    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 08 06:57:59.034927 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.034630    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 08 06:57:59.035039 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.035024    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 08 06:57:59.035039 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.035034    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 08 06:57:59.035126 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.035064    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kgbgm\""
Jul 08 06:57:59.035195 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.035176    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 08 06:57:59.037860 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.037838    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7854bea9-da8d-4bc1-b7f3-9f8b58f26788" path="/var/lib/kubelet/pods/7854bea9-da8d-4bc1-b7f3-9f8b58f26788/volumes"
Jul 08 06:57:59.039263 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.039247    2565 scope.go:117] "RemoveContainer" containerID="547953d5af67a6797c5f25cc1895179163fa5a18f11b8eccd4750088e5f4ad78"
Jul 08 06:57:59.039557 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:57:59.039537    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"547953d5af67a6797c5f25cc1895179163fa5a18f11b8eccd4750088e5f4ad78\": container with ID starting with 547953d5af67a6797c5f25cc1895179163fa5a18f11b8eccd4750088e5f4ad78 not found: ID does not exist" containerID="547953d5af67a6797c5f25cc1895179163fa5a18f11b8eccd4750088e5f4ad78"
Jul 08 06:57:59.039623 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.039565    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547953d5af67a6797c5f25cc1895179163fa5a18f11b8eccd4750088e5f4ad78"} err="failed to get container status \"547953d5af67a6797c5f25cc1895179163fa5a18f11b8eccd4750088e5f4ad78\": rpc error: code = NotFound desc = could not find container \"547953d5af67a6797c5f25cc1895179163fa5a18f11b8eccd4750088e5f4ad78\": container with ID starting with 547953d5af67a6797c5f25cc1895179163fa5a18f11b8eccd4750088e5f4ad78 not found: ID does not exist"
Jul 08 06:57:59.039623 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.039584    2565 scope.go:117] "RemoveContainer" containerID="4d233a89bca6259004848e732276c18ebe9c6ba9e0266447059c6ef157f2ec39"
Jul 08 06:57:59.040394 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:57:59.039888    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d233a89bca6259004848e732276c18ebe9c6ba9e0266447059c6ef157f2ec39\": container with ID starting with 4d233a89bca6259004848e732276c18ebe9c6ba9e0266447059c6ef157f2ec39 not found: ID does not exist" containerID="4d233a89bca6259004848e732276c18ebe9c6ba9e0266447059c6ef157f2ec39"
Jul 08 06:57:59.040394 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.039918    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d233a89bca6259004848e732276c18ebe9c6ba9e0266447059c6ef157f2ec39"} err="failed to get container status \"4d233a89bca6259004848e732276c18ebe9c6ba9e0266447059c6ef157f2ec39\": rpc error: code = NotFound desc = could not find container \"4d233a89bca6259004848e732276c18ebe9c6ba9e0266447059c6ef157f2ec39\": container with ID starting with 4d233a89bca6259004848e732276c18ebe9c6ba9e0266447059c6ef157f2ec39 not found: ID does not exist"
Jul 08 06:57:59.040394 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.039942    2565 scope.go:117] "RemoveContainer" containerID="7d01f8855e3d9ae2226e3fc843c7d97d5f57dbaddc09c74410ea20121ed66b54"
Jul 08 06:57:59.040394 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.040341    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 08 06:57:59.040658 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:57:59.040633    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d01f8855e3d9ae2226e3fc843c7d97d5f57dbaddc09c74410ea20121ed66b54\": container with ID starting with 7d01f8855e3d9ae2226e3fc843c7d97d5f57dbaddc09c74410ea20121ed66b54 not found: ID does not exist" containerID="7d01f8855e3d9ae2226e3fc843c7d97d5f57dbaddc09c74410ea20121ed66b54"
Jul 08 06:57:59.040721 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.040670    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d01f8855e3d9ae2226e3fc843c7d97d5f57dbaddc09c74410ea20121ed66b54"} err="failed to get container status \"7d01f8855e3d9ae2226e3fc843c7d97d5f57dbaddc09c74410ea20121ed66b54\": rpc error: code = NotFound desc = could not find container \"7d01f8855e3d9ae2226e3fc843c7d97d5f57dbaddc09c74410ea20121ed66b54\": container with ID starting with 7d01f8855e3d9ae2226e3fc843c7d97d5f57dbaddc09c74410ea20121ed66b54 not found: ID does not exist"
Jul 08 06:57:59.040721 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.040695    2565 scope.go:117] "RemoveContainer" containerID="333bf3db2f1678f66ba5fa1057fb8360b97b3569b0ae2f401648042c04d8c881"
Jul 08 06:57:59.041019 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:57:59.040995    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"333bf3db2f1678f66ba5fa1057fb8360b97b3569b0ae2f401648042c04d8c881\": container with ID starting with 333bf3db2f1678f66ba5fa1057fb8360b97b3569b0ae2f401648042c04d8c881 not found: ID does not exist" containerID="333bf3db2f1678f66ba5fa1057fb8360b97b3569b0ae2f401648042c04d8c881"
Jul 08 06:57:59.041111 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.041031    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"333bf3db2f1678f66ba5fa1057fb8360b97b3569b0ae2f401648042c04d8c881"} err="failed to get container status \"333bf3db2f1678f66ba5fa1057fb8360b97b3569b0ae2f401648042c04d8c881\": rpc error: code = NotFound desc = could not find container \"333bf3db2f1678f66ba5fa1057fb8360b97b3569b0ae2f401648042c04d8c881\": container with ID starting with 333bf3db2f1678f66ba5fa1057fb8360b97b3569b0ae2f401648042c04d8c881 not found: ID does not exist"
Jul 08 06:57:59.041111 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.041055    2565 scope.go:117] "RemoveContainer" containerID="d807bffd0603a54358f768918248976f7d909ccd32b3cbd98bbfcc94f13730e0"
Jul 08 06:57:59.041373 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:57:59.041353    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d807bffd0603a54358f768918248976f7d909ccd32b3cbd98bbfcc94f13730e0\": container with ID starting with d807bffd0603a54358f768918248976f7d909ccd32b3cbd98bbfcc94f13730e0 not found: ID does not exist" containerID="d807bffd0603a54358f768918248976f7d909ccd32b3cbd98bbfcc94f13730e0"
Jul 08 06:57:59.041452 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.041379    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d807bffd0603a54358f768918248976f7d909ccd32b3cbd98bbfcc94f13730e0"} err="failed to get container status \"d807bffd0603a54358f768918248976f7d909ccd32b3cbd98bbfcc94f13730e0\": rpc error: code = NotFound desc = could not find container \"d807bffd0603a54358f768918248976f7d909ccd32b3cbd98bbfcc94f13730e0\": container with ID starting with d807bffd0603a54358f768918248976f7d909ccd32b3cbd98bbfcc94f13730e0 not found: ID does not exist"
Jul 08 06:57:59.041452 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.041395    2565 scope.go:117] "RemoveContainer" containerID="6b91a786bf23bed675628999a805f5b3cc355ff1a3f189354e55383c994dc984"
Jul 08 06:57:59.041653 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:57:59.041635    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b91a786bf23bed675628999a805f5b3cc355ff1a3f189354e55383c994dc984\": container with ID starting with 6b91a786bf23bed675628999a805f5b3cc355ff1a3f189354e55383c994dc984 not found: ID does not exist" containerID="6b91a786bf23bed675628999a805f5b3cc355ff1a3f189354e55383c994dc984"
Jul 08 06:57:59.041721 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.041661    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b91a786bf23bed675628999a805f5b3cc355ff1a3f189354e55383c994dc984"} err="failed to get container status \"6b91a786bf23bed675628999a805f5b3cc355ff1a3f189354e55383c994dc984\": rpc error: code = NotFound desc = could not find container \"6b91a786bf23bed675628999a805f5b3cc355ff1a3f189354e55383c994dc984\": container with ID starting with 6b91a786bf23bed675628999a805f5b3cc355ff1a3f189354e55383c994dc984 not found: ID does not exist"
Jul 08 06:57:59.041721 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.041682    2565 scope.go:117] "RemoveContainer" containerID="2572ca99cce9d36b9afbb4ce7958147d29ef761e048d61d7b20c4520ca433ff7"
Jul 08 06:57:59.041969 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:57:59.041946    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2572ca99cce9d36b9afbb4ce7958147d29ef761e048d61d7b20c4520ca433ff7\": container with ID starting with 2572ca99cce9d36b9afbb4ce7958147d29ef761e048d61d7b20c4520ca433ff7 not found: ID does not exist" containerID="2572ca99cce9d36b9afbb4ce7958147d29ef761e048d61d7b20c4520ca433ff7"
Jul 08 06:57:59.042034 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.041973    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2572ca99cce9d36b9afbb4ce7958147d29ef761e048d61d7b20c4520ca433ff7"} err="failed to get container status \"2572ca99cce9d36b9afbb4ce7958147d29ef761e048d61d7b20c4520ca433ff7\": rpc error: code = NotFound desc = could not find container \"2572ca99cce9d36b9afbb4ce7958147d29ef761e048d61d7b20c4520ca433ff7\": container with ID starting with 2572ca99cce9d36b9afbb4ce7958147d29ef761e048d61d7b20c4520ca433ff7 not found: ID does not exist"
Jul 08 06:57:59.045037 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.045016    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:57:59.142157 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.142118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.142347 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.142174    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.142347 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.142219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.142347 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.142241    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-config-volume\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.142347 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.142259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.142347 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.142281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.142347 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.142303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-config-out\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.142347 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.142317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.142579 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.142354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-web-config\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.142579 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.142412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc2mt\" (UniqueName: \"kubernetes.io/projected/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-kube-api-access-rc2mt\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.142579 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.142447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.142579 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.142468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.142579 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.142522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243335 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243335 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-config-volume\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243335 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243304    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243335 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243935 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-config-out\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243935 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243935 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-web-config\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243935 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc2mt\" (UniqueName: \"kubernetes.io/projected/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-kube-api-access-rc2mt\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243935 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243935 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243935 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243935 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243935 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.243935 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.243698    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.245487 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.244525    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.245487 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.244908    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.246545 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.246519    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-web-config\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.247146 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.246934    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.247146 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.247178    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-config-out\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.247146 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.247235    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.247146 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.247241    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.247540 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.247306    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-config-volume\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.247540 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.247356    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.247646 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.247581    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.248309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.248290    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.251382 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.251359    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc2mt\" (UniqueName: \"kubernetes.io/projected/7ff8ce01-a189-4e4a-a756-19aedf9fd9b4-kube-api-access-rc2mt\") pod \"alertmanager-main-0\" (UID: \"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.343797 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.343743    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 06:57:59.481245 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.481218    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 06:57:59.483149 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:57:59.483123    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff8ce01_a189_4e4a_a756_19aedf9fd9b4.slice/crio-44b8604292f369bb2842c3f7d7a56dc71eaca578492f20d257d41000854218dd WatchSource:0}: Error finding container 44b8604292f369bb2842c3f7d7a56dc71eaca578492f20d257d41000854218dd: Status 404 returned error can't find the container with id 44b8604292f369bb2842c3f7d7a56dc71eaca578492f20d257d41000854218dd
Jul 08 06:57:59.980989 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.980954    2565 generic.go:356] "Generic (PLEG): container finished" podID="7ff8ce01-a189-4e4a-a756-19aedf9fd9b4" containerID="1f339724148454dd5502ce8f401678d720c1b80f1b05f07a8032f8909c0cfdfb" exitCode=0
Jul 08 06:57:59.981192 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.981005    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4","Type":"ContainerDied","Data":"1f339724148454dd5502ce8f401678d720c1b80f1b05f07a8032f8909c0cfdfb"}
Jul 08 06:57:59.981192 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:57:59.981054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4","Type":"ContainerStarted","Data":"44b8604292f369bb2842c3f7d7a56dc71eaca578492f20d257d41000854218dd"}
Jul 08 06:58:00.988007 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:00.987970    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4","Type":"ContainerStarted","Data":"a3577efe56adeba89457ef8c6798efb6826b9eba4438f2512cf16fc114abbc38"}
Jul 08 06:58:00.988418 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:00.988066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4","Type":"ContainerStarted","Data":"edc981fc9f3a2389edb998391553b83e4e510515856ac887ab0c2357e1b55e42"}
Jul 08 06:58:00.988418 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:00.988109    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4","Type":"ContainerStarted","Data":"5ad86c05f348c0d68e70de8212e418e48ec4ea3193fba5443698c6e876677b28"}
Jul 08 06:58:00.988418 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:00.988133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4","Type":"ContainerStarted","Data":"9ae521e602241a02f11476395ddcf804b41eb252bb500d6e9f416b151b0bcf43"}
Jul 08 06:58:00.988418 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:00.988159    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4","Type":"ContainerStarted","Data":"2111a84841554a4a502e1a8a9e6829ea6e885d7be9b198a8c7606a04f24c32c7"}
Jul 08 06:58:00.988418 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:00.988183    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ff8ce01-a189-4e4a-a756-19aedf9fd9b4","Type":"ContainerStarted","Data":"7f28c7a45e78b827bd55cd01734f53f8e3d6c4695241c6ac635e6359d577091b"}
Jul 08 06:58:01.019375 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.018899    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.002767047 podStartE2EDuration="2.018878201s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.111154ms" isStatefulPod=false podCreationTimestamp="2026-07-08 06:57:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:58:01.017226907 +0000 UTC m=+151.726510018" watchObservedRunningTime="2026-07-08 06:58:01.018878201 +0000 UTC m=+151.728161316"
Jul 08 06:58:01.086583 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.086550    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-f66dd8499-hnsdx"]
Jul 08 06:58:01.089957 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.089931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.092515 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.092486    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5qjsh\""
Jul 08 06:58:01.092515 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.092494    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 08 06:58:01.092696 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.092539    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 08 06:58:01.092696 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.092492    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 08 06:58:01.092808 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.092794    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 08 06:58:01.092864 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.092845    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 08 06:58:01.097765 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.097743    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 08 06:58:01.103052 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.103026    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f66dd8499-hnsdx"]
Jul 08 06:58:01.162118 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.162056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-federate-client-tls\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.162379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.162183    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-telemeter-client-tls\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.162379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.162221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.162379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.162255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.162379 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.162313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-metrics-client-ca\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.162518 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.162382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz5pw\" (UniqueName: \"kubernetes.io/projected/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-kube-api-access-vz5pw\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.162518 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.162423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-secret-telemeter-client\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.162518 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.162443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-serving-certs-ca-bundle\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.260485 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:01.260395    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice/crio-cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice\": RecentStats: unable to find data in memory cache]"
Jul 08 06:58:01.263065 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.263042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-federate-client-tls\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.263188 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.263095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-telemeter-client-tls\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.263188 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.263119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.263188 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.263148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.263188 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.263176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-metrics-client-ca\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.263393 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.263239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz5pw\" (UniqueName: \"kubernetes.io/projected/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-kube-api-access-vz5pw\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.263393 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.263291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-secret-telemeter-client\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.263393 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.263320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-serving-certs-ca-bundle\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.264197 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.264169    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-metrics-client-ca\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.264321 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.264185    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-serving-certs-ca-bundle\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.264321 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.264288    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.267463 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.267436    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-telemeter-client-tls\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.267586 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.267461    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.267586 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.267526    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-federate-client-tls\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.267687 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.267614    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-secret-telemeter-client\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.271726 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.271700    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz5pw\" (UniqueName: \"kubernetes.io/projected/3b48c776-63ac-40e0-a1ef-d308a78e2d6f-kube-api-access-vz5pw\") pod \"telemeter-client-f66dd8499-hnsdx\" (UID: \"3b48c776-63ac-40e0-a1ef-d308a78e2d6f\") " pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.403873 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.403832    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx"
Jul 08 06:58:01.404915 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.404888    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:58:01.405324 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.405289    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="prometheus" containerID="cri-o://734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3" gracePeriod=600
Jul 08 06:58:01.405409 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.405325    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="kube-rbac-proxy-web" containerID="cri-o://13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3" gracePeriod=600
Jul 08 06:58:01.405409 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.405300    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="thanos-sidecar" containerID="cri-o://18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1" gracePeriod=600
Jul 08 06:58:01.405515 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.405299    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="kube-rbac-proxy" containerID="cri-o://6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf" gracePeriod=600
Jul 08 06:58:01.405515 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.405328    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41" gracePeriod=600
Jul 08 06:58:01.405620 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.405508    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="config-reloader" containerID="cri-o://6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6" gracePeriod=600
Jul 08 06:58:01.573810 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.573783    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f66dd8499-hnsdx"]
Jul 08 06:58:01.575613 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:58:01.575586    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b48c776_63ac_40e0_a1ef_d308a78e2d6f.slice/crio-0ef1dcadef35c2dd2ae94755fad71046560e01b6344bf07dced26fb7319ebad3 WatchSource:0}: Error finding container 0ef1dcadef35c2dd2ae94755fad71046560e01b6344bf07dced26fb7319ebad3: Status 404 returned error can't find the container with id 0ef1dcadef35c2dd2ae94755fad71046560e01b6344bf07dced26fb7319ebad3
Jul 08 06:58:01.685386 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.685359    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:01.768000 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.767946    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-web-config\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768000 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.767999    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-tls\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768263 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768036    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-kube-rbac-proxy\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768263 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768062    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4mj9\" (UniqueName: \"kubernetes.io/projected/b454da6d-4254-4c43-832c-2face0cac2da-kube-api-access-v4mj9\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768263 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768121    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b454da6d-4254-4c43-832c-2face0cac2da-tls-assets\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768263 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768150    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-thanos-prometheus-http-client-file\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768263 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768185    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-1\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768263 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768223    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-0\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768263 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768245    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-config\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768272    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-db\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768309    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-grpc-tls\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768352    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-kubelet-serving-ca-bundle\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768393    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768451    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-metrics-client-certs\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768477    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-metrics-client-ca\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768512    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768538    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-2\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768574    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b454da6d-4254-4c43-832c-2face0cac2da-config-out\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.768627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768582    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:58:01.768627 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768616    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-trusted-ca-bundle\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.769175 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768648    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-serving-certs-ca-bundle\") pod \"b454da6d-4254-4c43-832c-2face0cac2da\" (UID: \"b454da6d-4254-4c43-832c-2face0cac2da\") "
Jul 08 06:58:01.769175 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.768910    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.769352 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.769326    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:58:01.770145 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.769785    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:58:01.770294 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.770269    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:58:01.770712 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.770690    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:58:01.771359 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.771333    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:58:01.771758 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.771732    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 06:58:01.771827 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.771760    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 06:58:01.772110 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.772065    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:58:01.774276 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.773944    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:58:01.774776 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.774721    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b454da6d-4254-4c43-832c-2face0cac2da-kube-api-access-v4mj9" (OuterVolumeSpecName: "kube-api-access-v4mj9") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "kube-api-access-v4mj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:58:01.774992 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.774908    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:58:01.775107 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.775086    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:58:01.775283 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.775242    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:58:01.775388 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.775311    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b454da6d-4254-4c43-832c-2face0cac2da-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 06:58:01.775576 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.775556    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b454da6d-4254-4c43-832c-2face0cac2da-config-out" (OuterVolumeSpecName: "config-out") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 06:58:01.776968 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.776937    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:58:01.777496 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.777438    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:58:01.777581 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.777509    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-config" (OuterVolumeSpecName: "config") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:58:01.786753 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.786695    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-web-config" (OuterVolumeSpecName: "web-config") pod "b454da6d-4254-4c43-832c-2face0cac2da" (UID: "b454da6d-4254-4c43-832c-2face0cac2da"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 06:58:01.869548 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869513    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-metrics-client-certs\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869548 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869543    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-metrics-client-ca\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869548 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869556    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869567    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869578    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b454da6d-4254-4c43-832c-2face0cac2da-config-out\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869587    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869597    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869605    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-web-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869615    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869623    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-kube-rbac-proxy\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869631    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4mj9\" (UniqueName: \"kubernetes.io/projected/b454da6d-4254-4c43-832c-2face0cac2da-kube-api-access-v4mj9\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869639    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b454da6d-4254-4c43-832c-2face0cac2da-tls-assets\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869649    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869657    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869666    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869674    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b454da6d-4254-4c43-832c-2face0cac2da-prometheus-k8s-db\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869682    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-grpc-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869690    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b454da6d-4254-4c43-832c-2face0cac2da-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.869761 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.869698    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b454da6d-4254-4c43-832c-2face0cac2da-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 06:58:01.993118 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.993052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx" event={"ID":"3b48c776-63ac-40e0-a1ef-d308a78e2d6f","Type":"ContainerStarted","Data":"0ef1dcadef35c2dd2ae94755fad71046560e01b6344bf07dced26fb7319ebad3"}
Jul 08 06:58:01.996101 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996059    2565 generic.go:356] "Generic (PLEG): container finished" podID="b454da6d-4254-4c43-832c-2face0cac2da" containerID="3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41" exitCode=0
Jul 08 06:58:01.996101 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996096    2565 generic.go:356] "Generic (PLEG): container finished" podID="b454da6d-4254-4c43-832c-2face0cac2da" containerID="6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf" exitCode=0
Jul 08 06:58:01.996101 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996103    2565 generic.go:356] "Generic (PLEG): container finished" podID="b454da6d-4254-4c43-832c-2face0cac2da" containerID="13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3" exitCode=0
Jul 08 06:58:01.996101 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996108    2565 generic.go:356] "Generic (PLEG): container finished" podID="b454da6d-4254-4c43-832c-2face0cac2da" containerID="18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1" exitCode=0
Jul 08 06:58:01.996309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996113    2565 generic.go:356] "Generic (PLEG): container finished" podID="b454da6d-4254-4c43-832c-2face0cac2da" containerID="6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6" exitCode=0
Jul 08 06:58:01.996309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996118    2565 generic.go:356] "Generic (PLEG): container finished" podID="b454da6d-4254-4c43-832c-2face0cac2da" containerID="734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3" exitCode=0
Jul 08 06:58:01.996309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerDied","Data":"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"}
Jul 08 06:58:01.996309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996175    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:01.996309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerDied","Data":"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"}
Jul 08 06:58:01.996309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerDied","Data":"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"}
Jul 08 06:58:01.996309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996256    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerDied","Data":"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"}
Jul 08 06:58:01.996309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerDied","Data":"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"}
Jul 08 06:58:01.996309 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996277    2565 scope.go:117] "RemoveContainer" containerID="3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"
Jul 08 06:58:01.996768 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerDied","Data":"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"}
Jul 08 06:58:01.996768 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:01.996448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b454da6d-4254-4c43-832c-2face0cac2da","Type":"ContainerDied","Data":"b9a710c42d7a28ec80e838af5406899481c1015e84a1849e4261a18d72b78642"}
Jul 08 06:58:02.004175 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.004161    2565 scope.go:117] "RemoveContainer" containerID="6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"
Jul 08 06:58:02.012126 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.012109    2565 scope.go:117] "RemoveContainer" containerID="13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"
Jul 08 06:58:02.019239 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.019182    2565 scope.go:117] "RemoveContainer" containerID="18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"
Jul 08 06:58:02.021530 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.021511    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:58:02.026936 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.026921    2565 scope.go:117] "RemoveContainer" containerID="6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"
Jul 08 06:58:02.027733 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.027713    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:58:02.033789 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.033774    2565 scope.go:117] "RemoveContainer" containerID="734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"
Jul 08 06:58:02.041038 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.041018    2565 scope.go:117] "RemoveContainer" containerID="04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"
Jul 08 06:58:02.048784 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.048761    2565 scope.go:117] "RemoveContainer" containerID="3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"
Jul 08 06:58:02.049132 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:02.049102    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41\": container with ID starting with 3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41 not found: ID does not exist" containerID="3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"
Jul 08 06:58:02.049202 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.049139    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"} err="failed to get container status \"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41\": rpc error: code = NotFound desc = could not find container \"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41\": container with ID starting with 3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41 not found: ID does not exist"
Jul 08 06:58:02.049202 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.049166    2565 scope.go:117] "RemoveContainer" containerID="6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"
Jul 08 06:58:02.049468 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:02.049443    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf\": container with ID starting with 6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf not found: ID does not exist" containerID="6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"
Jul 08 06:58:02.049527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.049479    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"} err="failed to get container status \"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf\": rpc error: code = NotFound desc = could not find container \"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf\": container with ID starting with 6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf not found: ID does not exist"
Jul 08 06:58:02.049527 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.049505    2565 scope.go:117] "RemoveContainer" containerID="13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"
Jul 08 06:58:02.049774 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:02.049754    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3\": container with ID starting with 13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3 not found: ID does not exist" containerID="13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"
Jul 08 06:58:02.049844 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.049784    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"} err="failed to get container status \"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3\": rpc error: code = NotFound desc = could not find container \"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3\": container with ID starting with 13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3 not found: ID does not exist"
Jul 08 06:58:02.049844 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.049804    2565 scope.go:117] "RemoveContainer" containerID="18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"
Jul 08 06:58:02.050056 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:02.050040    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1\": container with ID starting with 18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1 not found: ID does not exist" containerID="18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"
Jul 08 06:58:02.050152 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.050063    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"} err="failed to get container status \"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1\": rpc error: code = NotFound desc = could not find container \"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1\": container with ID starting with 18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1 not found: ID does not exist"
Jul 08 06:58:02.050152 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.050101    2565 scope.go:117] "RemoveContainer" containerID="6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"
Jul 08 06:58:02.050364 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:02.050343    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6\": container with ID starting with 6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6 not found: ID does not exist" containerID="6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"
Jul 08 06:58:02.050436 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.050372    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"} err="failed to get container status \"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6\": rpc error: code = NotFound desc = could not find container \"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6\": container with ID starting with 6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6 not found: ID does not exist"
Jul 08 06:58:02.050436 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.050390    2565 scope.go:117] "RemoveContainer" containerID="734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"
Jul 08 06:58:02.050630 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:02.050604    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3\": container with ID starting with 734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3 not found: ID does not exist" containerID="734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"
Jul 08 06:58:02.050681 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.050638    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"} err="failed to get container status \"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3\": rpc error: code = NotFound desc = could not find container \"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3\": container with ID starting with 734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3 not found: ID does not exist"
Jul 08 06:58:02.050681 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.050659    2565 scope.go:117] "RemoveContainer" containerID="04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"
Jul 08 06:58:02.050969 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:02.050944    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f\": container with ID starting with 04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f not found: ID does not exist" containerID="04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"
Jul 08 06:58:02.051092 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.050970    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"} err="failed to get container status \"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f\": rpc error: code = NotFound desc = could not find container \"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f\": container with ID starting with 04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f not found: ID does not exist"
Jul 08 06:58:02.051092 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.050984    2565 scope.go:117] "RemoveContainer" containerID="3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"
Jul 08 06:58:02.051257 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.051235    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"} err="failed to get container status \"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41\": rpc error: code = NotFound desc = could not find container \"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41\": container with ID starting with 3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41 not found: ID does not exist"
Jul 08 06:58:02.051305 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.051257    2565 scope.go:117] "RemoveContainer" containerID="6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"
Jul 08 06:58:02.051546 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.051511    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"} err="failed to get container status \"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf\": rpc error: code = NotFound desc = could not find container \"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf\": container with ID starting with 6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf not found: ID does not exist"
Jul 08 06:58:02.051610 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.051548    2565 scope.go:117] "RemoveContainer" containerID="13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"
Jul 08 06:58:02.051870 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.051849    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"} err="failed to get container status \"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3\": rpc error: code = NotFound desc = could not find container \"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3\": container with ID starting with 13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3 not found: ID does not exist"
Jul 08 06:58:02.051870 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.051870    2565 scope.go:117] "RemoveContainer" containerID="18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"
Jul 08 06:58:02.052152 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.052120    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"} err="failed to get container status \"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1\": rpc error: code = NotFound desc = could not find container \"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1\": container with ID starting with 18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1 not found: ID does not exist"
Jul 08 06:58:02.052152 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.052145    2565 scope.go:117] "RemoveContainer" containerID="6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"
Jul 08 06:58:02.052670 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.052603    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"} err="failed to get container status \"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6\": rpc error: code = NotFound desc = could not find container \"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6\": container with ID starting with 6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6 not found: ID does not exist"
Jul 08 06:58:02.052670 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.052629    2565 scope.go:117] "RemoveContainer" containerID="734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"
Jul 08 06:58:02.052670 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.052960    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"} err="failed to get container status \"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3\": rpc error: code = NotFound desc = could not find container \"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3\": container with ID starting with 734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3 not found: ID does not exist"
Jul 08 06:58:02.052670 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.052996    2565 scope.go:117] "RemoveContainer" containerID="04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"
Jul 08 06:58:02.053571 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.053521    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"} err="failed to get container status \"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f\": rpc error: code = NotFound desc = could not find container \"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f\": container with ID starting with 04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f not found: ID does not exist"
Jul 08 06:58:02.053571 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.053545    2565 scope.go:117] "RemoveContainer" containerID="3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"
Jul 08 06:58:02.053868 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.053844    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"} err="failed to get container status \"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41\": rpc error: code = NotFound desc = could not find container \"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41\": container with ID starting with 3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41 not found: ID does not exist"
Jul 08 06:58:02.053943 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.053870    2565 scope.go:117] "RemoveContainer" containerID="6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"
Jul 08 06:58:02.054146 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.054121    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"} err="failed to get container status \"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf\": rpc error: code = NotFound desc = could not find container \"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf\": container with ID starting with 6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf not found: ID does not exist"
Jul 08 06:58:02.054225 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.054148    2565 scope.go:117] "RemoveContainer" containerID="13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"
Jul 08 06:58:02.054386 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.054366    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"} err="failed to get container status \"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3\": rpc error: code = NotFound desc = could not find container \"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3\": container with ID starting with 13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3 not found: ID does not exist"
Jul 08 06:58:02.054453 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.054388    2565 scope.go:117] "RemoveContainer" containerID="18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"
Jul 08 06:58:02.054648 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.054619    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"} err="failed to get container status \"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1\": rpc error: code = NotFound desc = could not find container \"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1\": container with ID starting with 18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1 not found: ID does not exist"
Jul 08 06:58:02.054648 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.054642    2565 scope.go:117] "RemoveContainer" containerID="6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"
Jul 08 06:58:02.054905 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.054879    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"} err="failed to get container status \"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6\": rpc error: code = NotFound desc = could not find container \"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6\": container with ID starting with 6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6 not found: ID does not exist"
Jul 08 06:58:02.055009 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.054907    2565 scope.go:117] "RemoveContainer" containerID="734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"
Jul 08 06:58:02.055124 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055056    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:58:02.055420 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055395    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"} err="failed to get container status \"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3\": rpc error: code = NotFound desc = could not find container \"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3\": container with ID starting with 734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3 not found: ID does not exist"
Jul 08 06:58:02.055512 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055421    2565 scope.go:117] "RemoveContainer" containerID="04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"
Jul 08 06:58:02.055512 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055463    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="init-config-reloader"
Jul 08 06:58:02.055512 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055479    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="init-config-reloader"
Jul 08 06:58:02.055512 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055493    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="prometheus"
Jul 08 06:58:02.055512 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055502    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="prometheus"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055517    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="kube-rbac-proxy"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055523    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="kube-rbac-proxy"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055529    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="kube-rbac-proxy-thanos"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055534    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="kube-rbac-proxy-thanos"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055544    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="kube-rbac-proxy-web"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055552    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="kube-rbac-proxy-web"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055564    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="thanos-sidecar"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055571    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="thanos-sidecar"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055582    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="config-reloader"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055587    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="config-reloader"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055651    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="config-reloader"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055663    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="prometheus"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055673    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="kube-rbac-proxy-thanos"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055685    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="thanos-sidecar"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055679    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"} err="failed to get container status \"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f\": rpc error: code = NotFound desc = could not find container \"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f\": container with ID starting with 04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f not found: ID does not exist"
Jul 08 06:58:02.055722 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055705    2565 scope.go:117] "RemoveContainer" containerID="3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"
Jul 08 06:58:02.056356 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055694    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="kube-rbac-proxy-web"
Jul 08 06:58:02.056356 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055779    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b454da6d-4254-4c43-832c-2face0cac2da" containerName="kube-rbac-proxy"
Jul 08 06:58:02.056356 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.055984    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"} err="failed to get container status \"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41\": rpc error: code = NotFound desc = could not find container \"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41\": container with ID starting with 3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41 not found: ID does not exist"
Jul 08 06:58:02.056356 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.056007    2565 scope.go:117] "RemoveContainer" containerID="6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"
Jul 08 06:58:02.056356 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.056282    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"} err="failed to get container status \"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf\": rpc error: code = NotFound desc = could not find container \"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf\": container with ID starting with 6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf not found: ID does not exist"
Jul 08 06:58:02.056356 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.056307    2565 scope.go:117] "RemoveContainer" containerID="13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"
Jul 08 06:58:02.056596 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.056568    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"} err="failed to get container status \"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3\": rpc error: code = NotFound desc = could not find container \"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3\": container with ID starting with 13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3 not found: ID does not exist"
Jul 08 06:58:02.056596 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.056592    2565 scope.go:117] "RemoveContainer" containerID="18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"
Jul 08 06:58:02.056895 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.056870    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"} err="failed to get container status \"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1\": rpc error: code = NotFound desc = could not find container \"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1\": container with ID starting with 18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1 not found: ID does not exist"
Jul 08 06:58:02.056965 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.056896    2565 scope.go:117] "RemoveContainer" containerID="6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"
Jul 08 06:58:02.057156 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.057132    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"} err="failed to get container status \"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6\": rpc error: code = NotFound desc = could not find container \"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6\": container with ID starting with 6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6 not found: ID does not exist"
Jul 08 06:58:02.057156 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.057157    2565 scope.go:117] "RemoveContainer" containerID="734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"
Jul 08 06:58:02.057520 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.057496    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"} err="failed to get container status \"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3\": rpc error: code = NotFound desc = could not find container \"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3\": container with ID starting with 734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3 not found: ID does not exist"
Jul 08 06:58:02.057625 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.057521    2565 scope.go:117] "RemoveContainer" containerID="04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"
Jul 08 06:58:02.057786 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.057768    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"} err="failed to get container status \"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f\": rpc error: code = NotFound desc = could not find container \"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f\": container with ID starting with 04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f not found: ID does not exist"
Jul 08 06:58:02.057904 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.057788    2565 scope.go:117] "RemoveContainer" containerID="3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"
Jul 08 06:58:02.058012 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.057994    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"} err="failed to get container status \"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41\": rpc error: code = NotFound desc = could not find container \"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41\": container with ID starting with 3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41 not found: ID does not exist"
Jul 08 06:58:02.058106 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.058015    2565 scope.go:117] "RemoveContainer" containerID="6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"
Jul 08 06:58:02.058284 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.058259    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"} err="failed to get container status \"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf\": rpc error: code = NotFound desc = could not find container \"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf\": container with ID starting with 6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf not found: ID does not exist"
Jul 08 06:58:02.058373 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.058286    2565 scope.go:117] "RemoveContainer" containerID="13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"
Jul 08 06:58:02.061328 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.059688    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"} err="failed to get container status \"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3\": rpc error: code = NotFound desc = could not find container \"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3\": container with ID starting with 13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3 not found: ID does not exist"
Jul 08 06:58:02.061328 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.059714    2565 scope.go:117] "RemoveContainer" containerID="18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"
Jul 08 06:58:02.061328 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.060446    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"} err="failed to get container status \"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1\": rpc error: code = NotFound desc = could not find container \"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1\": container with ID starting with 18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1 not found: ID does not exist"
Jul 08 06:58:02.061328 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.060468    2565 scope.go:117] "RemoveContainer" containerID="6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"
Jul 08 06:58:02.061328 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.060699    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"} err="failed to get container status \"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6\": rpc error: code = NotFound desc = could not find container \"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6\": container with ID starting with 6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6 not found: ID does not exist"
Jul 08 06:58:02.061328 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.060720    2565 scope.go:117] "RemoveContainer" containerID="734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"
Jul 08 06:58:02.061328 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.061164    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"} err="failed to get container status \"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3\": rpc error: code = NotFound desc = could not find container \"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3\": container with ID starting with 734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3 not found: ID does not exist"
Jul 08 06:58:02.061328 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.061188    2565 scope.go:117] "RemoveContainer" containerID="04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"
Jul 08 06:58:02.062131 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.061771    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"} err="failed to get container status \"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f\": rpc error: code = NotFound desc = could not find container \"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f\": container with ID starting with 04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f not found: ID does not exist"
Jul 08 06:58:02.062131 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.061795    2565 scope.go:117] "RemoveContainer" containerID="3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"
Jul 08 06:58:02.062279 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.062256    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.062354 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.062289    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41"} err="failed to get container status \"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41\": rpc error: code = NotFound desc = could not find container \"3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41\": container with ID starting with 3fbed9694df8a55e5bc93f9e233f11b5b47e3676ec628cb30d0772cd2152dc41 not found: ID does not exist"
Jul 08 06:58:02.062354 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.062314    2565 scope.go:117] "RemoveContainer" containerID="6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"
Jul 08 06:58:02.062865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.062620    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf"} err="failed to get container status \"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf\": rpc error: code = NotFound desc = could not find container \"6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf\": container with ID starting with 6ef4a63511c77f68fcb8ab52d22611981d4f84e8f43d210f0710bd8d703f0cbf not found: ID does not exist"
Jul 08 06:58:02.062865 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.062653    2565 scope.go:117] "RemoveContainer" containerID="13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"
Jul 08 06:58:02.063344 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.063064    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3"} err="failed to get container status \"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3\": rpc error: code = NotFound desc = could not find container \"13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3\": container with ID starting with 13ff3cf696e5d3bc5f5a9b26ca5f96ad548f0ae249ce3dfda4df6e835a6f42f3 not found: ID does not exist"
Jul 08 06:58:02.063344 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.063108    2565 scope.go:117] "RemoveContainer" containerID="18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"
Jul 08 06:58:02.063446 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.063412    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1"} err="failed to get container status \"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1\": rpc error: code = NotFound desc = could not find container \"18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1\": container with ID starting with 18e5556486efa8f2ebd7cca6fa506a0117b4ad4ebd6ae48aea6adc656abec2e1 not found: ID does not exist"
Jul 08 06:58:02.063446 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.063434    2565 scope.go:117] "RemoveContainer" containerID="6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"
Jul 08 06:58:02.063747 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.063721    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6"} err="failed to get container status \"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6\": rpc error: code = NotFound desc = could not find container \"6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6\": container with ID starting with 6c9877ed7db71008182a78c39451269890851d698e75145babee8ba422aa88e6 not found: ID does not exist"
Jul 08 06:58:02.063875 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.063747    2565 scope.go:117] "RemoveContainer" containerID="734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"
Jul 08 06:58:02.064057 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.064002    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3"} err="failed to get container status \"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3\": rpc error: code = NotFound desc = could not find container \"734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3\": container with ID starting with 734edc5a5f49c60ebdc35867e8c4fe1af309780d40bba225aad30a0a36e2c7a3 not found: ID does not exist"
Jul 08 06:58:02.064057 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.064027    2565 scope.go:117] "RemoveContainer" containerID="04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"
Jul 08 06:58:02.064312 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.064286    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f"} err="failed to get container status \"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f\": rpc error: code = NotFound desc = could not find container \"04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f\": container with ID starting with 04b8c205b7cd3b40b0c6600f160273e6098b0f1cc5f6c2d81d58af2453646a3f not found: ID does not exist"
Jul 08 06:58:02.065125 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.065059    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 06:58:02.065219 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.065063    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 06:58:02.065547 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.065526    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 06:58:02.065703 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.065680    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 06:58:02.065774 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.065726    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 06:58:02.065826 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.065781    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-la8bgkk8qfkj\""
Jul 08 06:58:02.066136 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.065936    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 06:58:02.066136 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.066063    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 06:58:02.066136 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.066103    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 06:58:02.066298 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.066144    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vs4lg\""
Jul 08 06:58:02.066298 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.066209    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 06:58:02.066298 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.066099    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 06:58:02.066446 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.066314    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 06:58:02.066755 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.066651    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 06:58:02.068857 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.068819    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 06:58:02.073124 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.073105    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 06:58:02.078005 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.077982    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:58:02.171801 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.171758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.171955 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.171808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tljwb\" (UniqueName: \"kubernetes.io/projected/26267953-0733-4376-8df5-7c83e5c4124c-kube-api-access-tljwb\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.171955 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.171843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.171955 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.171870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.171955 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.171886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.171955 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.171934    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172158 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.171979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172158 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.172022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-config\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172158 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.172058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172158 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.172097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172158 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.172116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-web-config\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172301 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.172159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172301 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.172182    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172301 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.172216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26267953-0733-4376-8df5-7c83e5c4124c-config-out\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172301 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.172235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172301 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.172262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172301 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.172296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26267953-0733-4376-8df5-7c83e5c4124c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172473 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.172326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172473 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.172358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.172473 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.172378    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273196 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273351 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273351 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273351 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273351 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tljwb\" (UniqueName: \"kubernetes.io/projected/26267953-0733-4376-8df5-7c83e5c4124c-kube-api-access-tljwb\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273351 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273608 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273608 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273608 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273608 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273608 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-config\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273608 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273608 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273608 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-web-config\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273982 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273624    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273982 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273982 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26267953-0733-4376-8df5-7c83e5c4124c-config-out\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273982 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273982 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273982 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26267953-0733-4376-8df5-7c83e5c4124c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.273982 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.273939    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.274365 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.274017    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.274693 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.274612    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.274863 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.274840    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.275923 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.275518    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.277276 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.277252    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26267953-0733-4376-8df5-7c83e5c4124c-config-out\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.277513 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.277487    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26267953-0733-4376-8df5-7c83e5c4124c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.277600 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.277580    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.277649 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.277608    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.277762 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.277739    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.277855 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.277832    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.279112 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.279023    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.279826 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.279803    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26267953-0733-4376-8df5-7c83e5c4124c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.280459 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.280439    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-web-config\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.280547 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.280497    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.280547 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.280524    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.280698 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.280573    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.281662 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.281637    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.281797 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.281783    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/26267953-0733-4376-8df5-7c83e5c4124c-config\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.286046 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.286017    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tljwb\" (UniqueName: \"kubernetes.io/projected/26267953-0733-4376-8df5-7c83e5c4124c-kube-api-access-tljwb\") pod \"prometheus-k8s-0\" (UID: \"26267953-0733-4376-8df5-7c83e5c4124c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.375051 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.375008    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:02.526880 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:02.526856    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 06:58:02.529436 ip-10-0-132-191 kubenswrapper[2565]: W0708 06:58:02.529393    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26267953_0733_4376_8df5_7c83e5c4124c.slice/crio-e2d9875092902e23955a32b207628226700364a3469d0f0961b35fa2ecd443b0 WatchSource:0}: Error finding container e2d9875092902e23955a32b207628226700364a3469d0f0961b35fa2ecd443b0: Status 404 returned error can't find the container with id e2d9875092902e23955a32b207628226700364a3469d0f0961b35fa2ecd443b0
Jul 08 06:58:03.002412 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:03.002369    2565 generic.go:356] "Generic (PLEG): container finished" podID="26267953-0733-4376-8df5-7c83e5c4124c" containerID="6738256dc5851150237b45be2bc105a498769568cafe50c88a455c3958d98ff0" exitCode=0
Jul 08 06:58:03.002910 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:03.002463    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26267953-0733-4376-8df5-7c83e5c4124c","Type":"ContainerDied","Data":"6738256dc5851150237b45be2bc105a498769568cafe50c88a455c3958d98ff0"}
Jul 08 06:58:03.002910 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:03.002582    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26267953-0733-4376-8df5-7c83e5c4124c","Type":"ContainerStarted","Data":"e2d9875092902e23955a32b207628226700364a3469d0f0961b35fa2ecd443b0"}
Jul 08 06:58:03.037211 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:03.037162    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b454da6d-4254-4c43-832c-2face0cac2da" path="/var/lib/kubelet/pods/b454da6d-4254-4c43-832c-2face0cac2da/volumes"
Jul 08 06:58:04.011069 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:04.010976    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26267953-0733-4376-8df5-7c83e5c4124c","Type":"ContainerStarted","Data":"be1f43859e1670233ba6affab88faa7abaddb6552f5ce55c9e409c8408a02da1"}
Jul 08 06:58:04.011069 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:04.011048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26267953-0733-4376-8df5-7c83e5c4124c","Type":"ContainerStarted","Data":"f74e448a80e4a31949e4acfc7eb6f890c33c157359ed6cd9abe65f5cfa888dbe"}
Jul 08 06:58:04.011585 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:04.011104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26267953-0733-4376-8df5-7c83e5c4124c","Type":"ContainerStarted","Data":"4274a8885b7b01b61c4bd163da25ea4fe8dc92bc9142c81802a271fa6a191eae"}
Jul 08 06:58:04.011585 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:04.011141    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26267953-0733-4376-8df5-7c83e5c4124c","Type":"ContainerStarted","Data":"8973099f8e8c6062f6f8c277e76171a187881b9d1eb45b15133f13edd12ef3e8"}
Jul 08 06:58:04.011585 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:04.011173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26267953-0733-4376-8df5-7c83e5c4124c","Type":"ContainerStarted","Data":"62bb5088c6696ed82b21d2ca83bcdbfc9f6eb9cb5339fa937d871e8e8a554b4e"}
Jul 08 06:58:04.011585 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:04.011207    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26267953-0733-4376-8df5-7c83e5c4124c","Type":"ContainerStarted","Data":"4273aa4a42e738a780b6188ddeefa8f33d62884378b2dd5fb1e5884dc23d3b66"}
Jul 08 06:58:04.013030 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:04.013004    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx" event={"ID":"3b48c776-63ac-40e0-a1ef-d308a78e2d6f","Type":"ContainerStarted","Data":"0ef37b7b598d654b2d1129dd6e534e3331e5cf0d3fd2402155868a41a5e03317"}
Jul 08 06:58:04.013149 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:04.013057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx" event={"ID":"3b48c776-63ac-40e0-a1ef-d308a78e2d6f","Type":"ContainerStarted","Data":"45428f60122ac5770124ab2a07df527b12790c4938e766a524d2657e9668e72d"}
Jul 08 06:58:04.013149 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:04.013099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx" event={"ID":"3b48c776-63ac-40e0-a1ef-d308a78e2d6f","Type":"ContainerStarted","Data":"0f570b41ed4669d899c04cd4784e62ffc74a7d98728d5d1526ebfdc745f93010"}
Jul 08 06:58:04.045774 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:04.045712    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.018962698 podStartE2EDuration="2.045688153s" totalImagesPullingTime="0s" totalInitContainerRuntime="26.725455ms" isStatefulPod=false podCreationTimestamp="2026-07-08 06:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:58:04.043408701 +0000 UTC m=+154.752691846" watchObservedRunningTime="2026-07-08 06:58:04.045688153 +0000 UTC m=+154.754971264"
Jul 08 06:58:04.065109 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:04.065041    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-f66dd8499-hnsdx" podStartSLOduration=1.267942889 podStartE2EDuration="3.065023476s" totalImagesPullingTime="1.797080587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 06:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 06:58:04.062600879 +0000 UTC m=+154.771884013" watchObservedRunningTime="2026-07-08 06:58:04.065023476 +0000 UTC m=+154.774306586"
Jul 08 06:58:04.754945 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:04.754908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:58:04.856296 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:04.856252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:58:07.375349 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:07.375310    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:58:09.930178 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:09.930136    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice/crio-cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c\": RecentStats: unable to find data in memory cache]"
Jul 08 06:58:09.930178 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:09.930173    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice/crio-cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c\": RecentStats: unable to find data in memory cache]"
Jul 08 06:58:11.268144 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:11.268109    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice/crio-cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice\": RecentStats: unable to find data in memory cache]"
Jul 08 06:58:13.639014 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:13.638973    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice/crio-cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice\": RecentStats: unable to find data in memory cache]"
Jul 08 06:58:15.543525 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:15.543489    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:58:15.642727 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:15.642674    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:58:15.695765 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:15.695732    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:58:21.307949 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:21.307866    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice/crio-cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice\": RecentStats: unable to find data in memory cache]"
Jul 08 06:58:27.386744 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:27.386709    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:58:28.674725 ip-10-0-132-191 kubenswrapper[2565]: E0708 06:58:28.674691    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice/crio-cbc12cef39ea7aeed0de15f6674b1fb5a30bf015a0a74b4c5d31d6494db8fc2c\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c261806_af72_4f99_875a_cd505a47b069.slice\": RecentStats: unable to find data in memory cache]"
Jul 08 06:58:53.626298 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:53.626262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:58:53.694245 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:58:53.694209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:59:02.375825 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:02.375788    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:59:02.391278 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:02.391253    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:59:03.275626 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:03.275597    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 06:59:11.185995 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:11.185961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:59:11.243388 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:11.243361    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:59:23.085432 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:23.085395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:59:23.139327 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:23.139303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:59:28.740330 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:28.740295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:59:28.841183 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:28.841142    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:59:35.718772 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:35.718728    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:59:35.803474 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:35.803437    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:59:46.875569 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:46.875537    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:59:46.936758 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:46.936701    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 06:59:46.998422 ip-10-0-132-191 kubenswrapper[2565]: I0708 06:59:46.998392    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:09.158382 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:09.158305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:09.643013 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:09.642975    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:09.743931 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:09.743896    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:09.958389 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:09.958308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:10.059089 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:10.059047    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:10.117379 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:10.117342    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:30.848285 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:30.848249    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:00:30.852797 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:30.852774    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 07:00:30.856193 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:30.856174    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:00:37.067135 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:37.067092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:38.482533 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:38.482474    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:41.925390 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:41.925333    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:42.512544 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:42.512514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:42.581182 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:42.581147    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:42.964447 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:42.964413    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:43.276304 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:43.276226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:43.495747 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:43.495709    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:43.686135 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:43.686093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:43.919136 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:43.919093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:44.143799 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:44.143770    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:44.260043 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:44.260004    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:00:44.366130 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:00:44.366068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:01:01.846049 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:01:01.845991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:01:01.942912 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:01:01.942877    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:01:49.253344 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:01:49.253309    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:01:49.330875 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:01:49.330827    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:01:49.395849 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:01:49.395816    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:01:49.497069 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:01:49.497030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:01:50.091245 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:01:50.091212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:01:50.192434 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:01:50.192395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:01:50.248193 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:01:50.248160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:02:59.359830 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.359674    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:02:59.413039 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.412999    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-6qfnf"]
Jul 08 07:02:59.415904 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.415881    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-6qfnf"
Jul 08 07:02:59.418821 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.418797    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-ctzxp\""
Jul 08 07:02:59.418947 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.418826    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 08 07:02:59.418947 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.418827    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Jul 08 07:02:59.419709 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.419697    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 08 07:02:59.426168 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.426144    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-6qfnf"]
Jul 08 07:02:59.441502 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.441471    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:02:59.544893 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.544847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a1c2b92-1fc7-4f90-b197-b5a357f392fc-cert\") pod \"odh-model-controller-84b54b7f97-6qfnf\" (UID: \"0a1c2b92-1fc7-4f90-b197-b5a357f392fc\") " pod="kserve/odh-model-controller-84b54b7f97-6qfnf"
Jul 08 07:02:59.544893 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.544898    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f4lw\" (UniqueName: \"kubernetes.io/projected/0a1c2b92-1fc7-4f90-b197-b5a357f392fc-kube-api-access-6f4lw\") pod \"odh-model-controller-84b54b7f97-6qfnf\" (UID: \"0a1c2b92-1fc7-4f90-b197-b5a357f392fc\") " pod="kserve/odh-model-controller-84b54b7f97-6qfnf"
Jul 08 07:02:59.645952 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.645876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a1c2b92-1fc7-4f90-b197-b5a357f392fc-cert\") pod \"odh-model-controller-84b54b7f97-6qfnf\" (UID: \"0a1c2b92-1fc7-4f90-b197-b5a357f392fc\") " pod="kserve/odh-model-controller-84b54b7f97-6qfnf"
Jul 08 07:02:59.645952 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.645918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f4lw\" (UniqueName: \"kubernetes.io/projected/0a1c2b92-1fc7-4f90-b197-b5a357f392fc-kube-api-access-6f4lw\") pod \"odh-model-controller-84b54b7f97-6qfnf\" (UID: \"0a1c2b92-1fc7-4f90-b197-b5a357f392fc\") " pod="kserve/odh-model-controller-84b54b7f97-6qfnf"
Jul 08 07:02:59.646139 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:02:59.646037    2565 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 08 07:02:59.646175 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:02:59.646143    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a1c2b92-1fc7-4f90-b197-b5a357f392fc-cert podName:0a1c2b92-1fc7-4f90-b197-b5a357f392fc nodeName:}" failed. No retries permitted until 2026-07-08 07:03:00.146125865 +0000 UTC m=+450.855408957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0a1c2b92-1fc7-4f90-b197-b5a357f392fc-cert") pod "odh-model-controller-84b54b7f97-6qfnf" (UID: "0a1c2b92-1fc7-4f90-b197-b5a357f392fc") : secret "odh-model-controller-webhook-cert" not found
Jul 08 07:02:59.654588 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.654556    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f4lw\" (UniqueName: \"kubernetes.io/projected/0a1c2b92-1fc7-4f90-b197-b5a357f392fc-kube-api-access-6f4lw\") pod \"odh-model-controller-84b54b7f97-6qfnf\" (UID: \"0a1c2b92-1fc7-4f90-b197-b5a357f392fc\") " pod="kserve/odh-model-controller-84b54b7f97-6qfnf"
Jul 08 07:02:59.748628 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.748602    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:02:59.850546 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:02:59.850512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:03:00.013318 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:00.013225    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:03:00.070224 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:00.070182    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:03:00.150597 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:00.150407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a1c2b92-1fc7-4f90-b197-b5a357f392fc-cert\") pod \"odh-model-controller-84b54b7f97-6qfnf\" (UID: \"0a1c2b92-1fc7-4f90-b197-b5a357f392fc\") " pod="kserve/odh-model-controller-84b54b7f97-6qfnf"
Jul 08 07:03:00.152850 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:00.152823    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a1c2b92-1fc7-4f90-b197-b5a357f392fc-cert\") pod \"odh-model-controller-84b54b7f97-6qfnf\" (UID: \"0a1c2b92-1fc7-4f90-b197-b5a357f392fc\") " pod="kserve/odh-model-controller-84b54b7f97-6qfnf"
Jul 08 07:03:00.327215 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:00.327179    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-6qfnf"
Jul 08 07:03:00.465874 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:00.465851    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-6qfnf"]
Jul 08 07:03:00.468543 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:03:00.468512    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1c2b92_1fc7_4f90_b197_b5a357f392fc.slice/crio-d87824585454912c8411327e64b42b13c6d95f40bc1fd46d53208ef5d00e6321 WatchSource:0}: Error finding container d87824585454912c8411327e64b42b13c6d95f40bc1fd46d53208ef5d00e6321: Status 404 returned error can't find the container with id d87824585454912c8411327e64b42b13c6d95f40bc1fd46d53208ef5d00e6321
Jul 08 07:03:00.469849 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:00.469835    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 07:03:01.201357 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:01.201321    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-6qfnf" event={"ID":"0a1c2b92-1fc7-4f90-b197-b5a357f392fc","Type":"ContainerStarted","Data":"d87824585454912c8411327e64b42b13c6d95f40bc1fd46d53208ef5d00e6321"}
Jul 08 07:03:03.440809 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:03.440772    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:03:04.217178 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:04.217099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-6qfnf" event={"ID":"0a1c2b92-1fc7-4f90-b197-b5a357f392fc","Type":"ContainerStarted","Data":"9f62e94d7ea6f97f3f61a9f023aa560ea4e4a476e80e6810ea2b117f9b2622a3"}
Jul 08 07:03:04.217347 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:04.217328    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-6qfnf"
Jul 08 07:03:04.237954 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:04.237874    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-6qfnf" podStartSLOduration=1.779061967 podStartE2EDuration="5.237859931s" totalImagesPullingTime="3.458797964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:02:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:03:04.234905312 +0000 UTC m=+454.944188438" watchObservedRunningTime="2026-07-08 07:03:04.237859931 +0000 UTC m=+454.947143073"
Jul 08 07:03:06.957378 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:06.957342    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-999cb578c-s8hj5"]
Jul 08 07:03:06.960817 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:06.960797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:06.964543 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:06.964521    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 07:03:06.964678 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:06.964573    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 07:03:06.964678 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:06.964582    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 07:03:06.964790 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:06.964777    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 07:03:06.964905 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:06.964890    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qtmnv\""
Jul 08 07:03:06.964963 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:06.964887    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 07:03:06.968569 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:06.968550    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 07:03:06.971946 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:06.971925    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-999cb578c-s8hj5"]
Jul 08 07:03:07.014416 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.014363    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:03:07.017566 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.017545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ebc168f-874c-4688-b340-cbabe18957e1-console-oauth-config\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.017639 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.017579    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ebc168f-874c-4688-b340-cbabe18957e1-trusted-ca-bundle\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.017639 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.017624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ebc168f-874c-4688-b340-cbabe18957e1-console-serving-cert\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.017707 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.017664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ebc168f-874c-4688-b340-cbabe18957e1-console-config\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.017707 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.017693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc168f-874c-4688-b340-cbabe18957e1-oauth-serving-cert\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.017772 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.017735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ebc168f-874c-4688-b340-cbabe18957e1-service-ca\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.017772 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.017755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5vsb\" (UniqueName: \"kubernetes.io/projected/2ebc168f-874c-4688-b340-cbabe18957e1-kube-api-access-f5vsb\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.117248 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.117213    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:03:07.118408 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.118375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ebc168f-874c-4688-b340-cbabe18957e1-service-ca\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.118477 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.118435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5vsb\" (UniqueName: \"kubernetes.io/projected/2ebc168f-874c-4688-b340-cbabe18957e1-kube-api-access-f5vsb\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.118516 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.118487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ebc168f-874c-4688-b340-cbabe18957e1-console-oauth-config\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.118549 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.118519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ebc168f-874c-4688-b340-cbabe18957e1-trusted-ca-bundle\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.118582 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.118562    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ebc168f-874c-4688-b340-cbabe18957e1-console-serving-cert\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.118622 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.118598    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ebc168f-874c-4688-b340-cbabe18957e1-console-config\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.118676 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.118627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc168f-874c-4688-b340-cbabe18957e1-oauth-serving-cert\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.119214 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.119185    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ebc168f-874c-4688-b340-cbabe18957e1-service-ca\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.119335 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.119316    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc168f-874c-4688-b340-cbabe18957e1-oauth-serving-cert\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.119484 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.119464    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ebc168f-874c-4688-b340-cbabe18957e1-trusted-ca-bundle\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.119595 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.119491    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ebc168f-874c-4688-b340-cbabe18957e1-console-config\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.121641 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.121606    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ebc168f-874c-4688-b340-cbabe18957e1-console-serving-cert\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.121741 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.121615    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ebc168f-874c-4688-b340-cbabe18957e1-console-oauth-config\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.127244 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.127217    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5vsb\" (UniqueName: \"kubernetes.io/projected/2ebc168f-874c-4688-b340-cbabe18957e1-kube-api-access-f5vsb\") pod \"console-999cb578c-s8hj5\" (UID: \"2ebc168f-874c-4688-b340-cbabe18957e1\") " pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.215016 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.214912    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:03:07.270507 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.270471    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:07.408336 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.408312    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-999cb578c-s8hj5"]
Jul 08 07:03:07.410889 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:03:07.410864    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ebc168f_874c_4688_b340_cbabe18957e1.slice/crio-3b72fa4b1194dcb3089d5baf69beb419896c77752aa4789087cde0bda45a956d WatchSource:0}: Error finding container 3b72fa4b1194dcb3089d5baf69beb419896c77752aa4789087cde0bda45a956d: Status 404 returned error can't find the container with id 3b72fa4b1194dcb3089d5baf69beb419896c77752aa4789087cde0bda45a956d
Jul 08 07:03:07.768126 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.768097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:03:07.826199 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:07.826162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:03:08.235367 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:08.235325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-999cb578c-s8hj5" event={"ID":"2ebc168f-874c-4688-b340-cbabe18957e1","Type":"ContainerStarted","Data":"58588a859915b3782bf0030f2e441108a5d269a63aba75dcf28ea9a0dc5045cc"}
Jul 08 07:03:08.235757 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:08.235387    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-999cb578c-s8hj5" event={"ID":"2ebc168f-874c-4688-b340-cbabe18957e1","Type":"ContainerStarted","Data":"3b72fa4b1194dcb3089d5baf69beb419896c77752aa4789087cde0bda45a956d"}
Jul 08 07:03:08.253396 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:08.253337    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-999cb578c-s8hj5" podStartSLOduration=2.253318611 podStartE2EDuration="2.253318611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:03:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:03:08.252683342 +0000 UTC m=+458.961966477" watchObservedRunningTime="2026-07-08 07:03:08.253318611 +0000 UTC m=+458.962601722"
Jul 08 07:03:15.223006 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:15.222974    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-6qfnf"
Jul 08 07:03:16.053263 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:16.053229    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-w2rlr"]
Jul 08 07:03:16.059441 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:16.059423    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-w2rlr"
Jul 08 07:03:16.062420 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:16.062393    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-g8j9j\""
Jul 08 07:03:16.062553 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:16.062393    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 08 07:03:16.063624 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:16.063600    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-w2rlr"]
Jul 08 07:03:16.105143 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:16.105108    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55trl\" (UniqueName: \"kubernetes.io/projected/22a143a3-c94f-4e09-b86b-205e97289e5b-kube-api-access-55trl\") pod \"s3-init-w2rlr\" (UID: \"22a143a3-c94f-4e09-b86b-205e97289e5b\") " pod="kserve/s3-init-w2rlr"
Jul 08 07:03:16.105295 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:16.105191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22a143a3-c94f-4e09-b86b-205e97289e5b-model-cache\") pod \"s3-init-w2rlr\" (UID: \"22a143a3-c94f-4e09-b86b-205e97289e5b\") " pod="kserve/s3-init-w2rlr"
Jul 08 07:03:16.205645 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:16.205608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55trl\" (UniqueName: \"kubernetes.io/projected/22a143a3-c94f-4e09-b86b-205e97289e5b-kube-api-access-55trl\") pod \"s3-init-w2rlr\" (UID: \"22a143a3-c94f-4e09-b86b-205e97289e5b\") " pod="kserve/s3-init-w2rlr"
Jul 08 07:03:16.205804 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:16.205682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22a143a3-c94f-4e09-b86b-205e97289e5b-model-cache\") pod \"s3-init-w2rlr\" (UID: \"22a143a3-c94f-4e09-b86b-205e97289e5b\") " pod="kserve/s3-init-w2rlr"
Jul 08 07:03:16.206050 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:16.206031    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22a143a3-c94f-4e09-b86b-205e97289e5b-model-cache\") pod \"s3-init-w2rlr\" (UID: \"22a143a3-c94f-4e09-b86b-205e97289e5b\") " pod="kserve/s3-init-w2rlr"
Jul 08 07:03:16.214409 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:16.214380    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55trl\" (UniqueName: \"kubernetes.io/projected/22a143a3-c94f-4e09-b86b-205e97289e5b-kube-api-access-55trl\") pod \"s3-init-w2rlr\" (UID: \"22a143a3-c94f-4e09-b86b-205e97289e5b\") " pod="kserve/s3-init-w2rlr"
Jul 08 07:03:16.377282 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:16.377252    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-w2rlr"
Jul 08 07:03:16.504180 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:16.504054    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-w2rlr"]
Jul 08 07:03:16.507004 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:03:16.506977    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22a143a3_c94f_4e09_b86b_205e97289e5b.slice/crio-664221ecc6d8c75ec5a35e1769a536e98f10dc1e0c23de15426ce3f8a0f9a6cc WatchSource:0}: Error finding container 664221ecc6d8c75ec5a35e1769a536e98f10dc1e0c23de15426ce3f8a0f9a6cc: Status 404 returned error can't find the container with id 664221ecc6d8c75ec5a35e1769a536e98f10dc1e0c23de15426ce3f8a0f9a6cc
Jul 08 07:03:17.270645 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:17.270606    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:17.270808 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:17.270681    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:17.277688 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:17.277531    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:17.278155 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:17.278107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-w2rlr" event={"ID":"22a143a3-c94f-4e09-b86b-205e97289e5b","Type":"ContainerStarted","Data":"664221ecc6d8c75ec5a35e1769a536e98f10dc1e0c23de15426ce3f8a0f9a6cc"}
Jul 08 07:03:18.287837 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:18.287806    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-999cb578c-s8hj5"
Jul 08 07:03:18.446457 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:18.446425    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:03:18.544716 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:18.544629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:03:18.610484 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:18.610448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:03:21.299384 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:21.299297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-w2rlr" event={"ID":"22a143a3-c94f-4e09-b86b-205e97289e5b","Type":"ContainerStarted","Data":"cc82d50223ef515b61f53bec4110c926f215f99c111653db8711f9c920aa264f"}
Jul 08 07:03:23.309934 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:23.309896    2565 generic.go:356] "Generic (PLEG): container finished" podID="22a143a3-c94f-4e09-b86b-205e97289e5b" containerID="cc82d50223ef515b61f53bec4110c926f215f99c111653db8711f9c920aa264f" exitCode=0
Jul 08 07:03:23.310322 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:23.309970    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-w2rlr" event={"ID":"22a143a3-c94f-4e09-b86b-205e97289e5b","Type":"ContainerDied","Data":"cc82d50223ef515b61f53bec4110c926f215f99c111653db8711f9c920aa264f"}
Jul 08 07:03:28.334546 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:28.334517    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-w2rlr" event={"ID":"22a143a3-c94f-4e09-b86b-205e97289e5b","Type":"ContainerStarted","Data":"f91f73221cdf5764ba1af86d3b0ada99fb75165cc4b1335622d44a42a1a00bee"}
Jul 08 07:03:28.351447 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:28.351371    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-w2rlr" podStartSLOduration=1.867097089 podStartE2EDuration="12.351353107s" totalImagesPullingTime="8.889972527s" totalInitContainerRuntime="1.594283491s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:03:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:03:28.351281492 +0000 UTC m=+479.060564603" watchObservedRunningTime="2026-07-08 07:03:28.351353107 +0000 UTC m=+479.060636217"
Jul 08 07:03:59.667483 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:03:59.667453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:04:33.611156 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:33.611122    2565 generic.go:356] "Generic (PLEG): container finished" podID="22a143a3-c94f-4e09-b86b-205e97289e5b" containerID="f91f73221cdf5764ba1af86d3b0ada99fb75165cc4b1335622d44a42a1a00bee" exitCode=0
Jul 08 07:04:33.611576 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:33.611182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-w2rlr" event={"ID":"22a143a3-c94f-4e09-b86b-205e97289e5b","Type":"ContainerDied","Data":"f91f73221cdf5764ba1af86d3b0ada99fb75165cc4b1335622d44a42a1a00bee"}
Jul 08 07:04:34.748492 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:34.748468    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-w2rlr"
Jul 08 07:04:34.811319 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:34.811286    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22a143a3-c94f-4e09-b86b-205e97289e5b-model-cache\") pod \"22a143a3-c94f-4e09-b86b-205e97289e5b\" (UID: \"22a143a3-c94f-4e09-b86b-205e97289e5b\") "
Jul 08 07:04:34.811505 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:34.811333    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55trl\" (UniqueName: \"kubernetes.io/projected/22a143a3-c94f-4e09-b86b-205e97289e5b-kube-api-access-55trl\") pod \"22a143a3-c94f-4e09-b86b-205e97289e5b\" (UID: \"22a143a3-c94f-4e09-b86b-205e97289e5b\") "
Jul 08 07:04:34.813637 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:34.813610    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22a143a3-c94f-4e09-b86b-205e97289e5b-kube-api-access-55trl" (OuterVolumeSpecName: "kube-api-access-55trl") pod "22a143a3-c94f-4e09-b86b-205e97289e5b" (UID: "22a143a3-c94f-4e09-b86b-205e97289e5b"). InnerVolumeSpecName "kube-api-access-55trl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:04:34.829453 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:34.829419    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22a143a3-c94f-4e09-b86b-205e97289e5b-model-cache" (OuterVolumeSpecName: "model-cache") pod "22a143a3-c94f-4e09-b86b-205e97289e5b" (UID: "22a143a3-c94f-4e09-b86b-205e97289e5b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:04:34.912674 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:34.912584    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22a143a3-c94f-4e09-b86b-205e97289e5b-model-cache\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:04:34.912674 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:34.912624    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55trl\" (UniqueName: \"kubernetes.io/projected/22a143a3-c94f-4e09-b86b-205e97289e5b-kube-api-access-55trl\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:04:35.620865 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:35.620838    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-w2rlr"
Jul 08 07:04:35.621034 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:35.620835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-w2rlr" event={"ID":"22a143a3-c94f-4e09-b86b-205e97289e5b","Type":"ContainerDied","Data":"664221ecc6d8c75ec5a35e1769a536e98f10dc1e0c23de15426ce3f8a0f9a6cc"}
Jul 08 07:04:35.621034 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:35.620947    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="664221ecc6d8c75ec5a35e1769a536e98f10dc1e0c23de15426ce3f8a0f9a6cc"
Jul 08 07:04:36.036666 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:36.036573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:04:36.123206 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:36.123174    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:04:46.431136 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:46.431097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:04:47.365289 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.365259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:04:47.408056 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.408026    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"]
Jul 08 07:04:47.408581 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.408564    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22a143a3-c94f-4e09-b86b-205e97289e5b" containerName="s3-init"
Jul 08 07:04:47.408629 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.408584    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="22a143a3-c94f-4e09-b86b-205e97289e5b" containerName="s3-init"
Jul 08 07:04:47.408629 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.408610    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22a143a3-c94f-4e09-b86b-205e97289e5b" containerName="download-hf-model"
Jul 08 07:04:47.408629 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.408619    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="22a143a3-c94f-4e09-b86b-205e97289e5b" containerName="download-hf-model"
Jul 08 07:04:47.408721 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.408712    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="22a143a3-c94f-4e09-b86b-205e97289e5b" containerName="s3-init"
Jul 08 07:04:47.412509 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.412495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:04:47.415151 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.415130    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-5f3f4-predictor-serving-cert\""
Jul 08 07:04:47.415362 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.415132    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 07:04:47.415362 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.415132    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-5f3f4-kube-rbac-proxy-sar-config\""
Jul 08 07:04:47.415537 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.415197    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 07:04:47.416260 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.416240    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-jrfgb\""
Jul 08 07:04:47.418313 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.418294    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"]
Jul 08 07:04:47.520297 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.520268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xqz7\" (UniqueName: \"kubernetes.io/projected/e59105be-be31-4150-9823-55038ec67f7d-kube-api-access-6xqz7\") pod \"success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2\" (UID: \"e59105be-be31-4150-9823-55038ec67f7d\") " pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:04:47.520652 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.520311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e59105be-be31-4150-9823-55038ec67f7d-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2\" (UID: \"e59105be-be31-4150-9823-55038ec67f7d\") " pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:04:47.520652 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.520437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e59105be-be31-4150-9823-55038ec67f7d-proxy-tls\") pod \"success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2\" (UID: \"e59105be-be31-4150-9823-55038ec67f7d\") " pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:04:47.621676 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.621601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e59105be-be31-4150-9823-55038ec67f7d-proxy-tls\") pod \"success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2\" (UID: \"e59105be-be31-4150-9823-55038ec67f7d\") " pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:04:47.621816 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:04:47.621788    2565 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-serving-cert: secret "success-200-isvc-5f3f4-predictor-serving-cert" not found
Jul 08 07:04:47.621883 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:04:47.621870    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e59105be-be31-4150-9823-55038ec67f7d-proxy-tls podName:e59105be-be31-4150-9823-55038ec67f7d nodeName:}" failed. No retries permitted until 2026-07-08 07:04:48.121846909 +0000 UTC m=+558.831130013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/e59105be-be31-4150-9823-55038ec67f7d-proxy-tls") pod "success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" (UID: "e59105be-be31-4150-9823-55038ec67f7d") : secret "success-200-isvc-5f3f4-predictor-serving-cert" not found
Jul 08 07:04:47.621952 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.621892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xqz7\" (UniqueName: \"kubernetes.io/projected/e59105be-be31-4150-9823-55038ec67f7d-kube-api-access-6xqz7\") pod \"success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2\" (UID: \"e59105be-be31-4150-9823-55038ec67f7d\") " pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:04:47.622015 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.621948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e59105be-be31-4150-9823-55038ec67f7d-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2\" (UID: \"e59105be-be31-4150-9823-55038ec67f7d\") " pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:04:47.622599 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.622581    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e59105be-be31-4150-9823-55038ec67f7d-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2\" (UID: \"e59105be-be31-4150-9823-55038ec67f7d\") " pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:04:47.633370 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.633344    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xqz7\" (UniqueName: \"kubernetes.io/projected/e59105be-be31-4150-9823-55038ec67f7d-kube-api-access-6xqz7\") pod \"success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2\" (UID: \"e59105be-be31-4150-9823-55038ec67f7d\") " pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:04:47.680215 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.680180    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:04:47.711518 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.711485    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"]
Jul 08 07:04:47.715090 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.715058    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.717882 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.717857    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 08 07:04:47.718002 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.717855    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
Jul 08 07:04:47.718002 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.717858    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 08 07:04:47.718002 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.717858    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
Jul 08 07:04:47.724494 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.724470    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"]
Jul 08 07:04:47.781421 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.781394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:04:47.806550 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.806525    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"]
Jul 08 07:04:47.810061 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.810043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:47.812381 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.812358    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\""
Jul 08 07:04:47.812642 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.812618    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\""
Jul 08 07:04:47.820597 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.820574    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"]
Jul 08 07:04:47.824033 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.824009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/280a44d5-2bc1-4725-8f3d-d4a612104733-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.824162 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.824067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82jl5\" (UniqueName: \"kubernetes.io/projected/280a44d5-2bc1-4725-8f3d-d4a612104733-kube-api-access-82jl5\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.824162 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.824117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/280a44d5-2bc1-4725-8f3d-d4a612104733-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.824162 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.824133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/280a44d5-2bc1-4725-8f3d-d4a612104733-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.824162 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.824150    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/280a44d5-2bc1-4725-8f3d-d4a612104733-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.881662 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.881572    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:04:47.924527 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.924500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82jl5\" (UniqueName: \"kubernetes.io/projected/280a44d5-2bc1-4725-8f3d-d4a612104733-kube-api-access-82jl5\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.924658 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.924534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d21beba8-93c5-43ba-8d7e-2095dc7ea000-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:47.924658 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.924558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/280a44d5-2bc1-4725-8f3d-d4a612104733-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.924729 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.924670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/280a44d5-2bc1-4725-8f3d-d4a612104733-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.924729 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.924704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/280a44d5-2bc1-4725-8f3d-d4a612104733-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.924824 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.924736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:47.924886 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.924833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:47.924886 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:04:47.924856    2565 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 08 07:04:47.924960 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.924889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx9rq\" (UniqueName: \"kubernetes.io/projected/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kube-api-access-wx9rq\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:47.924997 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:04:47.924965    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/280a44d5-2bc1-4725-8f3d-d4a612104733-proxy-tls podName:280a44d5-2bc1-4725-8f3d-d4a612104733 nodeName:}" failed. No retries permitted until 2026-07-08 07:04:48.424942182 +0000 UTC m=+559.134225272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/280a44d5-2bc1-4725-8f3d-d4a612104733-proxy-tls") pod "isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" (UID: "280a44d5-2bc1-4725-8f3d-d4a612104733") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 08 07:04:47.925055 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.925001    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/280a44d5-2bc1-4725-8f3d-d4a612104733-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.925055 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.925020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d21beba8-93c5-43ba-8d7e-2095dc7ea000-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:47.925177 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.925092    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/280a44d5-2bc1-4725-8f3d-d4a612104733-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.925396 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.925379    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/280a44d5-2bc1-4725-8f3d-d4a612104733-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.925605 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.925590    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/280a44d5-2bc1-4725-8f3d-d4a612104733-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.934221 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.934193    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82jl5\" (UniqueName: \"kubernetes.io/projected/280a44d5-2bc1-4725-8f3d-d4a612104733-kube-api-access-82jl5\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:47.982517 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:47.982475    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:04:48.005655 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.005624    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"]
Jul 08 07:04:48.010317 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.010297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.012942 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.012918    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\""
Jul 08 07:04:48.012942 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.012930    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\""
Jul 08 07:04:48.017488 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.017468    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"]
Jul 08 07:04:48.025929 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.025911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d21beba8-93c5-43ba-8d7e-2095dc7ea000-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:48.026034 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.026002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:48.026105 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.026060    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:48.026105 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.026097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx9rq\" (UniqueName: \"kubernetes.io/projected/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kube-api-access-wx9rq\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:48.026214 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.026135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d21beba8-93c5-43ba-8d7e-2095dc7ea000-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:48.026437 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.026420    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:48.026766 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.026744    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d21beba8-93c5-43ba-8d7e-2095dc7ea000-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:48.026846 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.026793    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:48.028517 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.028500    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d21beba8-93c5-43ba-8d7e-2095dc7ea000-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:48.036867 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.036846    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx9rq\" (UniqueName: \"kubernetes.io/projected/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kube-api-access-wx9rq\") pod \"isvc-xgboost-graph-predictor-555fc69d56-q44ln\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:48.082526 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.082500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:04:48.121145 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.121124    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:04:48.127458 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.127429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e59105be-be31-4150-9823-55038ec67f7d-proxy-tls\") pod \"success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2\" (UID: \"e59105be-be31-4150-9823-55038ec67f7d\") " pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:04:48.127657 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.127628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.128095 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.127722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp8t2\" (UniqueName: \"kubernetes.io/projected/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kube-api-access-wp8t2\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.128095 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.127752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.128095 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.127946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.128095 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.127986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.130133 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.130106    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e59105be-be31-4150-9823-55038ec67f7d-proxy-tls\") pod \"success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2\" (UID: \"e59105be-be31-4150-9823-55038ec67f7d\") " pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:04:48.183614 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.183578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:04:48.228888 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.228858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.229038 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.228904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8t2\" (UniqueName: \"kubernetes.io/projected/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kube-api-access-wp8t2\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.229038 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.228933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.229038 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.229014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.229223 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.229038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.229525 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.229442    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.229805 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.229788    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.229957 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.229934    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.231687 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.231665    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.242297 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.242273    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp8t2\" (UniqueName: \"kubernetes.io/projected/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kube-api-access-wp8t2\") pod \"isvc-sklearn-graph-2-predictor-84b568d556-btqhc\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.255274 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.255253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"]
Jul 08 07:04:48.257093 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:04:48.257047    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21beba8_93c5_43ba_8d7e_2095dc7ea000.slice/crio-3be11377cc0dd758eabad859183efc7c3b2bab88a3244b499f9302ca3af61b1c WatchSource:0}: Error finding container 3be11377cc0dd758eabad859183efc7c3b2bab88a3244b499f9302ca3af61b1c: Status 404 returned error can't find the container with id 3be11377cc0dd758eabad859183efc7c3b2bab88a3244b499f9302ca3af61b1c
Jul 08 07:04:48.322470 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.322451    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:04:48.324604 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.324583    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:04:48.432004 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.431858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/280a44d5-2bc1-4725-8f3d-d4a612104733-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:48.434288 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.434266    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/280a44d5-2bc1-4725-8f3d-d4a612104733-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:48.470638 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.470610    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"]
Jul 08 07:04:48.471900 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:04:48.471876    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb0ddef5_beb8_45f1_8ce5_bbc7588f0c5c.slice/crio-0dd5d6c5f0e634ba1f3971bb9af188e2eb5366ca5a4dbcd87a785193828d011d WatchSource:0}: Error finding container 0dd5d6c5f0e634ba1f3971bb9af188e2eb5366ca5a4dbcd87a785193828d011d: Status 404 returned error can't find the container with id 0dd5d6c5f0e634ba1f3971bb9af188e2eb5366ca5a4dbcd87a785193828d011d
Jul 08 07:04:48.495454 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.495430    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"]
Jul 08 07:04:48.506330 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:04:48.506307    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59105be_be31_4150_9823_55038ec67f7d.slice/crio-5dd2be4e06a95656e24cd02da598fb6a873bfc32665056ab276c0d44c41626e0 WatchSource:0}: Error finding container 5dd2be4e06a95656e24cd02da598fb6a873bfc32665056ab276c0d44c41626e0: Status 404 returned error can't find the container with id 5dd2be4e06a95656e24cd02da598fb6a873bfc32665056ab276c0d44c41626e0
Jul 08 07:04:48.628280 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.628242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:04:48.679280 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.679237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" event={"ID":"d21beba8-93c5-43ba-8d7e-2095dc7ea000","Type":"ContainerStarted","Data":"0c07f1aa9d801a0b432e5115ed0d617839786c4b1f4150bc02bc86fc4de68c2d"}
Jul 08 07:04:48.679456 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.679330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" event={"ID":"d21beba8-93c5-43ba-8d7e-2095dc7ea000","Type":"ContainerStarted","Data":"3be11377cc0dd758eabad859183efc7c3b2bab88a3244b499f9302ca3af61b1c"}
Jul 08 07:04:48.680978 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.680934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" event={"ID":"e59105be-be31-4150-9823-55038ec67f7d","Type":"ContainerStarted","Data":"5dd2be4e06a95656e24cd02da598fb6a873bfc32665056ab276c0d44c41626e0"}
Jul 08 07:04:48.694337 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.694307    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" event={"ID":"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c","Type":"ContainerStarted","Data":"d8baf838a944f1102e5e8e6330824f9c8eaca791b91a542dbbbf5390cecdfe80"}
Jul 08 07:04:48.694443 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.694375    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" event={"ID":"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c","Type":"ContainerStarted","Data":"0dd5d6c5f0e634ba1f3971bb9af188e2eb5366ca5a4dbcd87a785193828d011d"}
Jul 08 07:04:48.782429 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:48.782398    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"]
Jul 08 07:04:48.784735 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:04:48.784704    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280a44d5_2bc1_4725_8f3d_d4a612104733.slice/crio-c283bb3d0ac7741d62ba73fb6ac9cb4196c809d00e8c162362499b3a703d4587 WatchSource:0}: Error finding container c283bb3d0ac7741d62ba73fb6ac9cb4196c809d00e8c162362499b3a703d4587: Status 404 returned error can't find the container with id c283bb3d0ac7741d62ba73fb6ac9cb4196c809d00e8c162362499b3a703d4587
Jul 08 07:04:49.711647 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:49.711600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" event={"ID":"280a44d5-2bc1-4725-8f3d-d4a612104733","Type":"ContainerStarted","Data":"a89fc79b8366612a16ada95ad943ee8fe4ce0d17e361fcf3824282ea968948e8"}
Jul 08 07:04:49.712124 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:49.711667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" event={"ID":"280a44d5-2bc1-4725-8f3d-d4a612104733","Type":"ContainerStarted","Data":"c283bb3d0ac7741d62ba73fb6ac9cb4196c809d00e8c162362499b3a703d4587"}
Jul 08 07:04:53.747577 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:53.747545    2565 generic.go:356] "Generic (PLEG): container finished" podID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerID="0c07f1aa9d801a0b432e5115ed0d617839786c4b1f4150bc02bc86fc4de68c2d" exitCode=0
Jul 08 07:04:53.748062 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:53.747617    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" event={"ID":"d21beba8-93c5-43ba-8d7e-2095dc7ea000","Type":"ContainerDied","Data":"0c07f1aa9d801a0b432e5115ed0d617839786c4b1f4150bc02bc86fc4de68c2d"}
Jul 08 07:04:53.749268 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:53.749246    2565 generic.go:356] "Generic (PLEG): container finished" podID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerID="a89fc79b8366612a16ada95ad943ee8fe4ce0d17e361fcf3824282ea968948e8" exitCode=0
Jul 08 07:04:53.749347 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:53.749322    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" event={"ID":"280a44d5-2bc1-4725-8f3d-d4a612104733","Type":"ContainerDied","Data":"a89fc79b8366612a16ada95ad943ee8fe4ce0d17e361fcf3824282ea968948e8"}
Jul 08 07:04:53.750927 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:53.750836    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerID="d8baf838a944f1102e5e8e6330824f9c8eaca791b91a542dbbbf5390cecdfe80" exitCode=0
Jul 08 07:04:53.750927 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:04:53.750881    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" event={"ID":"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c","Type":"ContainerDied","Data":"d8baf838a944f1102e5e8e6330824f9c8eaca791b91a542dbbbf5390cecdfe80"}
Jul 08 07:05:21.959940 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:21.959897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" event={"ID":"280a44d5-2bc1-4725-8f3d-d4a612104733","Type":"ContainerStarted","Data":"584826d96ca08cd8e724dc17fae38ea6e4410001150d46f0b8e686067c6da161"}
Jul 08 07:05:21.962392 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:21.962360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" event={"ID":"e59105be-be31-4150-9823-55038ec67f7d","Type":"ContainerStarted","Data":"ddb40819cfa8ba37c31a510a2f31497b11219061e6d2224712a0cb3868499512"}
Jul 08 07:05:21.965241 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:21.965215    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" event={"ID":"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c","Type":"ContainerStarted","Data":"9bb92dd943181ad861b56c0d5bd99c45aa6afcaf9f5c2ffd3208520c61520073"}
Jul 08 07:05:22.992425 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:22.992385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" event={"ID":"d21beba8-93c5-43ba-8d7e-2095dc7ea000","Type":"ContainerStarted","Data":"bdc12e2ad5e389c1c522ada5af75210552316ee44370ff8970c9a0acc8135b3d"}
Jul 08 07:05:25.014567 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.014529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" event={"ID":"d21beba8-93c5-43ba-8d7e-2095dc7ea000","Type":"ContainerStarted","Data":"0f40375bb345aa34cb15d0153c87393526ea56c5acc651e5fd6af35433e1aa96"}
Jul 08 07:05:25.014900 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.014660    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:05:25.014900 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.014724    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:05:25.016156 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.016117    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:05:25.017646 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.017624    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" event={"ID":"280a44d5-2bc1-4725-8f3d-d4a612104733","Type":"ContainerStarted","Data":"28ca2c1466350cc111bf05e706e6140bddd3fcc8281e6198dd04b459af22c57b"}
Jul 08 07:05:25.017748 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.017672    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:05:25.017748 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.017729    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:05:25.018992 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.018972    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 08 07:05:25.019786 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.019768    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" event={"ID":"e59105be-be31-4150-9823-55038ec67f7d","Type":"ContainerStarted","Data":"40cc630621546df07302f0ab3ebcc161646929f48161da8a0e0b71aff10f2f73"}
Jul 08 07:05:25.019842 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.019819    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:05:25.019881 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.019852    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:05:25.020866 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.020844    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 08 07:05:25.021874 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.021845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" event={"ID":"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c","Type":"ContainerStarted","Data":"c91ad0996ec625cb84a2a14cd0e6f5a29a2bc4ab1277a948f4cc3bba74fa07ad"}
Jul 08 07:05:25.022234 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.022219    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:05:25.022274 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.022265    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:05:25.022915 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.022898    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 08 07:05:25.035604 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.035563    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" podStartSLOduration=3.00742994 podStartE2EDuration="38.035550905s" totalImagesPullingTime="31.050200044s" totalInitContainerRuntime="3.977920921s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:04:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:05:25.033064522 +0000 UTC m=+595.742347625" watchObservedRunningTime="2026-07-08 07:05:25.035550905 +0000 UTC m=+595.744834014"
Jul 08 07:05:25.049774 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.049728    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" podStartSLOduration=10.317202011 podStartE2EDuration="38.049713042s" totalImagesPullingTime="27.732511031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:04:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:05:25.048924561 +0000 UTC m=+595.758207682" watchObservedRunningTime="2026-07-08 07:05:25.049713042 +0000 UTC m=+595.758996152"
Jul 08 07:05:25.067330 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.067292    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podStartSLOduration=3.354921613 podStartE2EDuration="38.067279891s" totalImagesPullingTime="30.965596109s" totalInitContainerRuntime="3.746762169s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:04:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:05:25.065294638 +0000 UTC m=+595.774577749" watchObservedRunningTime="2026-07-08 07:05:25.067279891 +0000 UTC m=+595.776563001"
Jul 08 07:05:25.085137 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:25.084015    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podStartSLOduration=3.112975388 podStartE2EDuration="38.083997389s" totalImagesPullingTime="31.014753617s" totalInitContainerRuntime="3.956268384s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:04:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:05:25.083573095 +0000 UTC m=+595.792856205" watchObservedRunningTime="2026-07-08 07:05:25.083997389 +0000 UTC m=+595.793280500"
Jul 08 07:05:26.027675 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:26.027636    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:05:26.028127 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:26.027750    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 08 07:05:26.028217 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:26.028194    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 08 07:05:26.028272 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:26.028194    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 08 07:05:30.888722 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:30.888691    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:05:30.889717 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:30.889694    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:05:31.036785 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:31.036758    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:05:31.036948 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:31.036846    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:05:31.037043 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:31.037025    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:05:31.037118 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:31.037108    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:05:31.037486 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:31.037457    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:05:31.037584 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:31.037519    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 08 07:05:31.037584 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:31.037524    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 08 07:05:31.038022 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:31.038004    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 08 07:05:35.630487 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:35.630447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:05:41.037540 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:41.037500    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 08 07:05:41.216202 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:41.037504    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 08 07:05:41.216202 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:41.037503    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:05:41.216202 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:41.038002    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 08 07:05:51.038476 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:51.038438    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 08 07:05:51.038951 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:51.038439    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:05:51.038951 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:51.038442    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 08 07:05:51.038951 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:05:51.038442    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 08 07:06:01.037543 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:01.037504    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 08 07:06:01.037543 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:01.037531    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 08 07:06:01.038018 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:01.037531    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:06:01.038774 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:01.038751    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 08 07:06:11.038445 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:11.038405    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 08 07:06:11.038445 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:11.038423    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 08 07:06:11.038445 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:11.038430    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 08 07:06:11.038989 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:11.038423    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:06:15.228414 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:15.228383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:06:16.453950 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:16.453916    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:06:19.618575 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:19.618545    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:06:21.038203 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:21.038158    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:06:21.038203 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:21.038175    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 08 07:06:21.038685 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:21.038166    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 08 07:06:21.038766 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:21.038752    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:06:31.038273 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:31.038235    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 08 07:06:31.038273 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:31.038248    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 08 07:06:31.038878 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:31.038789    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:06:37.520860 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:37.520830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:06:37.751491 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:37.751457    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:06:41.038955 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:41.038922    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:06:41.039388 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:41.039004    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:06:47.677669 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.677620    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:06:47.863474 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.863442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:06:47.902463 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.902425    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"]
Jul 08 07:06:47.905744 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.905721    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:47.908386 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.908358    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-104b4-predictor-serving-cert\""
Jul 08 07:06:47.908386 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.908384    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-104b4-kube-rbac-proxy-sar-config\""
Jul 08 07:06:47.916284 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.916259    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"]
Jul 08 07:06:47.927622 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.927595    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"]
Jul 08 07:06:47.927951 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.927844    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kserve-container" containerID="cri-o://ddb40819cfa8ba37c31a510a2f31497b11219061e6d2224712a0cb3868499512" gracePeriod=30
Jul 08 07:06:47.927951 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.927922    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kube-rbac-proxy" containerID="cri-o://40cc630621546df07302f0ab3ebcc161646929f48161da8a0e0b71aff10f2f73" gracePeriod=30
Jul 08 07:06:47.938350 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.938321    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:06:47.971709 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.971672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czlpg\" (UniqueName: \"kubernetes.io/projected/70459ada-619e-43a1-845f-515035cd7c7b-kube-api-access-czlpg\") pod \"success-200-isvc-104b4-predictor-65665c5848-4gb7r\" (UID: \"70459ada-619e-43a1-845f-515035cd7c7b\") " pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:47.971871 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.971716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/70459ada-619e-43a1-845f-515035cd7c7b-proxy-tls\") pod \"success-200-isvc-104b4-predictor-65665c5848-4gb7r\" (UID: \"70459ada-619e-43a1-845f-515035cd7c7b\") " pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:47.971871 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:47.971748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/70459ada-619e-43a1-845f-515035cd7c7b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-104b4-predictor-65665c5848-4gb7r\" (UID: \"70459ada-619e-43a1-845f-515035cd7c7b\") " pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:48.006770 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.006736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:06:48.073090 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.073049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czlpg\" (UniqueName: \"kubernetes.io/projected/70459ada-619e-43a1-845f-515035cd7c7b-kube-api-access-czlpg\") pod \"success-200-isvc-104b4-predictor-65665c5848-4gb7r\" (UID: \"70459ada-619e-43a1-845f-515035cd7c7b\") " pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:48.073269 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.073133    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/70459ada-619e-43a1-845f-515035cd7c7b-proxy-tls\") pod \"success-200-isvc-104b4-predictor-65665c5848-4gb7r\" (UID: \"70459ada-619e-43a1-845f-515035cd7c7b\") " pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:48.073269 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.073159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/70459ada-619e-43a1-845f-515035cd7c7b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-104b4-predictor-65665c5848-4gb7r\" (UID: \"70459ada-619e-43a1-845f-515035cd7c7b\") " pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:48.073888 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.073860    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/70459ada-619e-43a1-845f-515035cd7c7b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-104b4-predictor-65665c5848-4gb7r\" (UID: \"70459ada-619e-43a1-845f-515035cd7c7b\") " pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:48.075601 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.075580    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/70459ada-619e-43a1-845f-515035cd7c7b-proxy-tls\") pod \"success-200-isvc-104b4-predictor-65665c5848-4gb7r\" (UID: \"70459ada-619e-43a1-845f-515035cd7c7b\") " pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:48.080885 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.080865    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czlpg\" (UniqueName: \"kubernetes.io/projected/70459ada-619e-43a1-845f-515035cd7c7b-kube-api-access-czlpg\") pod \"success-200-isvc-104b4-predictor-65665c5848-4gb7r\" (UID: \"70459ada-619e-43a1-845f-515035cd7c7b\") " pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:48.104476 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.104447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:06:48.217326 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.217227    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:48.361470 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.361447    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"]
Jul 08 07:06:48.363211 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:06:48.363187    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70459ada_619e_43a1_845f_515035cd7c7b.slice/crio-ec9ea648b51261245d1bc30297ae5cd3a88f04855d218cd4fc74f1c0e2110873 WatchSource:0}: Error finding container ec9ea648b51261245d1bc30297ae5cd3a88f04855d218cd4fc74f1c0e2110873: Status 404 returned error can't find the container with id ec9ea648b51261245d1bc30297ae5cd3a88f04855d218cd4fc74f1c0e2110873
Jul 08 07:06:48.453814 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.453777    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" event={"ID":"70459ada-619e-43a1-845f-515035cd7c7b","Type":"ContainerStarted","Data":"f4caa95bdd11432d2111246cee9225bddf86a83e578f09e2c32776d507b0c83b"}
Jul 08 07:06:48.454146 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.454104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" event={"ID":"70459ada-619e-43a1-845f-515035cd7c7b","Type":"ContainerStarted","Data":"ec9ea648b51261245d1bc30297ae5cd3a88f04855d218cd4fc74f1c0e2110873"}
Jul 08 07:06:48.455691 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.455670    2565 generic.go:356] "Generic (PLEG): container finished" podID="e59105be-be31-4150-9823-55038ec67f7d" containerID="40cc630621546df07302f0ab3ebcc161646929f48161da8a0e0b71aff10f2f73" exitCode=2
Jul 08 07:06:48.455806 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.455736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" event={"ID":"e59105be-be31-4150-9823-55038ec67f7d","Type":"ContainerDied","Data":"40cc630621546df07302f0ab3ebcc161646929f48161da8a0e0b71aff10f2f73"}
Jul 08 07:06:48.504271 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:48.504237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:06:49.463881 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:49.463842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" event={"ID":"70459ada-619e-43a1-845f-515035cd7c7b","Type":"ContainerStarted","Data":"657dc055bd9668075b978fb0ccc1147a1c8765390f7713850b4b4d8476b34aa6"}
Jul 08 07:06:49.464302 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:49.463930    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:49.464302 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:49.463978    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:49.465386 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:49.465361    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 08 07:06:49.482565 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:49.482498    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" podStartSLOduration=2.48247411 podStartE2EDuration="2.48247411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:06:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:06:49.481004273 +0000 UTC m=+680.190287388" watchObservedRunningTime="2026-07-08 07:06:49.48247411 +0000 UTC m=+680.191757224"
Jul 08 07:06:50.469064 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:50.469021    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 08 07:06:51.028223 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.028158    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.26:8643/healthz\": dial tcp 10.134.0.26:8643: connect: connection refused"
Jul 08 07:06:51.038351 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.038306    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 08 07:06:51.191938 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.191912    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:06:51.300963 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.300877    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e59105be-be31-4150-9823-55038ec67f7d-kube-rbac-proxy-sar-config\") pod \"e59105be-be31-4150-9823-55038ec67f7d\" (UID: \"e59105be-be31-4150-9823-55038ec67f7d\") "
Jul 08 07:06:51.300963 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.300926    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xqz7\" (UniqueName: \"kubernetes.io/projected/e59105be-be31-4150-9823-55038ec67f7d-kube-api-access-6xqz7\") pod \"e59105be-be31-4150-9823-55038ec67f7d\" (UID: \"e59105be-be31-4150-9823-55038ec67f7d\") "
Jul 08 07:06:51.301224 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.301015    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e59105be-be31-4150-9823-55038ec67f7d-proxy-tls\") pod \"e59105be-be31-4150-9823-55038ec67f7d\" (UID: \"e59105be-be31-4150-9823-55038ec67f7d\") "
Jul 08 07:06:51.301394 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.301371    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e59105be-be31-4150-9823-55038ec67f7d-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "e59105be-be31-4150-9823-55038ec67f7d" (UID: "e59105be-be31-4150-9823-55038ec67f7d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:06:51.303163 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.303142    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59105be-be31-4150-9823-55038ec67f7d-kube-api-access-6xqz7" (OuterVolumeSpecName: "kube-api-access-6xqz7") pod "e59105be-be31-4150-9823-55038ec67f7d" (UID: "e59105be-be31-4150-9823-55038ec67f7d"). InnerVolumeSpecName "kube-api-access-6xqz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:06:51.303263 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.303181    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e59105be-be31-4150-9823-55038ec67f7d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e59105be-be31-4150-9823-55038ec67f7d" (UID: "e59105be-be31-4150-9823-55038ec67f7d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:06:51.402241 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.402204    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e59105be-be31-4150-9823-55038ec67f7d-proxy-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:06:51.402241 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.402235    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e59105be-be31-4150-9823-55038ec67f7d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:06:51.402241 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.402246    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xqz7\" (UniqueName: \"kubernetes.io/projected/e59105be-be31-4150-9823-55038ec67f7d-kube-api-access-6xqz7\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:06:51.475175 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.475136    2565 generic.go:356] "Generic (PLEG): container finished" podID="e59105be-be31-4150-9823-55038ec67f7d" containerID="ddb40819cfa8ba37c31a510a2f31497b11219061e6d2224712a0cb3868499512" exitCode=0
Jul 08 07:06:51.475636 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.475194    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"
Jul 08 07:06:51.475636 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.475224    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" event={"ID":"e59105be-be31-4150-9823-55038ec67f7d","Type":"ContainerDied","Data":"ddb40819cfa8ba37c31a510a2f31497b11219061e6d2224712a0cb3868499512"}
Jul 08 07:06:51.475636 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.475283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2" event={"ID":"e59105be-be31-4150-9823-55038ec67f7d","Type":"ContainerDied","Data":"5dd2be4e06a95656e24cd02da598fb6a873bfc32665056ab276c0d44c41626e0"}
Jul 08 07:06:51.475636 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.475310    2565 scope.go:117] "RemoveContainer" containerID="40cc630621546df07302f0ab3ebcc161646929f48161da8a0e0b71aff10f2f73"
Jul 08 07:06:51.485840 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.485822    2565 scope.go:117] "RemoveContainer" containerID="ddb40819cfa8ba37c31a510a2f31497b11219061e6d2224712a0cb3868499512"
Jul 08 07:06:51.493270 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.493253    2565 scope.go:117] "RemoveContainer" containerID="40cc630621546df07302f0ab3ebcc161646929f48161da8a0e0b71aff10f2f73"
Jul 08 07:06:51.493512 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:06:51.493495    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40cc630621546df07302f0ab3ebcc161646929f48161da8a0e0b71aff10f2f73\": container with ID starting with 40cc630621546df07302f0ab3ebcc161646929f48161da8a0e0b71aff10f2f73 not found: ID does not exist" containerID="40cc630621546df07302f0ab3ebcc161646929f48161da8a0e0b71aff10f2f73"
Jul 08 07:06:51.493559 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.493521    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40cc630621546df07302f0ab3ebcc161646929f48161da8a0e0b71aff10f2f73"} err="failed to get container status \"40cc630621546df07302f0ab3ebcc161646929f48161da8a0e0b71aff10f2f73\": rpc error: code = NotFound desc = could not find container \"40cc630621546df07302f0ab3ebcc161646929f48161da8a0e0b71aff10f2f73\": container with ID starting with 40cc630621546df07302f0ab3ebcc161646929f48161da8a0e0b71aff10f2f73 not found: ID does not exist"
Jul 08 07:06:51.493559 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.493538    2565 scope.go:117] "RemoveContainer" containerID="ddb40819cfa8ba37c31a510a2f31497b11219061e6d2224712a0cb3868499512"
Jul 08 07:06:51.493739 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:06:51.493721    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddb40819cfa8ba37c31a510a2f31497b11219061e6d2224712a0cb3868499512\": container with ID starting with ddb40819cfa8ba37c31a510a2f31497b11219061e6d2224712a0cb3868499512 not found: ID does not exist" containerID="ddb40819cfa8ba37c31a510a2f31497b11219061e6d2224712a0cb3868499512"
Jul 08 07:06:51.493778 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.493745    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddb40819cfa8ba37c31a510a2f31497b11219061e6d2224712a0cb3868499512"} err="failed to get container status \"ddb40819cfa8ba37c31a510a2f31497b11219061e6d2224712a0cb3868499512\": rpc error: code = NotFound desc = could not find container \"ddb40819cfa8ba37c31a510a2f31497b11219061e6d2224712a0cb3868499512\": container with ID starting with ddb40819cfa8ba37c31a510a2f31497b11219061e6d2224712a0cb3868499512 not found: ID does not exist"
Jul 08 07:06:51.496904 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.496883    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"]
Jul 08 07:06:51.500839 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:51.500817    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5f3f4-predictor-59799d75f4-nbjg2"]
Jul 08 07:06:53.035264 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:53.035233    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e59105be-be31-4150-9823-55038ec67f7d" path="/var/lib/kubelet/pods/e59105be-be31-4150-9823-55038ec67f7d/volumes"
Jul 08 07:06:55.473535 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:55.473504    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:06:55.474028 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:06:55.474001    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 08 07:07:05.474639 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:05.474594    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 08 07:07:07.493062 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:07.493022    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:07:07.564841 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:07.564810    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:07:15.474849 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:15.474794    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 08 07:07:17.599893 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.599835    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:07:17.651902 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.651867    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"]
Jul 08 07:07:17.652232 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.652184    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kserve-container" containerID="cri-o://bdc12e2ad5e389c1c522ada5af75210552316ee44370ff8970c9a0acc8135b3d" gracePeriod=30
Jul 08 07:07:17.652306 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.652251    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kube-rbac-proxy" containerID="cri-o://0f40375bb345aa34cb15d0153c87393526ea56c5acc651e5fd6af35433e1aa96" gracePeriod=30
Jul 08 07:07:17.681700 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.681674    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:07:17.693601 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.693566    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"]
Jul 08 07:07:17.693890 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.693860    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container" containerID="cri-o://9bb92dd943181ad861b56c0d5bd99c45aa6afcaf9f5c2ffd3208520c61520073" gracePeriod=30
Jul 08 07:07:17.693972 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.693903    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kube-rbac-proxy" containerID="cri-o://c91ad0996ec625cb84a2a14cd0e6f5a29a2bc4ab1277a948f4cc3bba74fa07ad" gracePeriod=30
Jul 08 07:07:17.741462 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.741430    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"]
Jul 08 07:07:17.742542 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.742506    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kserve-container"
Jul 08 07:07:17.742542 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.742538    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kserve-container"
Jul 08 07:07:17.742719 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.742608    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kube-rbac-proxy"
Jul 08 07:07:17.742719 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.742619    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kube-rbac-proxy"
Jul 08 07:07:17.742933 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.742816    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kube-rbac-proxy"
Jul 08 07:07:17.742933 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.742843    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e59105be-be31-4150-9823-55038ec67f7d" containerName="kserve-container"
Jul 08 07:07:17.747105 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.746984    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:07:17.751357 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.751330    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"]
Jul 08 07:07:17.751506 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.751483    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:17.752124 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.752064    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container" containerID="cri-o://584826d96ca08cd8e724dc17fae38ea6e4410001150d46f0b8e686067c6da161" gracePeriod=30
Jul 08 07:07:17.752256 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.752210    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kube-rbac-proxy" containerID="cri-o://28ca2c1466350cc111bf05e706e6140bddd3fcc8281e6198dd04b459af22c57b" gracePeriod=30
Jul 08 07:07:17.754419 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.754306    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1469a-kube-rbac-proxy-sar-config\""
Jul 08 07:07:17.754419 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.754374    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"]
Jul 08 07:07:17.754580 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.754377    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1469a-predictor-serving-cert\""
Jul 08 07:07:17.820475 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.820442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:07:17.848465 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.848441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-proxy-tls\") pod \"success-200-isvc-1469a-predictor-57f964f944-hm9lx\" (UID: \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\") " pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:17.848465 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.848474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kbjb\" (UniqueName: \"kubernetes.io/projected/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-kube-api-access-4kbjb\") pod \"success-200-isvc-1469a-predictor-57f964f944-hm9lx\" (UID: \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\") " pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:17.848675 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.848501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1469a-predictor-57f964f944-hm9lx\" (UID: \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\") " pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:17.921428 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.921382    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:07:17.949594 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.949562    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-proxy-tls\") pod \"success-200-isvc-1469a-predictor-57f964f944-hm9lx\" (UID: \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\") " pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:17.949786 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.949608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kbjb\" (UniqueName: \"kubernetes.io/projected/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-kube-api-access-4kbjb\") pod \"success-200-isvc-1469a-predictor-57f964f944-hm9lx\" (UID: \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\") " pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:17.949786 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.949690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1469a-predictor-57f964f944-hm9lx\" (UID: \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\") " pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:17.950478 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.950449    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1469a-predictor-57f964f944-hm9lx\" (UID: \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\") " pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:17.952292 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.952267    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-proxy-tls\") pod \"success-200-isvc-1469a-predictor-57f964f944-hm9lx\" (UID: \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\") " pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:17.960142 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:17.960120    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kbjb\" (UniqueName: \"kubernetes.io/projected/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-kube-api-access-4kbjb\") pod \"success-200-isvc-1469a-predictor-57f964f944-hm9lx\" (UID: \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\") " pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:18.021269 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.021234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:07:18.077577 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.077538    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:18.136319 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.136270    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:07:18.214015 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.213990    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"]
Jul 08 07:07:18.216642 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:07:18.216613    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ee39b3_58a8_42af_b708_1afdf6c6a7e3.slice/crio-eea663928be17ce5f90900270a32b2514f61387f3ae856e2f92666ec4196580e WatchSource:0}: Error finding container eea663928be17ce5f90900270a32b2514f61387f3ae856e2f92666ec4196580e: Status 404 returned error can't find the container with id eea663928be17ce5f90900270a32b2514f61387f3ae856e2f92666ec4196580e
Jul 08 07:07:18.610090 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.610042    2565 generic.go:356] "Generic (PLEG): container finished" podID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerID="0f40375bb345aa34cb15d0153c87393526ea56c5acc651e5fd6af35433e1aa96" exitCode=2
Jul 08 07:07:18.610597 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.610118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" event={"ID":"d21beba8-93c5-43ba-8d7e-2095dc7ea000","Type":"ContainerDied","Data":"0f40375bb345aa34cb15d0153c87393526ea56c5acc651e5fd6af35433e1aa96"}
Jul 08 07:07:18.612130 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.612107    2565 generic.go:356] "Generic (PLEG): container finished" podID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerID="28ca2c1466350cc111bf05e706e6140bddd3fcc8281e6198dd04b459af22c57b" exitCode=2
Jul 08 07:07:18.612241 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.612182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" event={"ID":"280a44d5-2bc1-4725-8f3d-d4a612104733","Type":"ContainerDied","Data":"28ca2c1466350cc111bf05e706e6140bddd3fcc8281e6198dd04b459af22c57b"}
Jul 08 07:07:18.613910 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.613880    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" event={"ID":"24ee39b3-58a8-42af-b708-1afdf6c6a7e3","Type":"ContainerStarted","Data":"d5bbe9d6ba0b39273ad5f54c46bf67e7705b75a439b3a06abd2432fbcf15ce5a"}
Jul 08 07:07:18.614216 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.613933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" event={"ID":"24ee39b3-58a8-42af-b708-1afdf6c6a7e3","Type":"ContainerStarted","Data":"1fc748bf89a03e80fb1996a0c8607fc99fdfc430c24d2373c5da4fb22c65e14e"}
Jul 08 07:07:18.614216 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.614054    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:18.614216 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.614112    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" event={"ID":"24ee39b3-58a8-42af-b708-1afdf6c6a7e3","Type":"ContainerStarted","Data":"eea663928be17ce5f90900270a32b2514f61387f3ae856e2f92666ec4196580e"}
Jul 08 07:07:18.615913 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.615894    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerID="c91ad0996ec625cb84a2a14cd0e6f5a29a2bc4ab1277a948f4cc3bba74fa07ad" exitCode=2
Jul 08 07:07:18.616001 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.615955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" event={"ID":"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c","Type":"ContainerDied","Data":"c91ad0996ec625cb84a2a14cd0e6f5a29a2bc4ab1277a948f4cc3bba74fa07ad"}
Jul 08 07:07:18.631811 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:18.631745    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" podStartSLOduration=1.63172492 podStartE2EDuration="1.63172492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:07:18.631238471 +0000 UTC m=+709.340521582" watchObservedRunningTime="2026-07-08 07:07:18.63172492 +0000 UTC m=+709.341008035"
Jul 08 07:07:19.621146 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:19.621110    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:19.622376 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:19.622346    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:07:20.625489 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:20.625443    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:07:21.028694 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:21.028603    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Jul 08 07:07:21.028694 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:21.028595    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 08 07:07:21.028694 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:21.028603    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 08 07:07:21.038330 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:21.038300    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 08 07:07:21.038494 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:21.038299    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 08 07:07:21.038494 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:21.038305    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 08 07:07:22.636827 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.636797    2565 generic.go:356] "Generic (PLEG): container finished" podID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerID="bdc12e2ad5e389c1c522ada5af75210552316ee44370ff8970c9a0acc8135b3d" exitCode=0
Jul 08 07:07:22.637201 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.636870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" event={"ID":"d21beba8-93c5-43ba-8d7e-2095dc7ea000","Type":"ContainerDied","Data":"bdc12e2ad5e389c1c522ada5af75210552316ee44370ff8970c9a0acc8135b3d"}
Jul 08 07:07:22.762927 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.762860    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:07:22.859367 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.859339    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:07:22.887449 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.887412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d21beba8-93c5-43ba-8d7e-2095dc7ea000-proxy-tls\") pod \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") "
Jul 08 07:07:22.887449 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.887458    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-cabundle-cert\") pod \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") "
Jul 08 07:07:22.887713 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.887493    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-proxy-tls\") pod \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") "
Jul 08 07:07:22.887713 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.887524    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kserve-provision-location\") pod \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") "
Jul 08 07:07:22.887713 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.887600    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kube-rbac-proxy-sar-config\") pod \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") "
Jul 08 07:07:22.887713 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.887648    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kserve-provision-location\") pod \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") "
Jul 08 07:07:22.887713 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.887671    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp8t2\" (UniqueName: \"kubernetes.io/projected/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kube-api-access-wp8t2\") pod \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\" (UID: \"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c\") "
Jul 08 07:07:22.887713 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.887697    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d21beba8-93c5-43ba-8d7e-2095dc7ea000-cabundle-cert\") pod \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") "
Jul 08 07:07:22.888044 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.887719    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx9rq\" (UniqueName: \"kubernetes.io/projected/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kube-api-access-wx9rq\") pod \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") "
Jul 08 07:07:22.888044 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.887760    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kube-rbac-proxy-sar-config\") pod \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\" (UID: \"d21beba8-93c5-43ba-8d7e-2095dc7ea000\") "
Jul 08 07:07:22.888044 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.887900    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" (UID: "bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:07:22.888255 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.888192    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d21beba8-93c5-43ba-8d7e-2095dc7ea000" (UID: "d21beba8-93c5-43ba-8d7e-2095dc7ea000"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:07:22.888255 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.888211    2565 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-cabundle-cert\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:22.888255 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.888242    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d21beba8-93c5-43ba-8d7e-2095dc7ea000" (UID: "d21beba8-93c5-43ba-8d7e-2095dc7ea000"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:07:22.888452 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.888415    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" (UID: "bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:07:22.888554 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.888530    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21beba8-93c5-43ba-8d7e-2095dc7ea000-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "d21beba8-93c5-43ba-8d7e-2095dc7ea000" (UID: "d21beba8-93c5-43ba-8d7e-2095dc7ea000"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:07:22.888632 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.888585    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" (UID: "bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:07:22.890413 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.890383    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" (UID: "bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:07:22.890511 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.890466    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kube-api-access-wx9rq" (OuterVolumeSpecName: "kube-api-access-wx9rq") pod "d21beba8-93c5-43ba-8d7e-2095dc7ea000" (UID: "d21beba8-93c5-43ba-8d7e-2095dc7ea000"). InnerVolumeSpecName "kube-api-access-wx9rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:07:22.890599 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.890582    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kube-api-access-wp8t2" (OuterVolumeSpecName: "kube-api-access-wp8t2") pod "bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" (UID: "bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c"). InnerVolumeSpecName "kube-api-access-wp8t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:07:22.890880 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.890864    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d21beba8-93c5-43ba-8d7e-2095dc7ea000-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d21beba8-93c5-43ba-8d7e-2095dc7ea000" (UID: "d21beba8-93c5-43ba-8d7e-2095dc7ea000"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:07:22.989161 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.989116    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:22.989161 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.989148    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d21beba8-93c5-43ba-8d7e-2095dc7ea000-proxy-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:22.989161 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.989158    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-proxy-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:22.989161 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.989169    2565 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kserve-provision-location\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:22.989422 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.989178    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:22.989422 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.989187    2565 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kserve-provision-location\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:22.989422 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.989195    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp8t2\" (UniqueName: \"kubernetes.io/projected/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c-kube-api-access-wp8t2\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:22.989422 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.989205    2565 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d21beba8-93c5-43ba-8d7e-2095dc7ea000-cabundle-cert\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:22.989422 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:22.989214    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx9rq\" (UniqueName: \"kubernetes.io/projected/d21beba8-93c5-43ba-8d7e-2095dc7ea000-kube-api-access-wx9rq\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:23.644723 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.644689    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerID="9bb92dd943181ad861b56c0d5bd99c45aa6afcaf9f5c2ffd3208520c61520073" exitCode=0
Jul 08 07:07:23.645167 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.644749    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"
Jul 08 07:07:23.645167 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.644775    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" event={"ID":"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c","Type":"ContainerDied","Data":"9bb92dd943181ad861b56c0d5bd99c45aa6afcaf9f5c2ffd3208520c61520073"}
Jul 08 07:07:23.645167 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.644845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc" event={"ID":"bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c","Type":"ContainerDied","Data":"0dd5d6c5f0e634ba1f3971bb9af188e2eb5366ca5a4dbcd87a785193828d011d"}
Jul 08 07:07:23.645167 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.644879    2565 scope.go:117] "RemoveContainer" containerID="c91ad0996ec625cb84a2a14cd0e6f5a29a2bc4ab1277a948f4cc3bba74fa07ad"
Jul 08 07:07:23.646876 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.646849    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln" event={"ID":"d21beba8-93c5-43ba-8d7e-2095dc7ea000","Type":"ContainerDied","Data":"3be11377cc0dd758eabad859183efc7c3b2bab88a3244b499f9302ca3af61b1c"}
Jul 08 07:07:23.646997 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.646937    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"
Jul 08 07:07:23.662512 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.662480    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"]
Jul 08 07:07:23.664755 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.664735    2565 scope.go:117] "RemoveContainer" containerID="9bb92dd943181ad861b56c0d5bd99c45aa6afcaf9f5c2ffd3208520c61520073"
Jul 08 07:07:23.666699 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.666674    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-q44ln"]
Jul 08 07:07:23.675428 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.675402    2565 scope.go:117] "RemoveContainer" containerID="d8baf838a944f1102e5e8e6330824f9c8eaca791b91a542dbbbf5390cecdfe80"
Jul 08 07:07:23.677568 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.677540    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"]
Jul 08 07:07:23.681731 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.681703    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-84b568d556-btqhc"]
Jul 08 07:07:23.685871 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.685843    2565 scope.go:117] "RemoveContainer" containerID="c91ad0996ec625cb84a2a14cd0e6f5a29a2bc4ab1277a948f4cc3bba74fa07ad"
Jul 08 07:07:23.686300 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:07:23.686276    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c91ad0996ec625cb84a2a14cd0e6f5a29a2bc4ab1277a948f4cc3bba74fa07ad\": container with ID starting with c91ad0996ec625cb84a2a14cd0e6f5a29a2bc4ab1277a948f4cc3bba74fa07ad not found: ID does not exist" containerID="c91ad0996ec625cb84a2a14cd0e6f5a29a2bc4ab1277a948f4cc3bba74fa07ad"
Jul 08 07:07:23.686413 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.686315    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c91ad0996ec625cb84a2a14cd0e6f5a29a2bc4ab1277a948f4cc3bba74fa07ad"} err="failed to get container status \"c91ad0996ec625cb84a2a14cd0e6f5a29a2bc4ab1277a948f4cc3bba74fa07ad\": rpc error: code = NotFound desc = could not find container \"c91ad0996ec625cb84a2a14cd0e6f5a29a2bc4ab1277a948f4cc3bba74fa07ad\": container with ID starting with c91ad0996ec625cb84a2a14cd0e6f5a29a2bc4ab1277a948f4cc3bba74fa07ad not found: ID does not exist"
Jul 08 07:07:23.686413 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.686344    2565 scope.go:117] "RemoveContainer" containerID="9bb92dd943181ad861b56c0d5bd99c45aa6afcaf9f5c2ffd3208520c61520073"
Jul 08 07:07:23.686705 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:07:23.686679    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bb92dd943181ad861b56c0d5bd99c45aa6afcaf9f5c2ffd3208520c61520073\": container with ID starting with 9bb92dd943181ad861b56c0d5bd99c45aa6afcaf9f5c2ffd3208520c61520073 not found: ID does not exist" containerID="9bb92dd943181ad861b56c0d5bd99c45aa6afcaf9f5c2ffd3208520c61520073"
Jul 08 07:07:23.686778 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.686716    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bb92dd943181ad861b56c0d5bd99c45aa6afcaf9f5c2ffd3208520c61520073"} err="failed to get container status \"9bb92dd943181ad861b56c0d5bd99c45aa6afcaf9f5c2ffd3208520c61520073\": rpc error: code = NotFound desc = could not find container \"9bb92dd943181ad861b56c0d5bd99c45aa6afcaf9f5c2ffd3208520c61520073\": container with ID starting with 9bb92dd943181ad861b56c0d5bd99c45aa6afcaf9f5c2ffd3208520c61520073 not found: ID does not exist"
Jul 08 07:07:23.686778 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.686741    2565 scope.go:117] "RemoveContainer" containerID="d8baf838a944f1102e5e8e6330824f9c8eaca791b91a542dbbbf5390cecdfe80"
Jul 08 07:07:23.687051 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:07:23.687033    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8baf838a944f1102e5e8e6330824f9c8eaca791b91a542dbbbf5390cecdfe80\": container with ID starting with d8baf838a944f1102e5e8e6330824f9c8eaca791b91a542dbbbf5390cecdfe80 not found: ID does not exist" containerID="d8baf838a944f1102e5e8e6330824f9c8eaca791b91a542dbbbf5390cecdfe80"
Jul 08 07:07:23.687118 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.687057    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8baf838a944f1102e5e8e6330824f9c8eaca791b91a542dbbbf5390cecdfe80"} err="failed to get container status \"d8baf838a944f1102e5e8e6330824f9c8eaca791b91a542dbbbf5390cecdfe80\": rpc error: code = NotFound desc = could not find container \"d8baf838a944f1102e5e8e6330824f9c8eaca791b91a542dbbbf5390cecdfe80\": container with ID starting with d8baf838a944f1102e5e8e6330824f9c8eaca791b91a542dbbbf5390cecdfe80 not found: ID does not exist"
Jul 08 07:07:23.687118 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.687088    2565 scope.go:117] "RemoveContainer" containerID="0f40375bb345aa34cb15d0153c87393526ea56c5acc651e5fd6af35433e1aa96"
Jul 08 07:07:23.695452 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.695434    2565 scope.go:117] "RemoveContainer" containerID="bdc12e2ad5e389c1c522ada5af75210552316ee44370ff8970c9a0acc8135b3d"
Jul 08 07:07:23.706354 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.706333    2565 scope.go:117] "RemoveContainer" containerID="0c07f1aa9d801a0b432e5115ed0d617839786c4b1f4150bc02bc86fc4de68c2d"
Jul 08 07:07:23.815451 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.815424    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:07:23.895480 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.895445    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/280a44d5-2bc1-4725-8f3d-d4a612104733-cabundle-cert\") pod \"280a44d5-2bc1-4725-8f3d-d4a612104733\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") "
Jul 08 07:07:23.895648 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.895514    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82jl5\" (UniqueName: \"kubernetes.io/projected/280a44d5-2bc1-4725-8f3d-d4a612104733-kube-api-access-82jl5\") pod \"280a44d5-2bc1-4725-8f3d-d4a612104733\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") "
Jul 08 07:07:23.895648 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.895551    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/280a44d5-2bc1-4725-8f3d-d4a612104733-kube-rbac-proxy-sar-config\") pod \"280a44d5-2bc1-4725-8f3d-d4a612104733\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") "
Jul 08 07:07:23.895648 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.895607    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/280a44d5-2bc1-4725-8f3d-d4a612104733-kserve-provision-location\") pod \"280a44d5-2bc1-4725-8f3d-d4a612104733\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") "
Jul 08 07:07:23.895648 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.895635    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/280a44d5-2bc1-4725-8f3d-d4a612104733-proxy-tls\") pod \"280a44d5-2bc1-4725-8f3d-d4a612104733\" (UID: \"280a44d5-2bc1-4725-8f3d-d4a612104733\") "
Jul 08 07:07:23.895899 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.895874    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/280a44d5-2bc1-4725-8f3d-d4a612104733-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "280a44d5-2bc1-4725-8f3d-d4a612104733" (UID: "280a44d5-2bc1-4725-8f3d-d4a612104733"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:07:23.895963 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.895916    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/280a44d5-2bc1-4725-8f3d-d4a612104733-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "280a44d5-2bc1-4725-8f3d-d4a612104733" (UID: "280a44d5-2bc1-4725-8f3d-d4a612104733"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:07:23.896010 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.895957    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280a44d5-2bc1-4725-8f3d-d4a612104733-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "280a44d5-2bc1-4725-8f3d-d4a612104733" (UID: "280a44d5-2bc1-4725-8f3d-d4a612104733"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:07:23.897670 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.897648    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280a44d5-2bc1-4725-8f3d-d4a612104733-kube-api-access-82jl5" (OuterVolumeSpecName: "kube-api-access-82jl5") pod "280a44d5-2bc1-4725-8f3d-d4a612104733" (UID: "280a44d5-2bc1-4725-8f3d-d4a612104733"). InnerVolumeSpecName "kube-api-access-82jl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:07:23.897764 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.897716    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/280a44d5-2bc1-4725-8f3d-d4a612104733-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "280a44d5-2bc1-4725-8f3d-d4a612104733" (UID: "280a44d5-2bc1-4725-8f3d-d4a612104733"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:07:23.996693 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.996656    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/280a44d5-2bc1-4725-8f3d-d4a612104733-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:23.996693 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.996686    2565 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/280a44d5-2bc1-4725-8f3d-d4a612104733-kserve-provision-location\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:23.996693 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.996695    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/280a44d5-2bc1-4725-8f3d-d4a612104733-proxy-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:23.996693 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.996704    2565 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/280a44d5-2bc1-4725-8f3d-d4a612104733-cabundle-cert\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:23.996957 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:23.996712    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82jl5\" (UniqueName: \"kubernetes.io/projected/280a44d5-2bc1-4725-8f3d-d4a612104733-kube-api-access-82jl5\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:07:24.654131 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.654098    2565 generic.go:356] "Generic (PLEG): container finished" podID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerID="584826d96ca08cd8e724dc17fae38ea6e4410001150d46f0b8e686067c6da161" exitCode=0
Jul 08 07:07:24.654574 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.654158    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"
Jul 08 07:07:24.654574 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.654163    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" event={"ID":"280a44d5-2bc1-4725-8f3d-d4a612104733","Type":"ContainerDied","Data":"584826d96ca08cd8e724dc17fae38ea6e4410001150d46f0b8e686067c6da161"}
Jul 08 07:07:24.654574 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.654217    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs" event={"ID":"280a44d5-2bc1-4725-8f3d-d4a612104733","Type":"ContainerDied","Data":"c283bb3d0ac7741d62ba73fb6ac9cb4196c809d00e8c162362499b3a703d4587"}
Jul 08 07:07:24.654574 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.654243    2565 scope.go:117] "RemoveContainer" containerID="28ca2c1466350cc111bf05e706e6140bddd3fcc8281e6198dd04b459af22c57b"
Jul 08 07:07:24.663559 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.663542    2565 scope.go:117] "RemoveContainer" containerID="584826d96ca08cd8e724dc17fae38ea6e4410001150d46f0b8e686067c6da161"
Jul 08 07:07:24.671500 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.671478    2565 scope.go:117] "RemoveContainer" containerID="a89fc79b8366612a16ada95ad943ee8fe4ce0d17e361fcf3824282ea968948e8"
Jul 08 07:07:24.675986 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.675961    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"]
Jul 08 07:07:24.680616 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.680537    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c964dbd44-bp7fs"]
Jul 08 07:07:24.680692 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.680669    2565 scope.go:117] "RemoveContainer" containerID="28ca2c1466350cc111bf05e706e6140bddd3fcc8281e6198dd04b459af22c57b"
Jul 08 07:07:24.681022 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:07:24.681000    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28ca2c1466350cc111bf05e706e6140bddd3fcc8281e6198dd04b459af22c57b\": container with ID starting with 28ca2c1466350cc111bf05e706e6140bddd3fcc8281e6198dd04b459af22c57b not found: ID does not exist" containerID="28ca2c1466350cc111bf05e706e6140bddd3fcc8281e6198dd04b459af22c57b"
Jul 08 07:07:24.681264 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.681030    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ca2c1466350cc111bf05e706e6140bddd3fcc8281e6198dd04b459af22c57b"} err="failed to get container status \"28ca2c1466350cc111bf05e706e6140bddd3fcc8281e6198dd04b459af22c57b\": rpc error: code = NotFound desc = could not find container \"28ca2c1466350cc111bf05e706e6140bddd3fcc8281e6198dd04b459af22c57b\": container with ID starting with 28ca2c1466350cc111bf05e706e6140bddd3fcc8281e6198dd04b459af22c57b not found: ID does not exist"
Jul 08 07:07:24.681264 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.681049    2565 scope.go:117] "RemoveContainer" containerID="584826d96ca08cd8e724dc17fae38ea6e4410001150d46f0b8e686067c6da161"
Jul 08 07:07:24.681570 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:07:24.681545    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"584826d96ca08cd8e724dc17fae38ea6e4410001150d46f0b8e686067c6da161\": container with ID starting with 584826d96ca08cd8e724dc17fae38ea6e4410001150d46f0b8e686067c6da161 not found: ID does not exist" containerID="584826d96ca08cd8e724dc17fae38ea6e4410001150d46f0b8e686067c6da161"
Jul 08 07:07:24.681642 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.681572    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584826d96ca08cd8e724dc17fae38ea6e4410001150d46f0b8e686067c6da161"} err="failed to get container status \"584826d96ca08cd8e724dc17fae38ea6e4410001150d46f0b8e686067c6da161\": rpc error: code = NotFound desc = could not find container \"584826d96ca08cd8e724dc17fae38ea6e4410001150d46f0b8e686067c6da161\": container with ID starting with 584826d96ca08cd8e724dc17fae38ea6e4410001150d46f0b8e686067c6da161 not found: ID does not exist"
Jul 08 07:07:24.681642 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.681589    2565 scope.go:117] "RemoveContainer" containerID="a89fc79b8366612a16ada95ad943ee8fe4ce0d17e361fcf3824282ea968948e8"
Jul 08 07:07:24.681864 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:07:24.681847    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a89fc79b8366612a16ada95ad943ee8fe4ce0d17e361fcf3824282ea968948e8\": container with ID starting with a89fc79b8366612a16ada95ad943ee8fe4ce0d17e361fcf3824282ea968948e8 not found: ID does not exist" containerID="a89fc79b8366612a16ada95ad943ee8fe4ce0d17e361fcf3824282ea968948e8"
Jul 08 07:07:24.681920 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:24.681883    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a89fc79b8366612a16ada95ad943ee8fe4ce0d17e361fcf3824282ea968948e8"} err="failed to get container status \"a89fc79b8366612a16ada95ad943ee8fe4ce0d17e361fcf3824282ea968948e8\": rpc error: code = NotFound desc = could not find container \"a89fc79b8366612a16ada95ad943ee8fe4ce0d17e361fcf3824282ea968948e8\": container with ID starting with a89fc79b8366612a16ada95ad943ee8fe4ce0d17e361fcf3824282ea968948e8 not found: ID does not exist"
Jul 08 07:07:25.035744 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:25.035660    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" path="/var/lib/kubelet/pods/280a44d5-2bc1-4725-8f3d-d4a612104733/volumes"
Jul 08 07:07:25.036193 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:25.036180    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" path="/var/lib/kubelet/pods/bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c/volumes"
Jul 08 07:07:25.036953 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:25.036937    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" path="/var/lib/kubelet/pods/d21beba8-93c5-43ba-8d7e-2095dc7ea000/volumes"
Jul 08 07:07:25.474093 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:25.474036    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 08 07:07:25.631016 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:25.630980    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:07:25.631613 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:25.631580    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:07:35.473940 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:35.473901    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 08 07:07:35.631651 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:35.631613    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:07:45.474524 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:45.474488    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:07:45.632390 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:45.632342    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:07:55.631737 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:55.631696    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:07:57.899585 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:57.899550    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:07:58.189273 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:07:58.189177    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:08:05.632617 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:08:05.632556    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 08 07:08:15.632256 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:08:15.632217    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:08:27.764667 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:08:27.764626    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:08:28.253521 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:08:28.253482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:10:30.920281 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:10:30.920205    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:10:30.920281 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:10:30.920248    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:13:12.744453 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:13:12.744418    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:13:41.757749 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:13:41.757703    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:15:30.950304 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:15:30.950272    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:15:30.950883 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:15:30.950366    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:15:48.770330 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:15:48.770291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:12.568608 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.568567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:12.667244 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.667214    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"]
Jul 08 07:16:12.667500 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.667474    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kserve-container" containerID="cri-o://f4caa95bdd11432d2111246cee9225bddf86a83e578f09e2c32776d507b0c83b" gracePeriod=30
Jul 08 07:16:12.667579 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.667542    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kube-rbac-proxy" containerID="cri-o://657dc055bd9668075b978fb0ccc1147a1c8765390f7713850b4b4d8476b34aa6" gracePeriod=30
Jul 08 07:16:12.686384 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.686355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:12.714810 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.714777    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"]
Jul 08 07:16:12.715176 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715163    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kube-rbac-proxy"
Jul 08 07:16:12.715231 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715179    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kube-rbac-proxy"
Jul 08 07:16:12.715231 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715189    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kserve-container"
Jul 08 07:16:12.715231 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715195    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kserve-container"
Jul 08 07:16:12.715231 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715207    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="storage-initializer"
Jul 08 07:16:12.715231 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715214    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="storage-initializer"
Jul 08 07:16:12.715231 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715219    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="storage-initializer"
Jul 08 07:16:12.715231 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715224    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="storage-initializer"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715234    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="storage-initializer"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715239    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="storage-initializer"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715250    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715255    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715268    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kube-rbac-proxy"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715272    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kube-rbac-proxy"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715280    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kube-rbac-proxy"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715285    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kube-rbac-proxy"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715291    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715296    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715349    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kube-rbac-proxy"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715358    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kube-rbac-proxy"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715364    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kube-rbac-proxy"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715371    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="280a44d5-2bc1-4725-8f3d-d4a612104733" containerName="kserve-container"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715377    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb0ddef5-beb8-45f1-8ce5-bbc7588f0c5c" containerName="kserve-container"
Jul 08 07:16:12.715444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.715384    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d21beba8-93c5-43ba-8d7e-2095dc7ea000" containerName="kserve-container"
Jul 08 07:16:12.718595 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.718577    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:12.721406 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.721378    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-4baa0-predictor-serving-cert\""
Jul 08 07:16:12.721406 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.721394    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-4baa0-kube-rbac-proxy-sar-config\""
Jul 08 07:16:12.729577 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.729553    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"]
Jul 08 07:16:12.780939 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.780902    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:12.850114 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.850057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:12.855308 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.855280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3143c070-e3cf-453c-9ce0-a3157be7ceea-proxy-tls\") pod \"success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c\" (UID: \"3143c070-e3cf-453c-9ce0-a3157be7ceea\") " pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:12.855468 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.855343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwm5d\" (UniqueName: \"kubernetes.io/projected/3143c070-e3cf-453c-9ce0-a3157be7ceea-kube-api-access-pwm5d\") pod \"success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c\" (UID: \"3143c070-e3cf-453c-9ce0-a3157be7ceea\") " pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:12.855468 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.855377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3143c070-e3cf-453c-9ce0-a3157be7ceea-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c\" (UID: \"3143c070-e3cf-453c-9ce0-a3157be7ceea\") " pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:12.938936 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.938905    2565 generic.go:356] "Generic (PLEG): container finished" podID="70459ada-619e-43a1-845f-515035cd7c7b" containerID="657dc055bd9668075b978fb0ccc1147a1c8765390f7713850b4b4d8476b34aa6" exitCode=2
Jul 08 07:16:12.939122 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.938973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" event={"ID":"70459ada-619e-43a1-845f-515035cd7c7b","Type":"ContainerDied","Data":"657dc055bd9668075b978fb0ccc1147a1c8765390f7713850b4b4d8476b34aa6"}
Jul 08 07:16:12.956412 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.956377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3143c070-e3cf-453c-9ce0-a3157be7ceea-proxy-tls\") pod \"success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c\" (UID: \"3143c070-e3cf-453c-9ce0-a3157be7ceea\") " pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:12.956592 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.956441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwm5d\" (UniqueName: \"kubernetes.io/projected/3143c070-e3cf-453c-9ce0-a3157be7ceea-kube-api-access-pwm5d\") pod \"success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c\" (UID: \"3143c070-e3cf-453c-9ce0-a3157be7ceea\") " pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:12.956592 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.956470    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3143c070-e3cf-453c-9ce0-a3157be7ceea-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c\" (UID: \"3143c070-e3cf-453c-9ce0-a3157be7ceea\") " pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:12.956592 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:16:12.956526    2565 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-serving-cert: secret "success-200-isvc-4baa0-predictor-serving-cert" not found
Jul 08 07:16:12.956737 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:16:12.956600    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3143c070-e3cf-453c-9ce0-a3157be7ceea-proxy-tls podName:3143c070-e3cf-453c-9ce0-a3157be7ceea nodeName:}" failed. No retries permitted until 2026-07-08 07:16:13.456581651 +0000 UTC m=+1244.165864743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3143c070-e3cf-453c-9ce0-a3157be7ceea-proxy-tls") pod "success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" (UID: "3143c070-e3cf-453c-9ce0-a3157be7ceea") : secret "success-200-isvc-4baa0-predictor-serving-cert" not found
Jul 08 07:16:12.957277 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.957258    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3143c070-e3cf-453c-9ce0-a3157be7ceea-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c\" (UID: \"3143c070-e3cf-453c-9ce0-a3157be7ceea\") " pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:12.964584 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.964558    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwm5d\" (UniqueName: \"kubernetes.io/projected/3143c070-e3cf-453c-9ce0-a3157be7ceea-kube-api-access-pwm5d\") pod \"success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c\" (UID: \"3143c070-e3cf-453c-9ce0-a3157be7ceea\") " pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:12.990201 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:12.990170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:13.276423 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:13.276339    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:13.461728 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:13.461692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3143c070-e3cf-453c-9ce0-a3157be7ceea-proxy-tls\") pod \"success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c\" (UID: \"3143c070-e3cf-453c-9ce0-a3157be7ceea\") " pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:13.464230 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:13.464203    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3143c070-e3cf-453c-9ce0-a3157be7ceea-proxy-tls\") pod \"success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c\" (UID: \"3143c070-e3cf-453c-9ce0-a3157be7ceea\") " pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:13.629575 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:13.629535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:13.767221 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:13.767196    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"]
Jul 08 07:16:13.769041 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:16:13.769015    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3143c070_e3cf_453c_9ce0_a3157be7ceea.slice/crio-7bdfbb6290c894ec41d2281e73b9a97f1c986c3311af6826704d375995dfee3b WatchSource:0}: Error finding container 7bdfbb6290c894ec41d2281e73b9a97f1c986c3311af6826704d375995dfee3b: Status 404 returned error can't find the container with id 7bdfbb6290c894ec41d2281e73b9a97f1c986c3311af6826704d375995dfee3b
Jul 08 07:16:13.946017 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:13.945981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" event={"ID":"3143c070-e3cf-453c-9ce0-a3157be7ceea","Type":"ContainerStarted","Data":"c0e56f6a63afe9fc111dedbf3e5ddff68324bf9d3f75ea8c3a88ce453064cdc9"}
Jul 08 07:16:13.946218 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:13.946036    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" event={"ID":"3143c070-e3cf-453c-9ce0-a3157be7ceea","Type":"ContainerStarted","Data":"1073447c81b9053ee490b2a1da5f34e4dcf15332d334510406f4b9bfeaaad4fd"}
Jul 08 07:16:13.946218 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:13.946060    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" event={"ID":"3143c070-e3cf-453c-9ce0-a3157be7ceea","Type":"ContainerStarted","Data":"7bdfbb6290c894ec41d2281e73b9a97f1c986c3311af6826704d375995dfee3b"}
Jul 08 07:16:13.946218 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:13.946130    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:13.964216 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:13.964172    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" podStartSLOduration=1.964156162 podStartE2EDuration="1.964156162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:16:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:16:13.96328809 +0000 UTC m=+1244.672571213" watchObservedRunningTime="2026-07-08 07:16:13.964156162 +0000 UTC m=+1244.673439271"
Jul 08 07:16:14.951346 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:14.951313    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:14.952640 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:14.952610    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 08 07:16:15.470232 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:15.470181    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 08 07:16:15.474702 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:15.474678    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 08 07:16:15.959237 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:15.959196    2565 generic.go:356] "Generic (PLEG): container finished" podID="70459ada-619e-43a1-845f-515035cd7c7b" containerID="f4caa95bdd11432d2111246cee9225bddf86a83e578f09e2c32776d507b0c83b" exitCode=0
Jul 08 07:16:15.959717 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:15.959261    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" event={"ID":"70459ada-619e-43a1-845f-515035cd7c7b","Type":"ContainerDied","Data":"f4caa95bdd11432d2111246cee9225bddf86a83e578f09e2c32776d507b0c83b"}
Jul 08 07:16:15.959717 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:15.959617    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 08 07:16:16.021576 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.021551    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:16:16.083907 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.083870    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czlpg\" (UniqueName: \"kubernetes.io/projected/70459ada-619e-43a1-845f-515035cd7c7b-kube-api-access-czlpg\") pod \"70459ada-619e-43a1-845f-515035cd7c7b\" (UID: \"70459ada-619e-43a1-845f-515035cd7c7b\") "
Jul 08 07:16:16.084093 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.083921    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/70459ada-619e-43a1-845f-515035cd7c7b-proxy-tls\") pod \"70459ada-619e-43a1-845f-515035cd7c7b\" (UID: \"70459ada-619e-43a1-845f-515035cd7c7b\") "
Jul 08 07:16:16.084093 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.083957    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/70459ada-619e-43a1-845f-515035cd7c7b-kube-rbac-proxy-sar-config\") pod \"70459ada-619e-43a1-845f-515035cd7c7b\" (UID: \"70459ada-619e-43a1-845f-515035cd7c7b\") "
Jul 08 07:16:16.084471 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.084440    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70459ada-619e-43a1-845f-515035cd7c7b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "70459ada-619e-43a1-845f-515035cd7c7b" (UID: "70459ada-619e-43a1-845f-515035cd7c7b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:16:16.086106 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.086058    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70459ada-619e-43a1-845f-515035cd7c7b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "70459ada-619e-43a1-845f-515035cd7c7b" (UID: "70459ada-619e-43a1-845f-515035cd7c7b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:16:16.086234 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.086209    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70459ada-619e-43a1-845f-515035cd7c7b-kube-api-access-czlpg" (OuterVolumeSpecName: "kube-api-access-czlpg") pod "70459ada-619e-43a1-845f-515035cd7c7b" (UID: "70459ada-619e-43a1-845f-515035cd7c7b"). InnerVolumeSpecName "kube-api-access-czlpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:16:16.185805 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.185760    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czlpg\" (UniqueName: \"kubernetes.io/projected/70459ada-619e-43a1-845f-515035cd7c7b-kube-api-access-czlpg\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:16:16.185805 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.185795    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/70459ada-619e-43a1-845f-515035cd7c7b-proxy-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:16:16.185805 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.185806    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/70459ada-619e-43a1-845f-515035cd7c7b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:16:16.966026 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.965996    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"
Jul 08 07:16:16.966475 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.966001    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r" event={"ID":"70459ada-619e-43a1-845f-515035cd7c7b","Type":"ContainerDied","Data":"ec9ea648b51261245d1bc30297ae5cd3a88f04855d218cd4fc74f1c0e2110873"}
Jul 08 07:16:16.966475 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.966173    2565 scope.go:117] "RemoveContainer" containerID="657dc055bd9668075b978fb0ccc1147a1c8765390f7713850b4b4d8476b34aa6"
Jul 08 07:16:16.974897 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.974881    2565 scope.go:117] "RemoveContainer" containerID="f4caa95bdd11432d2111246cee9225bddf86a83e578f09e2c32776d507b0c83b"
Jul 08 07:16:16.989412 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.989385    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"]
Jul 08 07:16:16.993209 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:16.993182    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-104b4-predictor-65665c5848-4gb7r"]
Jul 08 07:16:17.035405 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:17.035372    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70459ada-619e-43a1-845f-515035cd7c7b" path="/var/lib/kubelet/pods/70459ada-619e-43a1-845f-515035cd7c7b/volumes"
Jul 08 07:16:20.965933 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:20.965899    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:16:20.966587 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:20.966559    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 08 07:16:30.967521 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:30.967471    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 08 07:16:40.966825 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:40.966781    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 08 07:16:42.459617 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.459586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:42.556339 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.556248    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"]
Jul 08 07:16:42.556563 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.556527    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kserve-container" containerID="cri-o://1fc748bf89a03e80fb1996a0c8607fc99fdfc430c24d2373c5da4fb22c65e14e" gracePeriod=30
Jul 08 07:16:42.556638 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.556567    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kube-rbac-proxy" containerID="cri-o://d5bbe9d6ba0b39273ad5f54c46bf67e7705b75a439b3a06abd2432fbcf15ce5a" gracePeriod=30
Jul 08 07:16:42.557683 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.557650    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:42.565018 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.564996    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"]
Jul 08 07:16:42.565525 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.565497    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kube-rbac-proxy"
Jul 08 07:16:42.565525 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.565515    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kube-rbac-proxy"
Jul 08 07:16:42.565525 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.565526    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kserve-container"
Jul 08 07:16:42.565525 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.565531    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kserve-container"
Jul 08 07:16:42.565765 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.565630    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kube-rbac-proxy"
Jul 08 07:16:42.565765 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.565643    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="70459ada-619e-43a1-845f-515035cd7c7b" containerName="kserve-container"
Jul 08 07:16:42.569989 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.569973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:42.572307 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.572291    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8ecaa-kube-rbac-proxy-sar-config\""
Jul 08 07:16:42.572307 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.572304    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8ecaa-predictor-serving-cert\""
Jul 08 07:16:42.580327 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.580294    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"]
Jul 08 07:16:42.625313 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.625267    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:42.633404 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.633370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgjr6\" (UniqueName: \"kubernetes.io/projected/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-kube-api-access-lgjr6\") pod \"success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") " pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:42.633546 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.633423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") " pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:42.633546 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.633524    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-proxy-tls\") pod \"success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") " pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:42.718240 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.718124    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:42.734947 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.734914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-proxy-tls\") pod \"success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") " pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:42.735125 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.734980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgjr6\" (UniqueName: \"kubernetes.io/projected/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-kube-api-access-lgjr6\") pod \"success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") " pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:42.735125 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.735041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") " pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:42.735270 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:16:42.735151    2565 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-serving-cert: secret "success-200-isvc-8ecaa-predictor-serving-cert" not found
Jul 08 07:16:42.735270 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:16:42.735206    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-proxy-tls podName:52ac61ec-9f3b-44b7-b7a6-0d31152b9b80 nodeName:}" failed. No retries permitted until 2026-07-08 07:16:43.235187331 +0000 UTC m=+1273.944470420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-proxy-tls") pod "success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" (UID: "52ac61ec-9f3b-44b7-b7a6-0d31152b9b80") : secret "success-200-isvc-8ecaa-predictor-serving-cert" not found
Jul 08 07:16:42.735902 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.735855    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") " pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:42.743731 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.743704    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgjr6\" (UniqueName: \"kubernetes.io/projected/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-kube-api-access-lgjr6\") pod \"success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") " pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:42.772866 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:42.772842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:43.089538 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:43.089510    2565 generic.go:356] "Generic (PLEG): container finished" podID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerID="d5bbe9d6ba0b39273ad5f54c46bf67e7705b75a439b3a06abd2432fbcf15ce5a" exitCode=2
Jul 08 07:16:43.089689 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:43.089584    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" event={"ID":"24ee39b3-58a8-42af-b708-1afdf6c6a7e3","Type":"ContainerDied","Data":"d5bbe9d6ba0b39273ad5f54c46bf67e7705b75a439b3a06abd2432fbcf15ce5a"}
Jul 08 07:16:43.151472 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:43.151444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:43.239455 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:43.239429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-proxy-tls\") pod \"success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") " pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:43.239615 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:16:43.239582    2565 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-serving-cert: secret "success-200-isvc-8ecaa-predictor-serving-cert" not found
Jul 08 07:16:43.239677 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:16:43.239658    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-proxy-tls podName:52ac61ec-9f3b-44b7-b7a6-0d31152b9b80 nodeName:}" failed. No retries permitted until 2026-07-08 07:16:44.239638021 +0000 UTC m=+1274.948921110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-proxy-tls") pod "success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" (UID: "52ac61ec-9f3b-44b7-b7a6-0d31152b9b80") : secret "success-200-isvc-8ecaa-predictor-serving-cert" not found
Jul 08 07:16:43.320865 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:43.320834    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:16:44.249147 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:44.249116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-proxy-tls\") pod \"success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") " pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:44.251567 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:44.251542    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-proxy-tls\") pod \"success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") " pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:44.381593 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:44.381555    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:44.509403 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:44.509204    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"]
Jul 08 07:16:44.511953 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:16:44.511927    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ac61ec_9f3b_44b7_b7a6_0d31152b9b80.slice/crio-2263544c7122439dda39e66cfda0b9f61f9460385c78210c0c38a2b759592403 WatchSource:0}: Error finding container 2263544c7122439dda39e66cfda0b9f61f9460385c78210c0c38a2b759592403: Status 404 returned error can't find the container with id 2263544c7122439dda39e66cfda0b9f61f9460385c78210c0c38a2b759592403
Jul 08 07:16:45.100444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.100407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" event={"ID":"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80","Type":"ContainerStarted","Data":"aa1d54a5d3f83747b05fc1acb643d93fe6cf48ab352380d7b3eece70d8ca162d"}
Jul 08 07:16:45.100625 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.100466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" event={"ID":"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80","Type":"ContainerStarted","Data":"77b1b0085f6c882d7805dc18c35b8fb3a96613020bc2fd1a8d36042d89a996c7"}
Jul 08 07:16:45.100625 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.100498    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:45.100625 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.100521    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" event={"ID":"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80","Type":"ContainerStarted","Data":"2263544c7122439dda39e66cfda0b9f61f9460385c78210c0c38a2b759592403"}
Jul 08 07:16:45.118061 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.118015    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" podStartSLOduration=3.117999512 podStartE2EDuration="3.117999512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:16:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:16:45.115963118 +0000 UTC m=+1275.825246229" watchObservedRunningTime="2026-07-08 07:16:45.117999512 +0000 UTC m=+1275.827282623"
Jul 08 07:16:45.714784 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.714763    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:16:45.762450 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.762372    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-kube-rbac-proxy-sar-config\") pod \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\" (UID: \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\") "
Jul 08 07:16:45.762575 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.762494    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kbjb\" (UniqueName: \"kubernetes.io/projected/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-kube-api-access-4kbjb\") pod \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\" (UID: \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\") "
Jul 08 07:16:45.762575 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.762523    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-proxy-tls\") pod \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\" (UID: \"24ee39b3-58a8-42af-b708-1afdf6c6a7e3\") "
Jul 08 07:16:45.762761 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.762734    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "24ee39b3-58a8-42af-b708-1afdf6c6a7e3" (UID: "24ee39b3-58a8-42af-b708-1afdf6c6a7e3"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:16:45.764518 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.764495    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "24ee39b3-58a8-42af-b708-1afdf6c6a7e3" (UID: "24ee39b3-58a8-42af-b708-1afdf6c6a7e3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:16:45.764666 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.764642    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-kube-api-access-4kbjb" (OuterVolumeSpecName: "kube-api-access-4kbjb") pod "24ee39b3-58a8-42af-b708-1afdf6c6a7e3" (UID: "24ee39b3-58a8-42af-b708-1afdf6c6a7e3"). InnerVolumeSpecName "kube-api-access-4kbjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:16:45.863886 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.863854    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kbjb\" (UniqueName: \"kubernetes.io/projected/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-kube-api-access-4kbjb\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:16:45.863886 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.863882    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-proxy-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:16:45.863886 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:45.863892    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/24ee39b3-58a8-42af-b708-1afdf6c6a7e3-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:16:46.106854 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.106820    2565 generic.go:356] "Generic (PLEG): container finished" podID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerID="1fc748bf89a03e80fb1996a0c8607fc99fdfc430c24d2373c5da4fb22c65e14e" exitCode=0
Jul 08 07:16:46.107051 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.106878    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"
Jul 08 07:16:46.107051 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.106910    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" event={"ID":"24ee39b3-58a8-42af-b708-1afdf6c6a7e3","Type":"ContainerDied","Data":"1fc748bf89a03e80fb1996a0c8607fc99fdfc430c24d2373c5da4fb22c65e14e"}
Jul 08 07:16:46.107051 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.106966    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" event={"ID":"24ee39b3-58a8-42af-b708-1afdf6c6a7e3","Type":"ContainerDied","Data":"eea663928be17ce5f90900270a32b2514f61387f3ae856e2f92666ec4196580e"}
Jul 08 07:16:46.107051 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.106996    2565 scope.go:117] "RemoveContainer" containerID="d5bbe9d6ba0b39273ad5f54c46bf67e7705b75a439b3a06abd2432fbcf15ce5a"
Jul 08 07:16:46.107417 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.107394    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:46.108587 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.108560    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 08 07:16:46.115782 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.115764    2565 scope.go:117] "RemoveContainer" containerID="1fc748bf89a03e80fb1996a0c8607fc99fdfc430c24d2373c5da4fb22c65e14e"
Jul 08 07:16:46.123472 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.123393    2565 scope.go:117] "RemoveContainer" containerID="d5bbe9d6ba0b39273ad5f54c46bf67e7705b75a439b3a06abd2432fbcf15ce5a"
Jul 08 07:16:46.123680 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:16:46.123662    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5bbe9d6ba0b39273ad5f54c46bf67e7705b75a439b3a06abd2432fbcf15ce5a\": container with ID starting with d5bbe9d6ba0b39273ad5f54c46bf67e7705b75a439b3a06abd2432fbcf15ce5a not found: ID does not exist" containerID="d5bbe9d6ba0b39273ad5f54c46bf67e7705b75a439b3a06abd2432fbcf15ce5a"
Jul 08 07:16:46.123734 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.123687    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5bbe9d6ba0b39273ad5f54c46bf67e7705b75a439b3a06abd2432fbcf15ce5a"} err="failed to get container status \"d5bbe9d6ba0b39273ad5f54c46bf67e7705b75a439b3a06abd2432fbcf15ce5a\": rpc error: code = NotFound desc = could not find container \"d5bbe9d6ba0b39273ad5f54c46bf67e7705b75a439b3a06abd2432fbcf15ce5a\": container with ID starting with d5bbe9d6ba0b39273ad5f54c46bf67e7705b75a439b3a06abd2432fbcf15ce5a not found: ID does not exist"
Jul 08 07:16:46.123734 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.123706    2565 scope.go:117] "RemoveContainer" containerID="1fc748bf89a03e80fb1996a0c8607fc99fdfc430c24d2373c5da4fb22c65e14e"
Jul 08 07:16:46.123938 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:16:46.123921    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fc748bf89a03e80fb1996a0c8607fc99fdfc430c24d2373c5da4fb22c65e14e\": container with ID starting with 1fc748bf89a03e80fb1996a0c8607fc99fdfc430c24d2373c5da4fb22c65e14e not found: ID does not exist" containerID="1fc748bf89a03e80fb1996a0c8607fc99fdfc430c24d2373c5da4fb22c65e14e"
Jul 08 07:16:46.123975 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.123946    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc748bf89a03e80fb1996a0c8607fc99fdfc430c24d2373c5da4fb22c65e14e"} err="failed to get container status \"1fc748bf89a03e80fb1996a0c8607fc99fdfc430c24d2373c5da4fb22c65e14e\": rpc error: code = NotFound desc = could not find container \"1fc748bf89a03e80fb1996a0c8607fc99fdfc430c24d2373c5da4fb22c65e14e\": container with ID starting with 1fc748bf89a03e80fb1996a0c8607fc99fdfc430c24d2373c5da4fb22c65e14e not found: ID does not exist"
Jul 08 07:16:46.128308 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.128287    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"]
Jul 08 07:16:46.132339 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.132320    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx"]
Jul 08 07:16:46.625530 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.625478    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 08 07:16:46.631876 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:46.631842    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1469a-predictor-57f964f944-hm9lx" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: i/o timeout"
Jul 08 07:16:47.036424 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:47.036353    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" path="/var/lib/kubelet/pods/24ee39b3-58a8-42af-b708-1afdf6c6a7e3/volumes"
Jul 08 07:16:47.112403 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:47.112357    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 08 07:16:50.966778 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:50.966734    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 08 07:16:52.117069 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:52.117040    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:16:52.117647 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:16:52.117621    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 08 07:17:00.967255 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:00.967217    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:17:02.118186 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:02.118137    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 08 07:17:12.118337 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:12.118295    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 08 07:17:12.830956 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:12.830912    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:13.055547 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:13.055514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:22.117626 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.117584    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 08 07:17:22.874311 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.874279    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:22.977654 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.977621    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"]
Jul 08 07:17:22.977915 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.977875    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kserve-container" containerID="cri-o://1073447c81b9053ee490b2a1da5f34e4dcf15332d334510406f4b9bfeaaad4fd" gracePeriod=30
Jul 08 07:17:22.977993 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.977923    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kube-rbac-proxy" containerID="cri-o://c0e56f6a63afe9fc111dedbf3e5ddff68324bf9d3f75ea8c3a88ce453064cdc9" gracePeriod=30
Jul 08 07:17:22.980463 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.980419    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:22.991929 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.991905    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"]
Jul 08 07:17:22.992350 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.992336    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kube-rbac-proxy"
Jul 08 07:17:22.992406 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.992352    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kube-rbac-proxy"
Jul 08 07:17:22.992406 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.992372    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kserve-container"
Jul 08 07:17:22.992406 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.992377    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kserve-container"
Jul 08 07:17:22.992552 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.992429    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kserve-container"
Jul 08 07:17:22.992552 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.992439    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ee39b3-58a8-42af-b708-1afdf6c6a7e3" containerName="kube-rbac-proxy"
Jul 08 07:17:22.995897 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.995879    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:22.998127 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.998105    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1f938-predictor-serving-cert\""
Jul 08 07:17:22.998226 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:22.998163    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1f938-kube-rbac-proxy-sar-config\""
Jul 08 07:17:23.006406 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.006382    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"]
Jul 08 07:17:23.084898 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.084851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:23.099760 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.099733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htb4l\" (UniqueName: \"kubernetes.io/projected/35e31efb-2307-4832-a698-103153cd6cdc-kube-api-access-htb4l\") pod \"success-200-isvc-1f938-predictor-59f689c956-lzsxd\" (UID: \"35e31efb-2307-4832-a698-103153cd6cdc\") " pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:23.099890 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.099829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/35e31efb-2307-4832-a698-103153cd6cdc-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1f938-predictor-59f689c956-lzsxd\" (UID: \"35e31efb-2307-4832-a698-103153cd6cdc\") " pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:23.099959 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.099906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/35e31efb-2307-4832-a698-103153cd6cdc-proxy-tls\") pod \"success-200-isvc-1f938-predictor-59f689c956-lzsxd\" (UID: \"35e31efb-2307-4832-a698-103153cd6cdc\") " pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:23.144359 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.144279    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:23.200671 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.200633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/35e31efb-2307-4832-a698-103153cd6cdc-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1f938-predictor-59f689c956-lzsxd\" (UID: \"35e31efb-2307-4832-a698-103153cd6cdc\") " pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:23.200671 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.200680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/35e31efb-2307-4832-a698-103153cd6cdc-proxy-tls\") pod \"success-200-isvc-1f938-predictor-59f689c956-lzsxd\" (UID: \"35e31efb-2307-4832-a698-103153cd6cdc\") " pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:23.201042 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.200727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htb4l\" (UniqueName: \"kubernetes.io/projected/35e31efb-2307-4832-a698-103153cd6cdc-kube-api-access-htb4l\") pod \"success-200-isvc-1f938-predictor-59f689c956-lzsxd\" (UID: \"35e31efb-2307-4832-a698-103153cd6cdc\") " pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:23.201428 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.201402    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/35e31efb-2307-4832-a698-103153cd6cdc-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1f938-predictor-59f689c956-lzsxd\" (UID: \"35e31efb-2307-4832-a698-103153cd6cdc\") " pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:23.203148 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.203129    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/35e31efb-2307-4832-a698-103153cd6cdc-proxy-tls\") pod \"success-200-isvc-1f938-predictor-59f689c956-lzsxd\" (UID: \"35e31efb-2307-4832-a698-103153cd6cdc\") " pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:23.207953 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.207931    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htb4l\" (UniqueName: \"kubernetes.io/projected/35e31efb-2307-4832-a698-103153cd6cdc-kube-api-access-htb4l\") pod \"success-200-isvc-1f938-predictor-59f689c956-lzsxd\" (UID: \"35e31efb-2307-4832-a698-103153cd6cdc\") " pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:23.279451 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.279411    2565 generic.go:356] "Generic (PLEG): container finished" podID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerID="c0e56f6a63afe9fc111dedbf3e5ddff68324bf9d3f75ea8c3a88ce453064cdc9" exitCode=2
Jul 08 07:17:23.279616 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.279481    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" event={"ID":"3143c070-e3cf-453c-9ce0-a3157be7ceea","Type":"ContainerDied","Data":"c0e56f6a63afe9fc111dedbf3e5ddff68324bf9d3f75ea8c3a88ce453064cdc9"}
Jul 08 07:17:23.307499 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.307470    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:23.441618 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.441590    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"]
Jul 08 07:17:23.443593 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:17:23.443556    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e31efb_2307_4832_a698_103153cd6cdc.slice/crio-aa3d9b92b25fd1a6d26206bf0e7901443725c0819991d0024e27293bd1f97d19 WatchSource:0}: Error finding container aa3d9b92b25fd1a6d26206bf0e7901443725c0819991d0024e27293bd1f97d19: Status 404 returned error can't find the container with id aa3d9b92b25fd1a6d26206bf0e7901443725c0819991d0024e27293bd1f97d19
Jul 08 07:17:23.699850 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:23.699760    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:24.289013 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:24.288979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" event={"ID":"35e31efb-2307-4832-a698-103153cd6cdc","Type":"ContainerStarted","Data":"e9d44a72c504f1ae67a31382b2818e68c7e91f4c06c82434ec5db57bfbfd2c1c"}
Jul 08 07:17:24.289403 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:24.289036    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" event={"ID":"35e31efb-2307-4832-a698-103153cd6cdc","Type":"ContainerStarted","Data":"26ddb29f77004454c65283725279d1fec75826a43eb1c49d86ade4b58593c49e"}
Jul 08 07:17:24.289403 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:24.289060    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" event={"ID":"35e31efb-2307-4832-a698-103153cd6cdc","Type":"ContainerStarted","Data":"aa3d9b92b25fd1a6d26206bf0e7901443725c0819991d0024e27293bd1f97d19"}
Jul 08 07:17:24.289403 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:24.289110    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:24.308137 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:24.308091    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" podStartSLOduration=2.308059316 podStartE2EDuration="2.308059316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:17:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:17:24.305865096 +0000 UTC m=+1315.015148207" watchObservedRunningTime="2026-07-08 07:17:24.308059316 +0000 UTC m=+1315.017342425"
Jul 08 07:17:25.294025 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:25.293992    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:25.295346 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:25.295312    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 08 07:17:25.960544 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:25.960495    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.32:8643/healthz\": dial tcp 10.134.0.32:8643: connect: connection refused"
Jul 08 07:17:26.301699 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:26.301664    2565 generic.go:356] "Generic (PLEG): container finished" podID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerID="1073447c81b9053ee490b2a1da5f34e4dcf15332d334510406f4b9bfeaaad4fd" exitCode=0
Jul 08 07:17:26.302094 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:26.301731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" event={"ID":"3143c070-e3cf-453c-9ce0-a3157be7ceea","Type":"ContainerDied","Data":"1073447c81b9053ee490b2a1da5f34e4dcf15332d334510406f4b9bfeaaad4fd"}
Jul 08 07:17:26.302094 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:26.302047    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 08 07:17:26.324465 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:26.324443    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:17:26.431013 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:26.430971    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3143c070-e3cf-453c-9ce0-a3157be7ceea-kube-rbac-proxy-sar-config\") pod \"3143c070-e3cf-453c-9ce0-a3157be7ceea\" (UID: \"3143c070-e3cf-453c-9ce0-a3157be7ceea\") "
Jul 08 07:17:26.431224 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:26.431068    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwm5d\" (UniqueName: \"kubernetes.io/projected/3143c070-e3cf-453c-9ce0-a3157be7ceea-kube-api-access-pwm5d\") pod \"3143c070-e3cf-453c-9ce0-a3157be7ceea\" (UID: \"3143c070-e3cf-453c-9ce0-a3157be7ceea\") "
Jul 08 07:17:26.431224 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:26.431153    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3143c070-e3cf-453c-9ce0-a3157be7ceea-proxy-tls\") pod \"3143c070-e3cf-453c-9ce0-a3157be7ceea\" (UID: \"3143c070-e3cf-453c-9ce0-a3157be7ceea\") "
Jul 08 07:17:26.431493 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:26.431463    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3143c070-e3cf-453c-9ce0-a3157be7ceea-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "3143c070-e3cf-453c-9ce0-a3157be7ceea" (UID: "3143c070-e3cf-453c-9ce0-a3157be7ceea"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:17:26.433182 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:26.433155    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3143c070-e3cf-453c-9ce0-a3157be7ceea-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3143c070-e3cf-453c-9ce0-a3157be7ceea" (UID: "3143c070-e3cf-453c-9ce0-a3157be7ceea"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:17:26.433267 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:26.433220    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3143c070-e3cf-453c-9ce0-a3157be7ceea-kube-api-access-pwm5d" (OuterVolumeSpecName: "kube-api-access-pwm5d") pod "3143c070-e3cf-453c-9ce0-a3157be7ceea" (UID: "3143c070-e3cf-453c-9ce0-a3157be7ceea"). InnerVolumeSpecName "kube-api-access-pwm5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:17:26.532266 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:26.532174    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwm5d\" (UniqueName: \"kubernetes.io/projected/3143c070-e3cf-453c-9ce0-a3157be7ceea-kube-api-access-pwm5d\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:17:26.532266 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:26.532209    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3143c070-e3cf-453c-9ce0-a3157be7ceea-proxy-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:17:26.532266 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:26.532220    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3143c070-e3cf-453c-9ce0-a3157be7ceea-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:17:27.307756 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:27.307678    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"
Jul 08 07:17:27.308170 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:27.307677    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c" event={"ID":"3143c070-e3cf-453c-9ce0-a3157be7ceea","Type":"ContainerDied","Data":"7bdfbb6290c894ec41d2281e73b9a97f1c986c3311af6826704d375995dfee3b"}
Jul 08 07:17:27.308170 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:27.307823    2565 scope.go:117] "RemoveContainer" containerID="c0e56f6a63afe9fc111dedbf3e5ddff68324bf9d3f75ea8c3a88ce453064cdc9"
Jul 08 07:17:27.316615 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:27.316595    2565 scope.go:117] "RemoveContainer" containerID="1073447c81b9053ee490b2a1da5f34e4dcf15332d334510406f4b9bfeaaad4fd"
Jul 08 07:17:27.325919 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:27.325894    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"]
Jul 08 07:17:27.328148 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:27.328122    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4baa0-predictor-6dd97867c8-xqs4c"]
Jul 08 07:17:29.035879 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:29.035843    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" path="/var/lib/kubelet/pods/3143c070-e3cf-453c-9ce0-a3157be7ceea/volumes"
Jul 08 07:17:31.307319 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:31.307237    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:17:31.307747 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:31.307691    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 08 07:17:32.119064 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:32.119031    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:17:41.307830 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:41.307790    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 08 07:17:42.601060 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:42.601027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:42.888432 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:42.888342    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:51.308110 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:51.308003    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 08 07:17:52.706834 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.706798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:52.803337 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.803295    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"]
Jul 08 07:17:52.803606 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.803563    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kserve-container" containerID="cri-o://77b1b0085f6c882d7805dc18c35b8fb3a96613020bc2fd1a8d36042d89a996c7" gracePeriod=30
Jul 08 07:17:52.803606 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.803585    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kube-rbac-proxy" containerID="cri-o://aa1d54a5d3f83747b05fc1acb643d93fe6cf48ab352380d7b3eece70d8ca162d" gracePeriod=30
Jul 08 07:17:52.822875 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.822850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:52.823577 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.823557    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"]
Jul 08 07:17:52.823931 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.823920    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kserve-container"
Jul 08 07:17:52.823972 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.823933    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kserve-container"
Jul 08 07:17:52.823972 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.823942    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kube-rbac-proxy"
Jul 08 07:17:52.823972 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.823948    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kube-rbac-proxy"
Jul 08 07:17:52.824067 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.824010    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kserve-container"
Jul 08 07:17:52.824067 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.824022    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3143c070-e3cf-453c-9ce0-a3157be7ceea" containerName="kube-rbac-proxy"
Jul 08 07:17:52.829358 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.829339    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:52.831660 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.831631    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-3d727-predictor-serving-cert\""
Jul 08 07:17:52.831852 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.831833    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-3d727-kube-rbac-proxy-sar-config\""
Jul 08 07:17:52.836033 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.836009    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"]
Jul 08 07:17:52.907576 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.907549    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:52.971563 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.971460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1864667b-113b-413d-8611-96bc6997a5ce-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-3d727-predictor-79f4459548-fkxl5\" (UID: \"1864667b-113b-413d-8611-96bc6997a5ce\") " pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:52.971563 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.971539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn4nc\" (UniqueName: \"kubernetes.io/projected/1864667b-113b-413d-8611-96bc6997a5ce-kube-api-access-bn4nc\") pod \"success-200-isvc-3d727-predictor-79f4459548-fkxl5\" (UID: \"1864667b-113b-413d-8611-96bc6997a5ce\") " pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:52.971760 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.971594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1864667b-113b-413d-8611-96bc6997a5ce-proxy-tls\") pod \"success-200-isvc-3d727-predictor-79f4459548-fkxl5\" (UID: \"1864667b-113b-413d-8611-96bc6997a5ce\") " pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:52.974288 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:52.974258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:53.072705 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.072674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1864667b-113b-413d-8611-96bc6997a5ce-proxy-tls\") pod \"success-200-isvc-3d727-predictor-79f4459548-fkxl5\" (UID: \"1864667b-113b-413d-8611-96bc6997a5ce\") " pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:53.072705 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.072714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1864667b-113b-413d-8611-96bc6997a5ce-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-3d727-predictor-79f4459548-fkxl5\" (UID: \"1864667b-113b-413d-8611-96bc6997a5ce\") " pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:53.072969 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.072771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn4nc\" (UniqueName: \"kubernetes.io/projected/1864667b-113b-413d-8611-96bc6997a5ce-kube-api-access-bn4nc\") pod \"success-200-isvc-3d727-predictor-79f4459548-fkxl5\" (UID: \"1864667b-113b-413d-8611-96bc6997a5ce\") " pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:53.073509 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.073488    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1864667b-113b-413d-8611-96bc6997a5ce-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-3d727-predictor-79f4459548-fkxl5\" (UID: \"1864667b-113b-413d-8611-96bc6997a5ce\") " pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:53.075211 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.075192    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1864667b-113b-413d-8611-96bc6997a5ce-proxy-tls\") pod \"success-200-isvc-3d727-predictor-79f4459548-fkxl5\" (UID: \"1864667b-113b-413d-8611-96bc6997a5ce\") " pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:53.081898 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.081867    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn4nc\" (UniqueName: \"kubernetes.io/projected/1864667b-113b-413d-8611-96bc6997a5ce-kube-api-access-bn4nc\") pod \"success-200-isvc-3d727-predictor-79f4459548-fkxl5\" (UID: \"1864667b-113b-413d-8611-96bc6997a5ce\") " pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:53.141494 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.141462    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:53.170441 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.170416    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:17:53.274531 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.274498    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"]
Jul 08 07:17:53.277620 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:17:53.277594    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1864667b_113b_413d_8611_96bc6997a5ce.slice/crio-71f42f555e7144a40b1ef1da047dc05da7ce219d82b5e1ba5a666418b973fd18 WatchSource:0}: Error finding container 71f42f555e7144a40b1ef1da047dc05da7ce219d82b5e1ba5a666418b973fd18: Status 404 returned error can't find the container with id 71f42f555e7144a40b1ef1da047dc05da7ce219d82b5e1ba5a666418b973fd18
Jul 08 07:17:53.427394 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.427362    2565 generic.go:356] "Generic (PLEG): container finished" podID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerID="aa1d54a5d3f83747b05fc1acb643d93fe6cf48ab352380d7b3eece70d8ca162d" exitCode=2
Jul 08 07:17:53.427560 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.427432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" event={"ID":"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80","Type":"ContainerDied","Data":"aa1d54a5d3f83747b05fc1acb643d93fe6cf48ab352380d7b3eece70d8ca162d"}
Jul 08 07:17:53.429281 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.429251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" event={"ID":"1864667b-113b-413d-8611-96bc6997a5ce","Type":"ContainerStarted","Data":"09be524da0d609fd02421edc4aca11cd919c422cdaf5586a58cd573c1089c029"}
Jul 08 07:17:53.429424 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.429303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" event={"ID":"1864667b-113b-413d-8611-96bc6997a5ce","Type":"ContainerStarted","Data":"25b183f1bc4924bdfd401e88b5e76c3b60c10bb5f459823b64e3ef85e36748d8"}
Jul 08 07:17:53.429424 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.429332    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" event={"ID":"1864667b-113b-413d-8611-96bc6997a5ce","Type":"ContainerStarted","Data":"71f42f555e7144a40b1ef1da047dc05da7ce219d82b5e1ba5a666418b973fd18"}
Jul 08 07:17:53.429514 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.429474    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:53.429553 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.429528    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:53.430567 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.430543    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 08 07:17:53.446269 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:53.446223    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" podStartSLOduration=1.446208031 podStartE2EDuration="1.446208031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:17:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:17:53.444439613 +0000 UTC m=+1344.153722737" watchObservedRunningTime="2026-07-08 07:17:53.446208031 +0000 UTC m=+1344.155491141"
Jul 08 07:17:54.435036 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:54.434992    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 08 07:17:55.951601 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:55.951574    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:17:56.099157 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.099122    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgjr6\" (UniqueName: \"kubernetes.io/projected/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-kube-api-access-lgjr6\") pod \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") "
Jul 08 07:17:56.099337 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.099177    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-kube-rbac-proxy-sar-config\") pod \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") "
Jul 08 07:17:56.099337 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.099224    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-proxy-tls\") pod \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\" (UID: \"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80\") "
Jul 08 07:17:56.099536 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.099510    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" (UID: "52ac61ec-9f3b-44b7-b7a6-0d31152b9b80"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:17:56.101277 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.101253    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-kube-api-access-lgjr6" (OuterVolumeSpecName: "kube-api-access-lgjr6") pod "52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" (UID: "52ac61ec-9f3b-44b7-b7a6-0d31152b9b80"). InnerVolumeSpecName "kube-api-access-lgjr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:17:56.101277 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.101261    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" (UID: "52ac61ec-9f3b-44b7-b7a6-0d31152b9b80"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:17:56.200182 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.200157    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-proxy-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:17:56.200182 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.200179    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgjr6\" (UniqueName: \"kubernetes.io/projected/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-kube-api-access-lgjr6\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:17:56.200349 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.200189    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:17:56.445675 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.445586    2565 generic.go:356] "Generic (PLEG): container finished" podID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerID="77b1b0085f6c882d7805dc18c35b8fb3a96613020bc2fd1a8d36042d89a996c7" exitCode=0
Jul 08 07:17:56.445675 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.445627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" event={"ID":"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80","Type":"ContainerDied","Data":"77b1b0085f6c882d7805dc18c35b8fb3a96613020bc2fd1a8d36042d89a996c7"}
Jul 08 07:17:56.445675 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.445634    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"
Jul 08 07:17:56.445893 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.445682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt" event={"ID":"52ac61ec-9f3b-44b7-b7a6-0d31152b9b80","Type":"ContainerDied","Data":"2263544c7122439dda39e66cfda0b9f61f9460385c78210c0c38a2b759592403"}
Jul 08 07:17:56.445893 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.445710    2565 scope.go:117] "RemoveContainer" containerID="aa1d54a5d3f83747b05fc1acb643d93fe6cf48ab352380d7b3eece70d8ca162d"
Jul 08 07:17:56.454218 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.454202    2565 scope.go:117] "RemoveContainer" containerID="77b1b0085f6c882d7805dc18c35b8fb3a96613020bc2fd1a8d36042d89a996c7"
Jul 08 07:17:56.461505 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.461488    2565 scope.go:117] "RemoveContainer" containerID="aa1d54a5d3f83747b05fc1acb643d93fe6cf48ab352380d7b3eece70d8ca162d"
Jul 08 07:17:56.461752 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:17:56.461735    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa1d54a5d3f83747b05fc1acb643d93fe6cf48ab352380d7b3eece70d8ca162d\": container with ID starting with aa1d54a5d3f83747b05fc1acb643d93fe6cf48ab352380d7b3eece70d8ca162d not found: ID does not exist" containerID="aa1d54a5d3f83747b05fc1acb643d93fe6cf48ab352380d7b3eece70d8ca162d"
Jul 08 07:17:56.461800 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.461760    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa1d54a5d3f83747b05fc1acb643d93fe6cf48ab352380d7b3eece70d8ca162d"} err="failed to get container status \"aa1d54a5d3f83747b05fc1acb643d93fe6cf48ab352380d7b3eece70d8ca162d\": rpc error: code = NotFound desc = could not find container \"aa1d54a5d3f83747b05fc1acb643d93fe6cf48ab352380d7b3eece70d8ca162d\": container with ID starting with aa1d54a5d3f83747b05fc1acb643d93fe6cf48ab352380d7b3eece70d8ca162d not found: ID does not exist"
Jul 08 07:17:56.461800 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.461777    2565 scope.go:117] "RemoveContainer" containerID="77b1b0085f6c882d7805dc18c35b8fb3a96613020bc2fd1a8d36042d89a996c7"
Jul 08 07:17:56.462022 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:17:56.462008    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77b1b0085f6c882d7805dc18c35b8fb3a96613020bc2fd1a8d36042d89a996c7\": container with ID starting with 77b1b0085f6c882d7805dc18c35b8fb3a96613020bc2fd1a8d36042d89a996c7 not found: ID does not exist" containerID="77b1b0085f6c882d7805dc18c35b8fb3a96613020bc2fd1a8d36042d89a996c7"
Jul 08 07:17:56.462089 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.462026    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77b1b0085f6c882d7805dc18c35b8fb3a96613020bc2fd1a8d36042d89a996c7"} err="failed to get container status \"77b1b0085f6c882d7805dc18c35b8fb3a96613020bc2fd1a8d36042d89a996c7\": rpc error: code = NotFound desc = could not find container \"77b1b0085f6c882d7805dc18c35b8fb3a96613020bc2fd1a8d36042d89a996c7\": container with ID starting with 77b1b0085f6c882d7805dc18c35b8fb3a96613020bc2fd1a8d36042d89a996c7 not found: ID does not exist"
Jul 08 07:17:56.467178 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.467156    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"]
Jul 08 07:17:56.471067 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:56.471046    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8ecaa-predictor-77959c96b6-2sdwt"]
Jul 08 07:17:57.034953 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:57.034918    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" path="/var/lib/kubelet/pods/52ac61ec-9f3b-44b7-b7a6-0d31152b9b80/volumes"
Jul 08 07:17:59.445621 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:59.445593    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:17:59.446112 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:17:59.446027    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 08 07:18:01.307735 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:18:01.307694    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 08 07:18:09.446337 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:18:09.446295    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 08 07:18:11.308297 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:18:11.308271    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:18:19.446186 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:18:19.446142    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 08 07:18:23.085961 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:18:23.085914    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:18:24.247775 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:18:24.247742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:18:29.446420 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:18:29.446383    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 08 07:18:39.447225 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:18:39.447191    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:18:39.713655 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:18:39.713566    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:18:52.913629 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:18:52.913594    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:18:53.098504 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:18:53.098455    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:19:53.691927 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:19:53.691893    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:20:30.979420 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:20:30.979387    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:20:30.981435 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:20:30.981411    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:25:31.008961 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:25:31.008931    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:25:31.010857 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:25:31.010834    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:26:38.071177 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.071145    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"]
Jul 08 07:26:38.071682 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.071523    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kserve-container"
Jul 08 07:26:38.071682 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.071534    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kserve-container"
Jul 08 07:26:38.071682 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.071553    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kube-rbac-proxy"
Jul 08 07:26:38.071682 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.071560    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kube-rbac-proxy"
Jul 08 07:26:38.071682 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.071632    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kube-rbac-proxy"
Jul 08 07:26:38.071682 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.071640    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="52ac61ec-9f3b-44b7-b7a6-0d31152b9b80" containerName="kserve-container"
Jul 08 07:26:38.074407 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.074382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:38.076274 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.076249    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"]
Jul 08 07:26:38.076444 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.076425    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kserve-container" containerID="cri-o://26ddb29f77004454c65283725279d1fec75826a43eb1c49d86ade4b58593c49e" gracePeriod=30
Jul 08 07:26:38.076543 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.076503    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kube-rbac-proxy" containerID="cri-o://e9d44a72c504f1ae67a31382b2818e68c7e91f4c06c82434ec5db57bfbfd2c1c" gracePeriod=30
Jul 08 07:26:38.077285 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.077098    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-71ab7-predictor-serving-cert\""
Jul 08 07:26:38.077285 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.077127    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-71ab7-kube-rbac-proxy-sar-config\""
Jul 08 07:26:38.086848 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.086823    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"]
Jul 08 07:26:38.159994 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.159952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/37e8f576-c234-428f-a684-d60435b1c49a-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7\" (UID: \"37e8f576-c234-428f-a684-d60435b1c49a\") " pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:38.160774 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.160729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/37e8f576-c234-428f-a684-d60435b1c49a-proxy-tls\") pod \"success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7\" (UID: \"37e8f576-c234-428f-a684-d60435b1c49a\") " pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:38.160914 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.160776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp7r7\" (UniqueName: \"kubernetes.io/projected/37e8f576-c234-428f-a684-d60435b1c49a-kube-api-access-jp7r7\") pod \"success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7\" (UID: \"37e8f576-c234-428f-a684-d60435b1c49a\") " pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:38.261420 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.261383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/37e8f576-c234-428f-a684-d60435b1c49a-proxy-tls\") pod \"success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7\" (UID: \"37e8f576-c234-428f-a684-d60435b1c49a\") " pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:38.261601 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.261428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7r7\" (UniqueName: \"kubernetes.io/projected/37e8f576-c234-428f-a684-d60435b1c49a-kube-api-access-jp7r7\") pod \"success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7\" (UID: \"37e8f576-c234-428f-a684-d60435b1c49a\") " pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:38.261601 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.261500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/37e8f576-c234-428f-a684-d60435b1c49a-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7\" (UID: \"37e8f576-c234-428f-a684-d60435b1c49a\") " pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:38.262252 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.262227    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/37e8f576-c234-428f-a684-d60435b1c49a-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7\" (UID: \"37e8f576-c234-428f-a684-d60435b1c49a\") " pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:38.263833 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.263806    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/37e8f576-c234-428f-a684-d60435b1c49a-proxy-tls\") pod \"success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7\" (UID: \"37e8f576-c234-428f-a684-d60435b1c49a\") " pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:38.270208 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.270181    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp7r7\" (UniqueName: \"kubernetes.io/projected/37e8f576-c234-428f-a684-d60435b1c49a-kube-api-access-jp7r7\") pod \"success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7\" (UID: \"37e8f576-c234-428f-a684-d60435b1c49a\") " pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:38.395694 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.395585    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:38.530696 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.530659    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"]
Jul 08 07:26:38.533003 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:26:38.532976    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e8f576_c234_428f_a684_d60435b1c49a.slice/crio-a0efcb3b96b6faee1e80750abedef000ec4c5e72d143b4d4e672f5b13d224917 WatchSource:0}: Error finding container a0efcb3b96b6faee1e80750abedef000ec4c5e72d143b4d4e672f5b13d224917: Status 404 returned error can't find the container with id a0efcb3b96b6faee1e80750abedef000ec4c5e72d143b4d4e672f5b13d224917
Jul 08 07:26:38.736769 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.736726    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" event={"ID":"37e8f576-c234-428f-a684-d60435b1c49a","Type":"ContainerStarted","Data":"2769326f5ac0ccf04184a5fa1cd3a527a9a928dcd0b5bd883596fed76095df90"}
Jul 08 07:26:38.736975 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.736905    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:38.737054 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.736969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" event={"ID":"37e8f576-c234-428f-a684-d60435b1c49a","Type":"ContainerStarted","Data":"c9ab3719f5804089964d9806c3e2049c54d85b2a21be63590b6f4ca175710b16"}
Jul 08 07:26:38.737054 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.737010    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:38.737054 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.737039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" event={"ID":"37e8f576-c234-428f-a684-d60435b1c49a","Type":"ContainerStarted","Data":"a0efcb3b96b6faee1e80750abedef000ec4c5e72d143b4d4e672f5b13d224917"}
Jul 08 07:26:38.741850 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.738862    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 08 07:26:38.745100 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.745044    2565 generic.go:356] "Generic (PLEG): container finished" podID="35e31efb-2307-4832-a698-103153cd6cdc" containerID="e9d44a72c504f1ae67a31382b2818e68c7e91f4c06c82434ec5db57bfbfd2c1c" exitCode=2
Jul 08 07:26:38.745204 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.745045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" event={"ID":"35e31efb-2307-4832-a698-103153cd6cdc","Type":"ContainerDied","Data":"e9d44a72c504f1ae67a31382b2818e68c7e91f4c06c82434ec5db57bfbfd2c1c"}
Jul 08 07:26:38.761813 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.761759    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" podStartSLOduration=0.761743605 podStartE2EDuration="761.743605ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:26:38.75947055 +0000 UTC m=+1869.468753662" watchObservedRunningTime="2026-07-08 07:26:38.761743605 +0000 UTC m=+1869.471026715"
Jul 08 07:26:38.762632 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:38.762610    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:26:39.750730 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:39.750694    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 08 07:26:40.080753 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:40.080722    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:26:41.332665 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.332636    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:26:41.489675 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.489606    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/35e31efb-2307-4832-a698-103153cd6cdc-kube-rbac-proxy-sar-config\") pod \"35e31efb-2307-4832-a698-103153cd6cdc\" (UID: \"35e31efb-2307-4832-a698-103153cd6cdc\") "
Jul 08 07:26:41.489825 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.489701    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/35e31efb-2307-4832-a698-103153cd6cdc-proxy-tls\") pod \"35e31efb-2307-4832-a698-103153cd6cdc\" (UID: \"35e31efb-2307-4832-a698-103153cd6cdc\") "
Jul 08 07:26:41.489825 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.489725    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htb4l\" (UniqueName: \"kubernetes.io/projected/35e31efb-2307-4832-a698-103153cd6cdc-kube-api-access-htb4l\") pod \"35e31efb-2307-4832-a698-103153cd6cdc\" (UID: \"35e31efb-2307-4832-a698-103153cd6cdc\") "
Jul 08 07:26:41.490027 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.490000    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35e31efb-2307-4832-a698-103153cd6cdc-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "35e31efb-2307-4832-a698-103153cd6cdc" (UID: "35e31efb-2307-4832-a698-103153cd6cdc"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:26:41.491692 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.491659    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e31efb-2307-4832-a698-103153cd6cdc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "35e31efb-2307-4832-a698-103153cd6cdc" (UID: "35e31efb-2307-4832-a698-103153cd6cdc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:26:41.491808 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.491715    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35e31efb-2307-4832-a698-103153cd6cdc-kube-api-access-htb4l" (OuterVolumeSpecName: "kube-api-access-htb4l") pod "35e31efb-2307-4832-a698-103153cd6cdc" (UID: "35e31efb-2307-4832-a698-103153cd6cdc"). InnerVolumeSpecName "kube-api-access-htb4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:26:41.590564 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.590535    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/35e31efb-2307-4832-a698-103153cd6cdc-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:26:41.590564 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.590565    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/35e31efb-2307-4832-a698-103153cd6cdc-proxy-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:26:41.590767 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.590574    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htb4l\" (UniqueName: \"kubernetes.io/projected/35e31efb-2307-4832-a698-103153cd6cdc-kube-api-access-htb4l\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:26:41.760466 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.760378    2565 generic.go:356] "Generic (PLEG): container finished" podID="35e31efb-2307-4832-a698-103153cd6cdc" containerID="26ddb29f77004454c65283725279d1fec75826a43eb1c49d86ade4b58593c49e" exitCode=0
Jul 08 07:26:41.760466 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.760432    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"
Jul 08 07:26:41.760679 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.760459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" event={"ID":"35e31efb-2307-4832-a698-103153cd6cdc","Type":"ContainerDied","Data":"26ddb29f77004454c65283725279d1fec75826a43eb1c49d86ade4b58593c49e"}
Jul 08 07:26:41.760679 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.760528    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" event={"ID":"35e31efb-2307-4832-a698-103153cd6cdc","Type":"ContainerDied","Data":"aa3d9b92b25fd1a6d26206bf0e7901443725c0819991d0024e27293bd1f97d19"}
Jul 08 07:26:41.760679 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.760567    2565 scope.go:117] "RemoveContainer" containerID="e9d44a72c504f1ae67a31382b2818e68c7e91f4c06c82434ec5db57bfbfd2c1c"
Jul 08 07:26:41.769446 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.769431    2565 scope.go:117] "RemoveContainer" containerID="26ddb29f77004454c65283725279d1fec75826a43eb1c49d86ade4b58593c49e"
Jul 08 07:26:41.776957 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.776942    2565 scope.go:117] "RemoveContainer" containerID="e9d44a72c504f1ae67a31382b2818e68c7e91f4c06c82434ec5db57bfbfd2c1c"
Jul 08 07:26:41.777278 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:26:41.777257    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9d44a72c504f1ae67a31382b2818e68c7e91f4c06c82434ec5db57bfbfd2c1c\": container with ID starting with e9d44a72c504f1ae67a31382b2818e68c7e91f4c06c82434ec5db57bfbfd2c1c not found: ID does not exist" containerID="e9d44a72c504f1ae67a31382b2818e68c7e91f4c06c82434ec5db57bfbfd2c1c"
Jul 08 07:26:41.777374 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.777285    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9d44a72c504f1ae67a31382b2818e68c7e91f4c06c82434ec5db57bfbfd2c1c"} err="failed to get container status \"e9d44a72c504f1ae67a31382b2818e68c7e91f4c06c82434ec5db57bfbfd2c1c\": rpc error: code = NotFound desc = could not find container \"e9d44a72c504f1ae67a31382b2818e68c7e91f4c06c82434ec5db57bfbfd2c1c\": container with ID starting with e9d44a72c504f1ae67a31382b2818e68c7e91f4c06c82434ec5db57bfbfd2c1c not found: ID does not exist"
Jul 08 07:26:41.777374 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.777302    2565 scope.go:117] "RemoveContainer" containerID="26ddb29f77004454c65283725279d1fec75826a43eb1c49d86ade4b58593c49e"
Jul 08 07:26:41.777535 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:26:41.777518    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ddb29f77004454c65283725279d1fec75826a43eb1c49d86ade4b58593c49e\": container with ID starting with 26ddb29f77004454c65283725279d1fec75826a43eb1c49d86ade4b58593c49e not found: ID does not exist" containerID="26ddb29f77004454c65283725279d1fec75826a43eb1c49d86ade4b58593c49e"
Jul 08 07:26:41.777583 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.777538    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ddb29f77004454c65283725279d1fec75826a43eb1c49d86ade4b58593c49e"} err="failed to get container status \"26ddb29f77004454c65283725279d1fec75826a43eb1c49d86ade4b58593c49e\": rpc error: code = NotFound desc = could not find container \"26ddb29f77004454c65283725279d1fec75826a43eb1c49d86ade4b58593c49e\": container with ID starting with 26ddb29f77004454c65283725279d1fec75826a43eb1c49d86ade4b58593c49e not found: ID does not exist"
Jul 08 07:26:41.782680 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.782656    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"]
Jul 08 07:26:41.786823 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:41.786802    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd"]
Jul 08 07:26:42.302556 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:42.302503    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.34:8643/healthz\": context deadline exceeded"
Jul 08 07:26:42.308242 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:42.308220    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f938-predictor-59f689c956-lzsxd" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: i/o timeout"
Jul 08 07:26:43.034878 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:43.034843    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35e31efb-2307-4832-a698-103153cd6cdc" path="/var/lib/kubelet/pods/35e31efb-2307-4832-a698-103153cd6cdc/volumes"
Jul 08 07:26:44.755772 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:44.755744    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:26:44.756258 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:44.756212    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 08 07:26:54.756659 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:26:54.756554    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 08 07:27:04.756392 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:04.756346    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 08 07:27:07.406637 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.406600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:27:07.504507 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.504472    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"]
Jul 08 07:27:07.504835 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.504806    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kserve-container" containerID="cri-o://25b183f1bc4924bdfd401e88b5e76c3b60c10bb5f459823b64e3ef85e36748d8" gracePeriod=30
Jul 08 07:27:07.504924 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.504826    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kube-rbac-proxy" containerID="cri-o://09be524da0d609fd02421edc4aca11cd919c422cdaf5586a58cd573c1089c029" gracePeriod=30
Jul 08 07:27:07.514923 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.514891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:27:07.528357 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.528322    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"]
Jul 08 07:27:07.528727 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.528708    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kube-rbac-proxy"
Jul 08 07:27:07.528727 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.528727    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kube-rbac-proxy"
Jul 08 07:27:07.528867 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.528756    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kserve-container"
Jul 08 07:27:07.528867 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.528762    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kserve-container"
Jul 08 07:27:07.528867 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.528836    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kserve-container"
Jul 08 07:27:07.528867 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.528849    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e31efb-2307-4832-a698-103153cd6cdc" containerName="kube-rbac-proxy"
Jul 08 07:27:07.532166 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.532146    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:07.534673 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.534651    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-3274f-predictor-serving-cert\""
Jul 08 07:27:07.534791 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.534656    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-3274f-kube-rbac-proxy-sar-config\""
Jul 08 07:27:07.540742 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.540721    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"]
Jul 08 07:27:07.597144 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.597112    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:27:07.633417 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.633381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba528ea2-2bfc-485d-8b88-4370d38b0eed-proxy-tls\") pod \"success-200-isvc-3274f-predictor-cf66786f4-9m5t7\" (UID: \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\") " pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:07.633593 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.633446    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f4nx\" (UniqueName: \"kubernetes.io/projected/ba528ea2-2bfc-485d-8b88-4370d38b0eed-kube-api-access-8f4nx\") pod \"success-200-isvc-3274f-predictor-cf66786f4-9m5t7\" (UID: \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\") " pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:07.633593 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.633496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba528ea2-2bfc-485d-8b88-4370d38b0eed-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-3274f-predictor-cf66786f4-9m5t7\" (UID: \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\") " pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:07.671230 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.671142    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:27:07.734012 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.733979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba528ea2-2bfc-485d-8b88-4370d38b0eed-proxy-tls\") pod \"success-200-isvc-3274f-predictor-cf66786f4-9m5t7\" (UID: \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\") " pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:07.734204 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.734039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f4nx\" (UniqueName: \"kubernetes.io/projected/ba528ea2-2bfc-485d-8b88-4370d38b0eed-kube-api-access-8f4nx\") pod \"success-200-isvc-3274f-predictor-cf66786f4-9m5t7\" (UID: \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\") " pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:07.734204 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.734101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba528ea2-2bfc-485d-8b88-4370d38b0eed-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-3274f-predictor-cf66786f4-9m5t7\" (UID: \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\") " pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:07.734727 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.734705    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba528ea2-2bfc-485d-8b88-4370d38b0eed-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-3274f-predictor-cf66786f4-9m5t7\" (UID: \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\") " pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:07.736542 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.736519    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba528ea2-2bfc-485d-8b88-4370d38b0eed-proxy-tls\") pod \"success-200-isvc-3274f-predictor-cf66786f4-9m5t7\" (UID: \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\") " pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:07.742482 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.742457    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f4nx\" (UniqueName: \"kubernetes.io/projected/ba528ea2-2bfc-485d-8b88-4370d38b0eed-kube-api-access-8f4nx\") pod \"success-200-isvc-3274f-predictor-cf66786f4-9m5t7\" (UID: \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\") " pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:07.776312 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.776278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:27:07.844676 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.844637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:07.891967 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.891931    2565 generic.go:356] "Generic (PLEG): container finished" podID="1864667b-113b-413d-8611-96bc6997a5ce" containerID="09be524da0d609fd02421edc4aca11cd919c422cdaf5586a58cd573c1089c029" exitCode=2
Jul 08 07:27:07.891967 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.891970    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" event={"ID":"1864667b-113b-413d-8611-96bc6997a5ce","Type":"ContainerDied","Data":"09be524da0d609fd02421edc4aca11cd919c422cdaf5586a58cd573c1089c029"}
Jul 08 07:27:07.992632 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:07.992594    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"]
Jul 08 07:27:07.995705 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:27:07.995680    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba528ea2_2bfc_485d_8b88_4370d38b0eed.slice/crio-0aa7e1a303fcbfe6b67ca0ee3fd04401d9c1e628bf29f457022f610502068015 WatchSource:0}: Error finding container 0aa7e1a303fcbfe6b67ca0ee3fd04401d9c1e628bf29f457022f610502068015: Status 404 returned error can't find the container with id 0aa7e1a303fcbfe6b67ca0ee3fd04401d9c1e628bf29f457022f610502068015
Jul 08 07:27:08.205710 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:08.205622    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:27:08.899125 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:08.899084    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" event={"ID":"ba528ea2-2bfc-485d-8b88-4370d38b0eed","Type":"ContainerStarted","Data":"39b428bda167b85ce8d7c2b03a738b001e4030ca3c5c73a364c2d97a5f0bef56"}
Jul 08 07:27:08.899641 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:08.899142    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" event={"ID":"ba528ea2-2bfc-485d-8b88-4370d38b0eed","Type":"ContainerStarted","Data":"be4ce39d3fdb1babe2d031400bc963de1e4b298b9ce336b808b5069a2a9a2af8"}
Jul 08 07:27:08.899641 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:08.899170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" event={"ID":"ba528ea2-2bfc-485d-8b88-4370d38b0eed","Type":"ContainerStarted","Data":"0aa7e1a303fcbfe6b67ca0ee3fd04401d9c1e628bf29f457022f610502068015"}
Jul 08 07:27:08.899641 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:08.899257    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:08.917333 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:08.917265    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" podStartSLOduration=1.917245713 podStartE2EDuration="1.917245713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:27:08.916403294 +0000 UTC m=+1899.625686830" watchObservedRunningTime="2026-07-08 07:27:08.917245713 +0000 UTC m=+1899.626528823"
Jul 08 07:27:09.435523 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:09.435479    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.35:8643/healthz\": dial tcp 10.134.0.35:8643: connect: connection refused"
Jul 08 07:27:09.446138 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:09.446097    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 08 07:27:09.903424 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:09.903349    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:09.904950 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:09.904912    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Jul 08 07:27:10.907831 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:10.907787    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Jul 08 07:27:11.657436 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.657410    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:27:11.772478 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.772398    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1864667b-113b-413d-8611-96bc6997a5ce-proxy-tls\") pod \"1864667b-113b-413d-8611-96bc6997a5ce\" (UID: \"1864667b-113b-413d-8611-96bc6997a5ce\") "
Jul 08 07:27:11.772630 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.772588    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1864667b-113b-413d-8611-96bc6997a5ce-kube-rbac-proxy-sar-config\") pod \"1864667b-113b-413d-8611-96bc6997a5ce\" (UID: \"1864667b-113b-413d-8611-96bc6997a5ce\") "
Jul 08 07:27:11.772630 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.772610    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn4nc\" (UniqueName: \"kubernetes.io/projected/1864667b-113b-413d-8611-96bc6997a5ce-kube-api-access-bn4nc\") pod \"1864667b-113b-413d-8611-96bc6997a5ce\" (UID: \"1864667b-113b-413d-8611-96bc6997a5ce\") "
Jul 08 07:27:11.772961 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.772933    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1864667b-113b-413d-8611-96bc6997a5ce-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "1864667b-113b-413d-8611-96bc6997a5ce" (UID: "1864667b-113b-413d-8611-96bc6997a5ce"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:27:11.774539 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.774520    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1864667b-113b-413d-8611-96bc6997a5ce-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1864667b-113b-413d-8611-96bc6997a5ce" (UID: "1864667b-113b-413d-8611-96bc6997a5ce"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:27:11.774596 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.774570    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1864667b-113b-413d-8611-96bc6997a5ce-kube-api-access-bn4nc" (OuterVolumeSpecName: "kube-api-access-bn4nc") pod "1864667b-113b-413d-8611-96bc6997a5ce" (UID: "1864667b-113b-413d-8611-96bc6997a5ce"). InnerVolumeSpecName "kube-api-access-bn4nc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:27:11.874096 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.874017    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1864667b-113b-413d-8611-96bc6997a5ce-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:27:11.874096 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.874066    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn4nc\" (UniqueName: \"kubernetes.io/projected/1864667b-113b-413d-8611-96bc6997a5ce-kube-api-access-bn4nc\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:27:11.874096 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.874104    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1864667b-113b-413d-8611-96bc6997a5ce-proxy-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:27:11.913067 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.913033    2565 generic.go:356] "Generic (PLEG): container finished" podID="1864667b-113b-413d-8611-96bc6997a5ce" containerID="25b183f1bc4924bdfd401e88b5e76c3b60c10bb5f459823b64e3ef85e36748d8" exitCode=0
Jul 08 07:27:11.913464 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.913112    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"
Jul 08 07:27:11.913464 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.913120    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" event={"ID":"1864667b-113b-413d-8611-96bc6997a5ce","Type":"ContainerDied","Data":"25b183f1bc4924bdfd401e88b5e76c3b60c10bb5f459823b64e3ef85e36748d8"}
Jul 08 07:27:11.913464 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.913192    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5" event={"ID":"1864667b-113b-413d-8611-96bc6997a5ce","Type":"ContainerDied","Data":"71f42f555e7144a40b1ef1da047dc05da7ce219d82b5e1ba5a666418b973fd18"}
Jul 08 07:27:11.913464 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.913231    2565 scope.go:117] "RemoveContainer" containerID="09be524da0d609fd02421edc4aca11cd919c422cdaf5586a58cd573c1089c029"
Jul 08 07:27:11.922564 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.922547    2565 scope.go:117] "RemoveContainer" containerID="25b183f1bc4924bdfd401e88b5e76c3b60c10bb5f459823b64e3ef85e36748d8"
Jul 08 07:27:11.930279 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.930260    2565 scope.go:117] "RemoveContainer" containerID="09be524da0d609fd02421edc4aca11cd919c422cdaf5586a58cd573c1089c029"
Jul 08 07:27:11.930555 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:27:11.930535    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09be524da0d609fd02421edc4aca11cd919c422cdaf5586a58cd573c1089c029\": container with ID starting with 09be524da0d609fd02421edc4aca11cd919c422cdaf5586a58cd573c1089c029 not found: ID does not exist" containerID="09be524da0d609fd02421edc4aca11cd919c422cdaf5586a58cd573c1089c029"
Jul 08 07:27:11.930612 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.930565    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09be524da0d609fd02421edc4aca11cd919c422cdaf5586a58cd573c1089c029"} err="failed to get container status \"09be524da0d609fd02421edc4aca11cd919c422cdaf5586a58cd573c1089c029\": rpc error: code = NotFound desc = could not find container \"09be524da0d609fd02421edc4aca11cd919c422cdaf5586a58cd573c1089c029\": container with ID starting with 09be524da0d609fd02421edc4aca11cd919c422cdaf5586a58cd573c1089c029 not found: ID does not exist"
Jul 08 07:27:11.930612 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.930582    2565 scope.go:117] "RemoveContainer" containerID="25b183f1bc4924bdfd401e88b5e76c3b60c10bb5f459823b64e3ef85e36748d8"
Jul 08 07:27:11.930821 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:27:11.930803    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25b183f1bc4924bdfd401e88b5e76c3b60c10bb5f459823b64e3ef85e36748d8\": container with ID starting with 25b183f1bc4924bdfd401e88b5e76c3b60c10bb5f459823b64e3ef85e36748d8 not found: ID does not exist" containerID="25b183f1bc4924bdfd401e88b5e76c3b60c10bb5f459823b64e3ef85e36748d8"
Jul 08 07:27:11.930864 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.930828    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25b183f1bc4924bdfd401e88b5e76c3b60c10bb5f459823b64e3ef85e36748d8"} err="failed to get container status \"25b183f1bc4924bdfd401e88b5e76c3b60c10bb5f459823b64e3ef85e36748d8\": rpc error: code = NotFound desc = could not find container \"25b183f1bc4924bdfd401e88b5e76c3b60c10bb5f459823b64e3ef85e36748d8\": container with ID starting with 25b183f1bc4924bdfd401e88b5e76c3b60c10bb5f459823b64e3ef85e36748d8 not found: ID does not exist"
Jul 08 07:27:11.933926 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.933902    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"]
Jul 08 07:27:11.937355 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:11.937330    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-3d727-predictor-79f4459548-fkxl5"]
Jul 08 07:27:13.035295 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:13.035261    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1864667b-113b-413d-8611-96bc6997a5ce" path="/var/lib/kubelet/pods/1864667b-113b-413d-8611-96bc6997a5ce/volumes"
Jul 08 07:27:14.756369 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:14.756324    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 08 07:27:15.912001 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:15.911968    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:27:15.912484 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:15.912454    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Jul 08 07:27:24.757221 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:24.757187    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:27:25.913323 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:25.913279    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Jul 08 07:27:35.912998 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:35.912954    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Jul 08 07:27:38.107026 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:38.106986    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:27:38.413782 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:38.413693    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:27:45.912703 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:45.912660    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Jul 08 07:27:48.204112 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.203983    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:27:48.292998 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.292967    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"]
Jul 08 07:27:48.293261 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.293218    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kserve-container" containerID="cri-o://c9ab3719f5804089964d9806c3e2049c54d85b2a21be63590b6f4ca175710b16" gracePeriod=30
Jul 08 07:27:48.293348 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.293248    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kube-rbac-proxy" containerID="cri-o://2769326f5ac0ccf04184a5fa1cd3a527a9a928dcd0b5bd883596fed76095df90" gracePeriod=30
Jul 08 07:27:48.301255 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.301228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:27:48.317385 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.317354    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"]
Jul 08 07:27:48.317761 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.317741    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kserve-container"
Jul 08 07:27:48.317761 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.317758    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kserve-container"
Jul 08 07:27:48.317761 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.317765    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kube-rbac-proxy"
Jul 08 07:27:48.317938 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.317771    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kube-rbac-proxy"
Jul 08 07:27:48.317938 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.317845    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kserve-container"
Jul 08 07:27:48.317938 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.317857    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1864667b-113b-413d-8611-96bc6997a5ce" containerName="kube-rbac-proxy"
Jul 08 07:27:48.320806 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.320785    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:48.323227 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.323203    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9de39-kube-rbac-proxy-sar-config\""
Jul 08 07:27:48.323353 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.323331    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9de39-predictor-serving-cert\""
Jul 08 07:27:48.330148 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.330126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"]
Jul 08 07:27:48.402183 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.402138    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:27:48.413607 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.413572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-proxy-tls\") pod \"success-200-isvc-9de39-predictor-7575d6d4cd-ppr27\" (UID: \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\") " pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:48.413763 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.413675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9de39-predictor-7575d6d4cd-ppr27\" (UID: \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\") " pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:48.413763 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.413709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c586q\" (UniqueName: \"kubernetes.io/projected/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-kube-api-access-c586q\") pod \"success-200-isvc-9de39-predictor-7575d6d4cd-ppr27\" (UID: \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\") " pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:48.501633 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.501551    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:27:48.514765 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.514730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-proxy-tls\") pod \"success-200-isvc-9de39-predictor-7575d6d4cd-ppr27\" (UID: \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\") " pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:48.514919 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.514809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9de39-predictor-7575d6d4cd-ppr27\" (UID: \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\") " pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:48.514919 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.514835    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c586q\" (UniqueName: \"kubernetes.io/projected/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-kube-api-access-c586q\") pod \"success-200-isvc-9de39-predictor-7575d6d4cd-ppr27\" (UID: \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\") " pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:48.515587 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.515560    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9de39-predictor-7575d6d4cd-ppr27\" (UID: \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\") " pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:48.517388 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.517362    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-proxy-tls\") pod \"success-200-isvc-9de39-predictor-7575d6d4cd-ppr27\" (UID: \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\") " pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:48.523345 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.523317    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c586q\" (UniqueName: \"kubernetes.io/projected/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-kube-api-access-c586q\") pod \"success-200-isvc-9de39-predictor-7575d6d4cd-ppr27\" (UID: \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\") " pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:48.600467 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.600432    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:27:48.633503 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.633463    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:48.772178 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:48.772153    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"]
Jul 08 07:27:48.774656 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:27:48.774625    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c00819_7ab0_43dc_bfc3_8f2b857cdec2.slice/crio-de9d8a86665b9a90df1688acac08d68baeb841d2e54424db21f932111891a112 WatchSource:0}: Error finding container de9d8a86665b9a90df1688acac08d68baeb841d2e54424db21f932111891a112: Status 404 returned error can't find the container with id de9d8a86665b9a90df1688acac08d68baeb841d2e54424db21f932111891a112
Jul 08 07:27:49.091909 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:49.091873    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" event={"ID":"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2","Type":"ContainerStarted","Data":"c14a1a2c0db732062a75fe8c7b9029dfda91b8342315c4f4ee46094533b61360"}
Jul 08 07:27:49.092131 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:49.091944    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:49.092131 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:49.091975    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:49.092131 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:49.091998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" event={"ID":"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2","Type":"ContainerStarted","Data":"1a09ad6aa0d522b3acff3b7d0dc52c9a6354c25ceb36bf5898ce08af62836195"}
Jul 08 07:27:49.092131 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:49.092023    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" event={"ID":"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2","Type":"ContainerStarted","Data":"de9d8a86665b9a90df1688acac08d68baeb841d2e54424db21f932111891a112"}
Jul 08 07:27:49.093531 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:49.093498    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Jul 08 07:27:49.093840 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:49.093821    2565 generic.go:356] "Generic (PLEG): container finished" podID="37e8f576-c234-428f-a684-d60435b1c49a" containerID="2769326f5ac0ccf04184a5fa1cd3a527a9a928dcd0b5bd883596fed76095df90" exitCode=2
Jul 08 07:27:49.093906 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:49.093870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" event={"ID":"37e8f576-c234-428f-a684-d60435b1c49a","Type":"ContainerDied","Data":"2769326f5ac0ccf04184a5fa1cd3a527a9a928dcd0b5bd883596fed76095df90"}
Jul 08 07:27:49.110458 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:49.110410    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" podStartSLOduration=1.110395008 podStartE2EDuration="1.110395008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:27:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:27:49.108279774 +0000 UTC m=+1939.817562925" watchObservedRunningTime="2026-07-08 07:27:49.110395008 +0000 UTC m=+1939.819678119"
Jul 08 07:27:49.751479 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:49.751434    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.36:8643/healthz\": dial tcp 10.134.0.36:8643: connect: connection refused"
Jul 08 07:27:50.099404 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:50.099366    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Jul 08 07:27:51.648532 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:51.648503    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:27:51.745387 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:51.745296    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp7r7\" (UniqueName: \"kubernetes.io/projected/37e8f576-c234-428f-a684-d60435b1c49a-kube-api-access-jp7r7\") pod \"37e8f576-c234-428f-a684-d60435b1c49a\" (UID: \"37e8f576-c234-428f-a684-d60435b1c49a\") "
Jul 08 07:27:51.745387 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:51.745380    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/37e8f576-c234-428f-a684-d60435b1c49a-proxy-tls\") pod \"37e8f576-c234-428f-a684-d60435b1c49a\" (UID: \"37e8f576-c234-428f-a684-d60435b1c49a\") "
Jul 08 07:27:51.745589 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:51.745407    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/37e8f576-c234-428f-a684-d60435b1c49a-kube-rbac-proxy-sar-config\") pod \"37e8f576-c234-428f-a684-d60435b1c49a\" (UID: \"37e8f576-c234-428f-a684-d60435b1c49a\") "
Jul 08 07:27:51.745857 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:51.745826    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37e8f576-c234-428f-a684-d60435b1c49a-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "37e8f576-c234-428f-a684-d60435b1c49a" (UID: "37e8f576-c234-428f-a684-d60435b1c49a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:27:51.747319 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:51.747299    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e8f576-c234-428f-a684-d60435b1c49a-kube-api-access-jp7r7" (OuterVolumeSpecName: "kube-api-access-jp7r7") pod "37e8f576-c234-428f-a684-d60435b1c49a" (UID: "37e8f576-c234-428f-a684-d60435b1c49a"). InnerVolumeSpecName "kube-api-access-jp7r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:27:51.747499 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:51.747482    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37e8f576-c234-428f-a684-d60435b1c49a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "37e8f576-c234-428f-a684-d60435b1c49a" (UID: "37e8f576-c234-428f-a684-d60435b1c49a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:27:51.846674 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:51.846636    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/37e8f576-c234-428f-a684-d60435b1c49a-proxy-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:27:51.846674 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:51.846666    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/37e8f576-c234-428f-a684-d60435b1c49a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:27:51.846674 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:51.846676    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp7r7\" (UniqueName: \"kubernetes.io/projected/37e8f576-c234-428f-a684-d60435b1c49a-kube-api-access-jp7r7\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:27:52.109161 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:52.109122    2565 generic.go:356] "Generic (PLEG): container finished" podID="37e8f576-c234-428f-a684-d60435b1c49a" containerID="c9ab3719f5804089964d9806c3e2049c54d85b2a21be63590b6f4ca175710b16" exitCode=0
Jul 08 07:27:52.109337 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:52.109171    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"
Jul 08 07:27:52.109337 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:52.109172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" event={"ID":"37e8f576-c234-428f-a684-d60435b1c49a","Type":"ContainerDied","Data":"c9ab3719f5804089964d9806c3e2049c54d85b2a21be63590b6f4ca175710b16"}
Jul 08 07:27:52.109337 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:52.109307    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7" event={"ID":"37e8f576-c234-428f-a684-d60435b1c49a","Type":"ContainerDied","Data":"a0efcb3b96b6faee1e80750abedef000ec4c5e72d143b4d4e672f5b13d224917"}
Jul 08 07:27:52.109337 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:52.109336    2565 scope.go:117] "RemoveContainer" containerID="2769326f5ac0ccf04184a5fa1cd3a527a9a928dcd0b5bd883596fed76095df90"
Jul 08 07:27:52.118479 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:52.118460    2565 scope.go:117] "RemoveContainer" containerID="c9ab3719f5804089964d9806c3e2049c54d85b2a21be63590b6f4ca175710b16"
Jul 08 07:27:52.125695 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:52.125674    2565 scope.go:117] "RemoveContainer" containerID="2769326f5ac0ccf04184a5fa1cd3a527a9a928dcd0b5bd883596fed76095df90"
Jul 08 07:27:52.125932 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:27:52.125910    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2769326f5ac0ccf04184a5fa1cd3a527a9a928dcd0b5bd883596fed76095df90\": container with ID starting with 2769326f5ac0ccf04184a5fa1cd3a527a9a928dcd0b5bd883596fed76095df90 not found: ID does not exist" containerID="2769326f5ac0ccf04184a5fa1cd3a527a9a928dcd0b5bd883596fed76095df90"
Jul 08 07:27:52.126048 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:52.125938    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2769326f5ac0ccf04184a5fa1cd3a527a9a928dcd0b5bd883596fed76095df90"} err="failed to get container status \"2769326f5ac0ccf04184a5fa1cd3a527a9a928dcd0b5bd883596fed76095df90\": rpc error: code = NotFound desc = could not find container \"2769326f5ac0ccf04184a5fa1cd3a527a9a928dcd0b5bd883596fed76095df90\": container with ID starting with 2769326f5ac0ccf04184a5fa1cd3a527a9a928dcd0b5bd883596fed76095df90 not found: ID does not exist"
Jul 08 07:27:52.126048 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:52.125954    2565 scope.go:117] "RemoveContainer" containerID="c9ab3719f5804089964d9806c3e2049c54d85b2a21be63590b6f4ca175710b16"
Jul 08 07:27:52.126216 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:27:52.126185    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9ab3719f5804089964d9806c3e2049c54d85b2a21be63590b6f4ca175710b16\": container with ID starting with c9ab3719f5804089964d9806c3e2049c54d85b2a21be63590b6f4ca175710b16 not found: ID does not exist" containerID="c9ab3719f5804089964d9806c3e2049c54d85b2a21be63590b6f4ca175710b16"
Jul 08 07:27:52.126216 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:52.126206    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9ab3719f5804089964d9806c3e2049c54d85b2a21be63590b6f4ca175710b16"} err="failed to get container status \"c9ab3719f5804089964d9806c3e2049c54d85b2a21be63590b6f4ca175710b16\": rpc error: code = NotFound desc = could not find container \"c9ab3719f5804089964d9806c3e2049c54d85b2a21be63590b6f4ca175710b16\": container with ID starting with c9ab3719f5804089964d9806c3e2049c54d85b2a21be63590b6f4ca175710b16 not found: ID does not exist"
Jul 08 07:27:52.129890 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:52.129868    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"]
Jul 08 07:27:52.133766 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:52.133746    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-71ab7-predictor-6b54d7bd58-f96g7"]
Jul 08 07:27:53.035874 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:53.035837    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37e8f576-c234-428f-a684-d60435b1c49a" path="/var/lib/kubelet/pods/37e8f576-c234-428f-a684-d60435b1c49a/volumes"
Jul 08 07:27:55.103621 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:55.103590    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:27:55.104147 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:55.104120    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Jul 08 07:27:55.913256 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:27:55.913221    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:28:05.104401 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:28:05.104362    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Jul 08 07:28:07.382010 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:28:07.381979    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:28:07.621920 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:28:07.621886    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:28:07.786629 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:28:07.786531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:28:15.104667 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:28:15.104628    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Jul 08 07:28:25.104396 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:28:25.104315    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Jul 08 07:28:35.104958 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:28:35.104929    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:28:48.404997 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:28:48.404962    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:28:48.616454 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:28:48.616422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:29:22.284780 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:29:22.284739    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:29:50.921284 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:29:50.921235    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:30:31.038358 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:30:31.038332    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:30:31.040976 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:30:31.040479    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:32:13.754457 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:32:13.754421    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:35:31.032824 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:35:31.032790    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:35:31.067475 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:35:31.067371    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:35:31.071510 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:35:31.070916    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:37:03.095646 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:03.095611    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:37:03.170190 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:03.170155    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"]
Jul 08 07:37:03.170426 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:03.170393    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kserve-container" containerID="cri-o://1a09ad6aa0d522b3acff3b7d0dc52c9a6354c25ceb36bf5898ce08af62836195" gracePeriod=30
Jul 08 07:37:03.170519 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:03.170446    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kube-rbac-proxy" containerID="cri-o://c14a1a2c0db732062a75fe8c7b9029dfda91b8342315c4f4ee46094533b61360" gracePeriod=30
Jul 08 07:37:03.192738 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:03.192708    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:37:03.250052 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:03.250018    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:37:03.537005 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:03.536903    2565 generic.go:356] "Generic (PLEG): container finished" podID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerID="c14a1a2c0db732062a75fe8c7b9029dfda91b8342315c4f4ee46094533b61360" exitCode=2
Jul 08 07:37:03.537005 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:03.536977    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" event={"ID":"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2","Type":"ContainerDied","Data":"c14a1a2c0db732062a75fe8c7b9029dfda91b8342315c4f4ee46094533b61360"}
Jul 08 07:37:05.100359 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:05.100304    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.38:8643/healthz\": dial tcp 10.134.0.38:8643: connect: connection refused"
Jul 08 07:37:05.104852 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:05.104821    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Jul 08 07:37:06.422321 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.422294    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:37:06.551470 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.551382    2565 generic.go:356] "Generic (PLEG): container finished" podID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerID="1a09ad6aa0d522b3acff3b7d0dc52c9a6354c25ceb36bf5898ce08af62836195" exitCode=0
Jul 08 07:37:06.551470 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.551438    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"
Jul 08 07:37:06.551470 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.551460    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" event={"ID":"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2","Type":"ContainerDied","Data":"1a09ad6aa0d522b3acff3b7d0dc52c9a6354c25ceb36bf5898ce08af62836195"}
Jul 08 07:37:06.551680 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.551531    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27" event={"ID":"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2","Type":"ContainerDied","Data":"de9d8a86665b9a90df1688acac08d68baeb841d2e54424db21f932111891a112"}
Jul 08 07:37:06.551680 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.551569    2565 scope.go:117] "RemoveContainer" containerID="c14a1a2c0db732062a75fe8c7b9029dfda91b8342315c4f4ee46094533b61360"
Jul 08 07:37:06.559938 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.559916    2565 scope.go:117] "RemoveContainer" containerID="1a09ad6aa0d522b3acff3b7d0dc52c9a6354c25ceb36bf5898ce08af62836195"
Jul 08 07:37:06.567583 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.567564    2565 scope.go:117] "RemoveContainer" containerID="c14a1a2c0db732062a75fe8c7b9029dfda91b8342315c4f4ee46094533b61360"
Jul 08 07:37:06.567885 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:37:06.567863    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c14a1a2c0db732062a75fe8c7b9029dfda91b8342315c4f4ee46094533b61360\": container with ID starting with c14a1a2c0db732062a75fe8c7b9029dfda91b8342315c4f4ee46094533b61360 not found: ID does not exist" containerID="c14a1a2c0db732062a75fe8c7b9029dfda91b8342315c4f4ee46094533b61360"
Jul 08 07:37:06.567931 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.567898    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c14a1a2c0db732062a75fe8c7b9029dfda91b8342315c4f4ee46094533b61360"} err="failed to get container status \"c14a1a2c0db732062a75fe8c7b9029dfda91b8342315c4f4ee46094533b61360\": rpc error: code = NotFound desc = could not find container \"c14a1a2c0db732062a75fe8c7b9029dfda91b8342315c4f4ee46094533b61360\": container with ID starting with c14a1a2c0db732062a75fe8c7b9029dfda91b8342315c4f4ee46094533b61360 not found: ID does not exist"
Jul 08 07:37:06.567931 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.567918    2565 scope.go:117] "RemoveContainer" containerID="1a09ad6aa0d522b3acff3b7d0dc52c9a6354c25ceb36bf5898ce08af62836195"
Jul 08 07:37:06.568181 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:37:06.568164    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a09ad6aa0d522b3acff3b7d0dc52c9a6354c25ceb36bf5898ce08af62836195\": container with ID starting with 1a09ad6aa0d522b3acff3b7d0dc52c9a6354c25ceb36bf5898ce08af62836195 not found: ID does not exist" containerID="1a09ad6aa0d522b3acff3b7d0dc52c9a6354c25ceb36bf5898ce08af62836195"
Jul 08 07:37:06.568242 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.568187    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a09ad6aa0d522b3acff3b7d0dc52c9a6354c25ceb36bf5898ce08af62836195"} err="failed to get container status \"1a09ad6aa0d522b3acff3b7d0dc52c9a6354c25ceb36bf5898ce08af62836195\": rpc error: code = NotFound desc = could not find container \"1a09ad6aa0d522b3acff3b7d0dc52c9a6354c25ceb36bf5898ce08af62836195\": container with ID starting with 1a09ad6aa0d522b3acff3b7d0dc52c9a6354c25ceb36bf5898ce08af62836195 not found: ID does not exist"
Jul 08 07:37:06.569466 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.569450    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-kube-rbac-proxy-sar-config\") pod \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\" (UID: \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\") "
Jul 08 07:37:06.569510 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.569491    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c586q\" (UniqueName: \"kubernetes.io/projected/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-kube-api-access-c586q\") pod \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\" (UID: \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\") "
Jul 08 07:37:06.569661 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.569645    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-proxy-tls\") pod \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\" (UID: \"f8c00819-7ab0-43dc-bfc3-8f2b857cdec2\") "
Jul 08 07:37:06.569784 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.569765    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" (UID: "f8c00819-7ab0-43dc-bfc3-8f2b857cdec2"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:37:06.569928 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.569912    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:37:06.571446 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.571419    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-kube-api-access-c586q" (OuterVolumeSpecName: "kube-api-access-c586q") pod "f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" (UID: "f8c00819-7ab0-43dc-bfc3-8f2b857cdec2"). InnerVolumeSpecName "kube-api-access-c586q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:37:06.571531 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.571488    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" (UID: "f8c00819-7ab0-43dc-bfc3-8f2b857cdec2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:37:06.670485 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.670442    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c586q\" (UniqueName: \"kubernetes.io/projected/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-kube-api-access-c586q\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:37:06.670485 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.670475    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2-proxy-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:37:06.872796 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.872730    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"]
Jul 08 07:37:06.874541 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:06.874515    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9de39-predictor-7575d6d4cd-ppr27"]
Jul 08 07:37:07.035707 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:37:07.035676    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" path="/var/lib/kubelet/pods/f8c00819-7ab0-43dc-bfc3-8f2b857cdec2/volumes"
Jul 08 07:39:14.819538 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:39:14.819450    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:40:31.096112 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:40:31.096064    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:40:31.102126 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:40:31.102101    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:44:26.976827 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:26.976792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:44:27.168856 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:27.168818    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"]
Jul 08 07:44:27.169123 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:27.169094    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kserve-container" containerID="cri-o://be4ce39d3fdb1babe2d031400bc963de1e4b298b9ce336b808b5069a2a9a2af8" gracePeriod=30
Jul 08 07:44:27.169236 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:27.169131    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kube-rbac-proxy" containerID="cri-o://39b428bda167b85ce8d7c2b03a738b001e4030ca3c5c73a364c2d97a5f0bef56" gracePeriod=30
Jul 08 07:44:27.408186 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:27.408154    2565 generic.go:356] "Generic (PLEG): container finished" podID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerID="39b428bda167b85ce8d7c2b03a738b001e4030ca3c5c73a364c2d97a5f0bef56" exitCode=2
Jul 08 07:44:27.408344 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:27.408230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" event={"ID":"ba528ea2-2bfc-485d-8b88-4370d38b0eed","Type":"ContainerDied","Data":"39b428bda167b85ce8d7c2b03a738b001e4030ca3c5c73a364c2d97a5f0bef56"}
Jul 08 07:44:28.094727 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.094668    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:44:28.390420 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.390340    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ffwtt/must-gather-vw4t5"]
Jul 08 07:44:28.390705 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.390693    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kserve-container"
Jul 08 07:44:28.390747 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.390706    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kserve-container"
Jul 08 07:44:28.390747 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.390721    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kserve-container"
Jul 08 07:44:28.390747 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.390728    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kserve-container"
Jul 08 07:44:28.390747 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.390735    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kube-rbac-proxy"
Jul 08 07:44:28.390747 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.390741    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kube-rbac-proxy"
Jul 08 07:44:28.390747 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.390748    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kube-rbac-proxy"
Jul 08 07:44:28.390932 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.390754    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kube-rbac-proxy"
Jul 08 07:44:28.390932 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.390811    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kube-rbac-proxy"
Jul 08 07:44:28.390932 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.390819    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e8f576-c234-428f-a684-d60435b1c49a" containerName="kserve-container"
Jul 08 07:44:28.390932 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.390827    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kube-rbac-proxy"
Jul 08 07:44:28.390932 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.390834    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c00819-7ab0-43dc-bfc3-8f2b857cdec2" containerName="kserve-container"
Jul 08 07:44:28.393923 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.393905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:44:28.396874 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.396847    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ffwtt\"/\"kube-root-ca.crt\""
Jul 08 07:44:28.398035 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.398017    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ffwtt\"/\"openshift-service-ca.crt\""
Jul 08 07:44:28.398105 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.398035    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ffwtt\"/\"default-dockercfg-v6vz8\""
Jul 08 07:44:28.408803 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.408780    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ffwtt/must-gather-vw4t5"]
Jul 08 07:44:28.415264 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.415239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:44:28.497154 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.497121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkltd\" (UniqueName: \"kubernetes.io/projected/11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca-kube-api-access-vkltd\") pod \"must-gather-vw4t5\" (UID: \"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca\") " pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:44:28.497154 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.497159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca-must-gather-output\") pod \"must-gather-vw4t5\" (UID: \"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca\") " pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:44:28.513860 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.513828    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:44:28.598149 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.598117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkltd\" (UniqueName: \"kubernetes.io/projected/11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca-kube-api-access-vkltd\") pod \"must-gather-vw4t5\" (UID: \"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca\") " pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:44:28.598317 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.598155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca-must-gather-output\") pod \"must-gather-vw4t5\" (UID: \"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca\") " pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:44:28.598502 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.598485    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca-must-gather-output\") pod \"must-gather-vw4t5\" (UID: \"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca\") " pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:44:28.607379 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.607355    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkltd\" (UniqueName: \"kubernetes.io/projected/11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca-kube-api-access-vkltd\") pod \"must-gather-vw4t5\" (UID: \"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca\") " pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:44:28.717452 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.717377    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:44:28.849616 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:44:28.849584    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11b5a91c_5e61_4b80_b6f0_1e6cd748c8ca.slice/crio-6b84fba96b147a592f3b144a0d70d2b217114d8a9e1d976ae6351143ee046aa3 WatchSource:0}: Error finding container 6b84fba96b147a592f3b144a0d70d2b217114d8a9e1d976ae6351143ee046aa3: Status 404 returned error can't find the container with id 6b84fba96b147a592f3b144a0d70d2b217114d8a9e1d976ae6351143ee046aa3
Jul 08 07:44:28.849734 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.849642    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ffwtt/must-gather-vw4t5"]
Jul 08 07:44:28.851722 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:28.851705    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 07:44:29.418496 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:29.418465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffwtt/must-gather-vw4t5" event={"ID":"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca","Type":"ContainerStarted","Data":"6b84fba96b147a592f3b144a0d70d2b217114d8a9e1d976ae6351143ee046aa3"}
Jul 08 07:44:30.438053 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:30.437852    2565 generic.go:356] "Generic (PLEG): container finished" podID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerID="be4ce39d3fdb1babe2d031400bc963de1e4b298b9ce336b808b5069a2a9a2af8" exitCode=0
Jul 08 07:44:30.438053 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:30.437921    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" event={"ID":"ba528ea2-2bfc-485d-8b88-4370d38b0eed","Type":"ContainerDied","Data":"be4ce39d3fdb1babe2d031400bc963de1e4b298b9ce336b808b5069a2a9a2af8"}
Jul 08 07:44:30.451971 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:30.451943    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:44:30.618194 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:30.618159    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f4nx\" (UniqueName: \"kubernetes.io/projected/ba528ea2-2bfc-485d-8b88-4370d38b0eed-kube-api-access-8f4nx\") pod \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\" (UID: \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\") "
Jul 08 07:44:30.618378 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:30.618213    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba528ea2-2bfc-485d-8b88-4370d38b0eed-kube-rbac-proxy-sar-config\") pod \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\" (UID: \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\") "
Jul 08 07:44:30.618446 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:30.618381    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba528ea2-2bfc-485d-8b88-4370d38b0eed-proxy-tls\") pod \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\" (UID: \"ba528ea2-2bfc-485d-8b88-4370d38b0eed\") "
Jul 08 07:44:30.618631 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:30.618602    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba528ea2-2bfc-485d-8b88-4370d38b0eed-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "ba528ea2-2bfc-485d-8b88-4370d38b0eed" (UID: "ba528ea2-2bfc-485d-8b88-4370d38b0eed"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 07:44:30.618773 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:30.618738    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba528ea2-2bfc-485d-8b88-4370d38b0eed-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:44:30.621157 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:30.621129    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba528ea2-2bfc-485d-8b88-4370d38b0eed-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ba528ea2-2bfc-485d-8b88-4370d38b0eed" (UID: "ba528ea2-2bfc-485d-8b88-4370d38b0eed"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 07:44:30.621264 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:30.621237    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba528ea2-2bfc-485d-8b88-4370d38b0eed-kube-api-access-8f4nx" (OuterVolumeSpecName: "kube-api-access-8f4nx") pod "ba528ea2-2bfc-485d-8b88-4370d38b0eed" (UID: "ba528ea2-2bfc-485d-8b88-4370d38b0eed"). InnerVolumeSpecName "kube-api-access-8f4nx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:44:30.720114 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:30.720002    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f4nx\" (UniqueName: \"kubernetes.io/projected/ba528ea2-2bfc-485d-8b88-4370d38b0eed-kube-api-access-8f4nx\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:44:30.720114 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:30.720038    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba528ea2-2bfc-485d-8b88-4370d38b0eed-proxy-tls\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:44:31.233931 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:31.233804    2565 scope.go:117] "RemoveContainer" containerID="be4ce39d3fdb1babe2d031400bc963de1e4b298b9ce336b808b5069a2a9a2af8"
Jul 08 07:44:31.445252 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:31.445201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7" event={"ID":"ba528ea2-2bfc-485d-8b88-4370d38b0eed","Type":"ContainerDied","Data":"0aa7e1a303fcbfe6b67ca0ee3fd04401d9c1e628bf29f457022f610502068015"}
Jul 08 07:44:31.445252 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:31.445230    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"
Jul 08 07:44:31.445760 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:31.445337    2565 scope.go:117] "RemoveContainer" containerID="39b428bda167b85ce8d7c2b03a738b001e4030ca3c5c73a364c2d97a5f0bef56"
Jul 08 07:44:31.473905 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:31.473787    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"]
Jul 08 07:44:31.476930 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:31.476891    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-3274f-predictor-cf66786f4-9m5t7"]
Jul 08 07:44:32.622115 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:32.621849    2565 scope.go:117] "RemoveContainer" containerID="39b428bda167b85ce8d7c2b03a738b001e4030ca3c5c73a364c2d97a5f0bef56"
Jul 08 07:44:33.036714 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:33.036632    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" path="/var/lib/kubelet/pods/ba528ea2-2bfc-485d-8b88-4370d38b0eed/volumes"
Jul 08 07:44:33.837906 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:33.837707    2565 scope.go:117] "RemoveContainer" containerID="be4ce39d3fdb1babe2d031400bc963de1e4b298b9ce336b808b5069a2a9a2af8"
Jul 08 07:44:33.838194 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:44:33.838082    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be4ce39d3fdb1babe2d031400bc963de1e4b298b9ce336b808b5069a2a9a2af8\": container with ID starting with be4ce39d3fdb1babe2d031400bc963de1e4b298b9ce336b808b5069a2a9a2af8 not found: ID does not exist" containerID="be4ce39d3fdb1babe2d031400bc963de1e4b298b9ce336b808b5069a2a9a2af8"
Jul 08 07:44:33.838194 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:33.838112    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be4ce39d3fdb1babe2d031400bc963de1e4b298b9ce336b808b5069a2a9a2af8"} err="failed to get container status \"be4ce39d3fdb1babe2d031400bc963de1e4b298b9ce336b808b5069a2a9a2af8\": rpc error: code = NotFound desc = could not find container \"be4ce39d3fdb1babe2d031400bc963de1e4b298b9ce336b808b5069a2a9a2af8\": container with ID starting with be4ce39d3fdb1babe2d031400bc963de1e4b298b9ce336b808b5069a2a9a2af8 not found: ID does not exist"
Jul 08 07:44:34.020601 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:44:34.020548    2565 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_kube-rbac-proxy_success-200-isvc-3274f-predictor-cf66786f4-9m5t7_kserve-ci-e2e-test_ba528ea2-2bfc-485d-8b88-4370d38b0eed_0 in pod sandbox 0aa7e1a303fcbfe6b67ca0ee3fd04401d9c1e628bf29f457022f610502068015: identifier is not a container" containerID="39b428bda167b85ce8d7c2b03a738b001e4030ca3c5c73a364c2d97a5f0bef56"
Jul 08 07:44:34.020771 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:44:34.020610    2565 kuberuntime_gc.go:151] "Failed to remove container" err="rpc error: code = Unknown desc = failed to delete container k8s_kube-rbac-proxy_success-200-isvc-3274f-predictor-cf66786f4-9m5t7_kserve-ci-e2e-test_ba528ea2-2bfc-485d-8b88-4370d38b0eed_0 in pod sandbox 0aa7e1a303fcbfe6b67ca0ee3fd04401d9c1e628bf29f457022f610502068015: identifier is not a container" containerID="39b428bda167b85ce8d7c2b03a738b001e4030ca3c5c73a364c2d97a5f0bef56"
Jul 08 07:44:35.468743 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:35.468710    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffwtt/must-gather-vw4t5" event={"ID":"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca","Type":"ContainerStarted","Data":"b58bb79279d691057a21f5573bd025a4dde012fd830c3ef4098f2e4df3bac0cb"}
Jul 08 07:44:35.469157 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:35.468753    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffwtt/must-gather-vw4t5" event={"ID":"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca","Type":"ContainerStarted","Data":"674450a33b8e93a31c8d980a7f8b766be492daaca2fe5a865dec55dabd06525f"}
Jul 08 07:44:35.488657 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:35.488536    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ffwtt/must-gather-vw4t5" podStartSLOduration=1.308916375 podStartE2EDuration="7.488518602s" totalImagesPullingTime="6.179602227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:44:35.486503442 +0000 UTC m=+2946.195786565" watchObservedRunningTime="2026-07-08 07:44:35.488518602 +0000 UTC m=+2946.197801711"
Jul 08 07:44:57.571362 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:57.571326    2565 generic.go:356] "Generic (PLEG): container finished" podID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" containerID="674450a33b8e93a31c8d980a7f8b766be492daaca2fe5a865dec55dabd06525f" exitCode=0
Jul 08 07:44:57.571829 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:57.571398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffwtt/must-gather-vw4t5" event={"ID":"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca","Type":"ContainerDied","Data":"674450a33b8e93a31c8d980a7f8b766be492daaca2fe5a865dec55dabd06525f"}
Jul 08 07:44:57.571829 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:57.571727    2565 scope.go:117] "RemoveContainer" containerID="674450a33b8e93a31c8d980a7f8b766be492daaca2fe5a865dec55dabd06525f"
Jul 08 07:44:57.956243 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:57.956151    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ffwtt_must-gather-vw4t5_11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca/gather/0.log"
Jul 08 07:44:58.545529 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.545480    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:44:58.643097 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.643051    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qznxx/must-gather-fgfkl"]
Jul 08 07:44:58.643455 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.643410    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kube-rbac-proxy"
Jul 08 07:44:58.643455 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.643421    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kube-rbac-proxy"
Jul 08 07:44:58.643455 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.643443    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kserve-container"
Jul 08 07:44:58.643455 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.643449    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kserve-container"
Jul 08 07:44:58.643587 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.643504    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kube-rbac-proxy"
Jul 08 07:44:58.643587 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.643513    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba528ea2-2bfc-485d-8b88-4370d38b0eed" containerName="kserve-container"
Jul 08 07:44:58.645566 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.645552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qznxx/must-gather-fgfkl"
Jul 08 07:44:58.649361 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.649342    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qznxx\"/\"openshift-service-ca.crt\""
Jul 08 07:44:58.649493 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.649345    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qznxx\"/\"default-dockercfg-tdfcs\""
Jul 08 07:44:58.649493 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.649375    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qznxx\"/\"kube-root-ca.crt\""
Jul 08 07:44:58.666457 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.666430    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qznxx/must-gather-fgfkl"]
Jul 08 07:44:58.674272 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.674244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:44:58.772700 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.772665    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:44:58.786945 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.786912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4db8245e-bbbd-4e21-8c68-16cdfaa940b7-must-gather-output\") pod \"must-gather-fgfkl\" (UID: \"4db8245e-bbbd-4e21-8c68-16cdfaa940b7\") " pod="openshift-must-gather-qznxx/must-gather-fgfkl"
Jul 08 07:44:58.787122 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.786957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls9p4\" (UniqueName: \"kubernetes.io/projected/4db8245e-bbbd-4e21-8c68-16cdfaa940b7-kube-api-access-ls9p4\") pod \"must-gather-fgfkl\" (UID: \"4db8245e-bbbd-4e21-8c68-16cdfaa940b7\") " pod="openshift-must-gather-qznxx/must-gather-fgfkl"
Jul 08 07:44:58.888304 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.888268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4db8245e-bbbd-4e21-8c68-16cdfaa940b7-must-gather-output\") pod \"must-gather-fgfkl\" (UID: \"4db8245e-bbbd-4e21-8c68-16cdfaa940b7\") " pod="openshift-must-gather-qznxx/must-gather-fgfkl"
Jul 08 07:44:58.888452 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.888310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls9p4\" (UniqueName: \"kubernetes.io/projected/4db8245e-bbbd-4e21-8c68-16cdfaa940b7-kube-api-access-ls9p4\") pod \"must-gather-fgfkl\" (UID: \"4db8245e-bbbd-4e21-8c68-16cdfaa940b7\") " pod="openshift-must-gather-qznxx/must-gather-fgfkl"
Jul 08 07:44:58.888642 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.888621    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4db8245e-bbbd-4e21-8c68-16cdfaa940b7-must-gather-output\") pod \"must-gather-fgfkl\" (UID: \"4db8245e-bbbd-4e21-8c68-16cdfaa940b7\") " pod="openshift-must-gather-qznxx/must-gather-fgfkl"
Jul 08 07:44:58.900725 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.900692    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls9p4\" (UniqueName: \"kubernetes.io/projected/4db8245e-bbbd-4e21-8c68-16cdfaa940b7-kube-api-access-ls9p4\") pod \"must-gather-fgfkl\" (UID: \"4db8245e-bbbd-4e21-8c68-16cdfaa940b7\") " pod="openshift-must-gather-qznxx/must-gather-fgfkl"
Jul 08 07:44:58.955431 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:58.955398    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qznxx/must-gather-fgfkl"
Jul 08 07:44:59.086889 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:59.086860    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qznxx/must-gather-fgfkl"]
Jul 08 07:44:59.087567 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:44:59.087535    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4db8245e_bbbd_4e21_8c68_16cdfaa940b7.slice/crio-e18d9f6dfca81c973f877f6eda037c2562002955fcefebfadf7f5e3f0a8329b1 WatchSource:0}: Error finding container e18d9f6dfca81c973f877f6eda037c2562002955fcefebfadf7f5e3f0a8329b1: Status 404 returned error can't find the container with id e18d9f6dfca81c973f877f6eda037c2562002955fcefebfadf7f5e3f0a8329b1
Jul 08 07:44:59.580979 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:44:59.580944    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qznxx/must-gather-fgfkl" event={"ID":"4db8245e-bbbd-4e21-8c68-16cdfaa940b7","Type":"ContainerStarted","Data":"e18d9f6dfca81c973f877f6eda037c2562002955fcefebfadf7f5e3f0a8329b1"}
Jul 08 07:45:00.587281 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:00.587238    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qznxx/must-gather-fgfkl" event={"ID":"4db8245e-bbbd-4e21-8c68-16cdfaa940b7","Type":"ContainerStarted","Data":"22d34a6e5b2bb5b8f257236a24c07d29c4a0cc19861ebde9266bb7ea30cf76a3"}
Jul 08 07:45:00.587281 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:00.587283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qznxx/must-gather-fgfkl" event={"ID":"4db8245e-bbbd-4e21-8c68-16cdfaa940b7","Type":"ContainerStarted","Data":"3ede971d85243a40d450105df1b5efae0b644b4b2e7a6ba0b970246a7f338c5d"}
Jul 08 07:45:00.607251 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:00.607190    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qznxx/must-gather-fgfkl" podStartSLOduration=1.6035774919999999 podStartE2EDuration="2.607170908s" totalImagesPullingTime="1.003593416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 07:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:45:00.606592296 +0000 UTC m=+2971.315875418" watchObservedRunningTime="2026-07-08 07:45:00.607170908 +0000 UTC m=+2971.316454020"
Jul 08 07:45:01.602795 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:01.602770    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4lm92_18f91b3f-47a9-4eb6-8547-eee59181ac7d/global-pull-secret-syncer/0.log"
Jul 08 07:45:01.786835 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:01.786793    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log"
Jul 08 07:45:01.889128 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:01.889037    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-191.ec2.internal_b42444b7e0c741e5903c2be5ebcd8af2/haproxy/0.log"
Jul 08 07:45:03.468964 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:03.468923    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-ffwtt/must-gather-vw4t5"]
Jul 08 07:45:03.469517 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:03.469484    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-ffwtt/must-gather-vw4t5" podUID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" containerName="copy" containerID="cri-o://b58bb79279d691057a21f5573bd025a4dde012fd830c3ef4098f2e4df3bac0cb" gracePeriod=2
Jul 08 07:45:03.472358 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:45:03.472320    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-vw4t5\" is forbidden: User \"system:node:ip-10-0-132-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ffwtt\": no relationship found between node 'ip-10-0-132-191.ec2.internal' and this object" podUID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:45:03.473524 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:03.473501    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-ffwtt/must-gather-vw4t5"]
Jul 08 07:45:03.617409 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:03.617376    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ffwtt_must-gather-vw4t5_11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca/copy/0.log"
Jul 08 07:45:03.618034 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:03.618007    2565 generic.go:356] "Generic (PLEG): container finished" podID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" containerID="b58bb79279d691057a21f5573bd025a4dde012fd830c3ef4098f2e4df3bac0cb" exitCode=143
Jul 08 07:45:03.872338 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:03.872304    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ffwtt_must-gather-vw4t5_11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca/copy/0.log"
Jul 08 07:45:03.875630 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:03.875366    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:45:03.878420 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:45:03.878371    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-vw4t5\" is forbidden: User \"system:node:ip-10-0-132-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ffwtt\": no relationship found between node 'ip-10-0-132-191.ec2.internal' and this object" podUID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:45:04.048952 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:04.046805    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkltd\" (UniqueName: \"kubernetes.io/projected/11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca-kube-api-access-vkltd\") pod \"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca\" (UID: \"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca\") "
Jul 08 07:45:04.048952 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:04.046858    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca-must-gather-output\") pod \"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca\" (UID: \"11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca\") "
Jul 08 07:45:04.048952 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:04.048607    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" (UID: "11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 07:45:04.051326 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:04.051289    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca-kube-api-access-vkltd" (OuterVolumeSpecName: "kube-api-access-vkltd") pod "11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" (UID: "11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca"). InnerVolumeSpecName "kube-api-access-vkltd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 07:45:04.148639 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:04.148602    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkltd\" (UniqueName: \"kubernetes.io/projected/11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca-kube-api-access-vkltd\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:45:04.149601 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:04.149580    2565 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca-must-gather-output\") on node \"ip-10-0-132-191.ec2.internal\" DevicePath \"\""
Jul 08 07:45:04.522942 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:04.522888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:45:04.626947 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:04.626854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:45:04.628304 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:04.628236    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ffwtt_must-gather-vw4t5_11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca/copy/0.log"
Jul 08 07:45:04.629043 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:04.628847    2565 scope.go:117] "RemoveContainer" containerID="b58bb79279d691057a21f5573bd025a4dde012fd830c3ef4098f2e4df3bac0cb"
Jul 08 07:45:04.629043 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:04.629011    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:45:04.637421 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:45:04.637375    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-vw4t5\" is forbidden: User \"system:node:ip-10-0-132-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ffwtt\": no relationship found between node 'ip-10-0-132-191.ec2.internal' and this object" podUID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:45:04.650323 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:04.650126    2565 scope.go:117] "RemoveContainer" containerID="674450a33b8e93a31c8d980a7f8b766be492daaca2fe5a865dec55dabd06525f"
Jul 08 07:45:04.656676 ip-10-0-132-191 kubenswrapper[2565]: E0708 07:45:04.656018    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-vw4t5\" is forbidden: User \"system:node:ip-10-0-132-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ffwtt\": no relationship found between node 'ip-10-0-132-191.ec2.internal' and this object" podUID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" pod="openshift-must-gather-ffwtt/must-gather-vw4t5"
Jul 08 07:45:05.039272 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:05.039233    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" path="/var/lib/kubelet/pods/11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca/volumes"
Jul 08 07:45:06.303471 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:06.303431    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff8ce01-a189-4e4a-a756-19aedf9fd9b4/alertmanager/0.log"
Jul 08 07:45:06.363351 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:06.363250    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff8ce01-a189-4e4a-a756-19aedf9fd9b4/config-reloader/0.log"
Jul 08 07:45:06.431148 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:06.431109    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff8ce01-a189-4e4a-a756-19aedf9fd9b4/kube-rbac-proxy-web/0.log"
Jul 08 07:45:06.480934 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:06.480903    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff8ce01-a189-4e4a-a756-19aedf9fd9b4/kube-rbac-proxy/0.log"
Jul 08 07:45:06.524303 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:06.524265    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff8ce01-a189-4e4a-a756-19aedf9fd9b4/kube-rbac-proxy-metric/0.log"
Jul 08 07:45:06.584865 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:06.584830    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff8ce01-a189-4e4a-a756-19aedf9fd9b4/prom-label-proxy/0.log"
Jul 08 07:45:06.626062 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:06.625980    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ff8ce01-a189-4e4a-a756-19aedf9fd9b4/init-config-reloader/0.log"
Jul 08 07:45:06.710573 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:06.710540    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-vn8kr_02441622-cef7-4d4f-a1e9-34722c1fcb9d/kube-state-metrics/0.log"
Jul 08 07:45:06.741553 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:06.741493    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-vn8kr_02441622-cef7-4d4f-a1e9-34722c1fcb9d/kube-rbac-proxy-main/0.log"
Jul 08 07:45:06.781319 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:06.781280    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-vn8kr_02441622-cef7-4d4f-a1e9-34722c1fcb9d/kube-rbac-proxy-self/0.log"
Jul 08 07:45:06.830013 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:06.829983    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b9f9469c9-xr26j_13cfcbf1-1633-41ad-970f-31c820ee84aa/metrics-server/0.log"
Jul 08 07:45:06.866060 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:06.866030    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-brk6c_94e0ff2d-3bce-48dc-b4d5-f6911542095a/monitoring-plugin/0.log"
Jul 08 07:45:07.013633 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.013556    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b26vb_03126ac0-9fe8-4afd-915f-57462251f622/node-exporter/0.log"
Jul 08 07:45:07.052047 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.052003    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b26vb_03126ac0-9fe8-4afd-915f-57462251f622/kube-rbac-proxy/0.log"
Jul 08 07:45:07.091015 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.090984    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b26vb_03126ac0-9fe8-4afd-915f-57462251f622/init-textfile/0.log"
Jul 08 07:45:07.298557 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.298524    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2z42s_793cdc89-a453-40b2-ba73-05cc8e89e339/kube-rbac-proxy-main/0.log"
Jul 08 07:45:07.348167 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.348140    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2z42s_793cdc89-a453-40b2-ba73-05cc8e89e339/kube-rbac-proxy-self/0.log"
Jul 08 07:45:07.419241 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.419210    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2z42s_793cdc89-a453-40b2-ba73-05cc8e89e339/openshift-state-metrics/0.log"
Jul 08 07:45:07.481693 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.481664    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26267953-0733-4376-8df5-7c83e5c4124c/prometheus/0.log"
Jul 08 07:45:07.511236 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.511202    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26267953-0733-4376-8df5-7c83e5c4124c/config-reloader/0.log"
Jul 08 07:45:07.546256 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.546179    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26267953-0733-4376-8df5-7c83e5c4124c/thanos-sidecar/0.log"
Jul 08 07:45:07.578150 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.578124    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26267953-0733-4376-8df5-7c83e5c4124c/kube-rbac-proxy-web/0.log"
Jul 08 07:45:07.615838 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.615806    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26267953-0733-4376-8df5-7c83e5c4124c/kube-rbac-proxy/0.log"
Jul 08 07:45:07.649776 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.649744    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26267953-0733-4376-8df5-7c83e5c4124c/kube-rbac-proxy-thanos/0.log"
Jul 08 07:45:07.681220 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.681191    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26267953-0733-4376-8df5-7c83e5c4124c/init-config-reloader/0.log"
Jul 08 07:45:07.714127 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.714059    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-q7kb6_0194b28c-33ad-4efd-811d-4b7510dced70/prometheus-operator/0.log"
Jul 08 07:45:07.742109 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.742065    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-q7kb6_0194b28c-33ad-4efd-811d-4b7510dced70/kube-rbac-proxy/0.log"
Jul 08 07:45:07.775204 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.775170    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-r8mrr_6fce89ee-7b54-4733-81dd-bef30d934a37/prometheus-operator-admission-webhook/0.log"
Jul 08 07:45:07.827649 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.827615    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f66dd8499-hnsdx_3b48c776-63ac-40e0-a1ef-d308a78e2d6f/telemeter-client/0.log"
Jul 08 07:45:07.892150 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.892067    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f66dd8499-hnsdx_3b48c776-63ac-40e0-a1ef-d308a78e2d6f/reload/0.log"
Jul 08 07:45:07.946818 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:07.946784    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f66dd8499-hnsdx_3b48c776-63ac-40e0-a1ef-d308a78e2d6f/kube-rbac-proxy/0.log"
Jul 08 07:45:08.005793 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:08.005749    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c598fb456-gf2gp_20c1a4c0-ded2-47ab-bb43-64e4a145de60/thanos-query/0.log"
Jul 08 07:45:08.041717 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:08.041688    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c598fb456-gf2gp_20c1a4c0-ded2-47ab-bb43-64e4a145de60/kube-rbac-proxy-web/0.log"
Jul 08 07:45:08.079757 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:08.079662    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c598fb456-gf2gp_20c1a4c0-ded2-47ab-bb43-64e4a145de60/kube-rbac-proxy/0.log"
Jul 08 07:45:08.124512 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:08.124484    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c598fb456-gf2gp_20c1a4c0-ded2-47ab-bb43-64e4a145de60/prom-label-proxy/0.log"
Jul 08 07:45:08.164869 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:08.164839    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c598fb456-gf2gp_20c1a4c0-ded2-47ab-bb43-64e4a145de60/kube-rbac-proxy-rules/0.log"
Jul 08 07:45:08.204289 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:08.204262    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c598fb456-gf2gp_20c1a4c0-ded2-47ab-bb43-64e4a145de60/kube-rbac-proxy-metrics/0.log"
Jul 08 07:45:09.839863 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:09.839828    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"]
Jul 08 07:45:09.840416 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:09.840399    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" containerName="copy"
Jul 08 07:45:09.840472 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:09.840421    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" containerName="copy"
Jul 08 07:45:09.840472 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:09.840444    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" containerName="gather"
Jul 08 07:45:09.840472 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:09.840453    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" containerName="gather"
Jul 08 07:45:09.840577 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:09.840540    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" containerName="gather"
Jul 08 07:45:09.840577 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:09.840560    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b5a91c-5e61-4b80-b6f0-1e6cd748c8ca" containerName="copy"
Jul 08 07:45:09.844045 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:09.844016    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:09.860199 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:09.860170    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"]
Jul 08 07:45:10.011612 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.011571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65qwk\" (UniqueName: \"kubernetes.io/projected/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-kube-api-access-65qwk\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.012849 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.012817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-sys\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.013001 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.012965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-podres\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.013106 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.013004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-lib-modules\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.013106 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.013040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-proc\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.113868 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.113782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-sys\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.114020 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.113875    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-sys\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.114020 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.113925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-podres\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.114020 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.113972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-lib-modules\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.114020 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.113999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-proc\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.114232 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.114052    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-podres\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.114232 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.114088    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-proc\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.114232 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.114116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65qwk\" (UniqueName: \"kubernetes.io/projected/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-kube-api-access-65qwk\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.114232 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.114148    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-lib-modules\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.125650 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.125626    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65qwk\" (UniqueName: \"kubernetes.io/projected/8d8b9d50-ab04-4ec2-ada7-e5302e4cc540-kube-api-access-65qwk\") pod \"perf-node-gather-daemonset-fvvnz\" (UID: \"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540\") " pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.158303 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.158263    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.324960 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.324923    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"]
Jul 08 07:45:10.328639 ip-10-0-132-191 kubenswrapper[2565]: W0708 07:45:10.328587    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8d8b9d50_ab04_4ec2_ada7_e5302e4cc540.slice/crio-731e009da56b83eeeb9e5e86c5bcf9248ba9d9b48b503e51c378f6166d83d00a WatchSource:0}: Error finding container 731e009da56b83eeeb9e5e86c5bcf9248ba9d9b48b503e51c378f6166d83d00a: Status 404 returned error can't find the container with id 731e009da56b83eeeb9e5e86c5bcf9248ba9d9b48b503e51c378f6166d83d00a
Jul 08 07:45:10.492461 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.492417    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-999cb578c-s8hj5_2ebc168f-874c-4688-b340-cbabe18957e1/console/0.log"
Jul 08 07:45:10.571335 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.571302    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-w4qwb_dc36ed28-4405-449c-ae85-008a63a8e555/download-server/0.log"
Jul 08 07:45:10.680669 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.680565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz" event={"ID":"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540","Type":"ContainerStarted","Data":"7f2aebae00fb00f15be6029c9c54053a26d1033739ef74d4e5743fa3192e4ace"}
Jul 08 07:45:10.680669 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.680636    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:10.680669 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.680662    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz" event={"ID":"8d8b9d50-ab04-4ec2-ada7-e5302e4cc540","Type":"ContainerStarted","Data":"731e009da56b83eeeb9e5e86c5bcf9248ba9d9b48b503e51c378f6166d83d00a"}
Jul 08 07:45:10.709312 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:10.709260    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz" podStartSLOduration=1.709242788 podStartE2EDuration="1.709242788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 07:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 07:45:10.707461851 +0000 UTC m=+2981.416744964" watchObservedRunningTime="2026-07-08 07:45:10.709242788 +0000 UTC m=+2981.418525898"
Jul 08 07:45:12.226192 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:12.226164    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wjfnw_71454413-37b6-4895-84b9-5a18e0f7c3d0/dns/0.log"
Jul 08 07:45:12.252215 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:12.252192    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wjfnw_71454413-37b6-4895-84b9-5a18e0f7c3d0/kube-rbac-proxy/0.log"
Jul 08 07:45:12.332315 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:12.332283    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xxrtv_b930586c-e3b5-49ed-831a-3bb0ceb55958/dns-node-resolver/0.log"
Jul 08 07:45:12.850782 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:12.850757    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bwjx_2d97c0f1-d007-4f7b-a19e-3dcce094357a/node-ca/0.log"
Jul 08 07:45:14.308438 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:14.308413    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f54v6_37032234-820e-4ce1-a817-1a89dad327ad/serve-healthcheck-canary/0.log"
Jul 08 07:45:14.905183 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:14.905154    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6rfd8_9426f377-c768-4f39-8c36-c83512910a83/kube-rbac-proxy/0.log"
Jul 08 07:45:14.938259 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:14.938230    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6rfd8_9426f377-c768-4f39-8c36-c83512910a83/exporter/0.log"
Jul 08 07:45:14.978296 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:14.978271    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6rfd8_9426f377-c768-4f39-8c36-c83512910a83/extractor/0.log"
Jul 08 07:45:16.695626 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:16.695599    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qznxx/perf-node-gather-daemonset-fvvnz"
Jul 08 07:45:17.990763 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:17.990716    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-6qfnf_0a1c2b92-1fc7-4f90-b197-b5a357f392fc/manager/0.log"
Jul 08 07:45:18.034285 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:18.034250    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-w2rlr_22a143a3-c94f-4e09-b86b-205e97289e5b/s3-init/0.log"
Jul 08 07:45:18.063750 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:18.063719    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-w2rlr_22a143a3-c94f-4e09-b86b-205e97289e5b/download-hf-model/0.log"
Jul 08 07:45:20.254582 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:20.254532    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-82kbn_edea2342-84be-47c9-ba0e-a1cc69e50a54/konnectivity-agent/0.log" limit=1024
Jul 08 07:45:24.485546 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:24.485475    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-njffd_18c4910d-2dc7-4b52-a0c5-1b3b52c976c9/kube-multus-additional-cni-plugins/0.log"
Jul 08 07:45:24.509188 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:24.509162    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-njffd_18c4910d-2dc7-4b52-a0c5-1b3b52c976c9/egress-router-binary-copy/0.log"
Jul 08 07:45:24.533129 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:24.533097    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-njffd_18c4910d-2dc7-4b52-a0c5-1b3b52c976c9/cni-plugins/0.log"
Jul 08 07:45:24.559464 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:24.559437    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-njffd_18c4910d-2dc7-4b52-a0c5-1b3b52c976c9/bond-cni-plugin/0.log"
Jul 08 07:45:24.588007 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:24.587974    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-njffd_18c4910d-2dc7-4b52-a0c5-1b3b52c976c9/routeoverride-cni/0.log"
Jul 08 07:45:24.615229 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:24.615203    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-njffd_18c4910d-2dc7-4b52-a0c5-1b3b52c976c9/whereabouts-cni-bincopy/0.log"
Jul 08 07:45:24.644303 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:24.644267    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-njffd_18c4910d-2dc7-4b52-a0c5-1b3b52c976c9/whereabouts-cni/0.log"
Jul 08 07:45:24.743805 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:24.743734    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zzg72_4c325dbc-01f4-408b-b00f-ffe0e053aeed/kube-multus/0.log"
Jul 08 07:45:24.917343 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:24.917307    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tjrq6_472c4a73-2d24-400f-ae39-45695d6af154/network-metrics-daemon/0.log"
Jul 08 07:45:24.956583 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:24.956548    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tjrq6_472c4a73-2d24-400f-ae39-45695d6af154/kube-rbac-proxy/0.log"
Jul 08 07:45:26.063802 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:26.063777    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-controller/0.log"
Jul 08 07:45:26.085484 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:26.085448    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/1.log"
Jul 08 07:45:26.085669 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:26.085464    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovn-acl-logging/0.log"
Jul 08 07:45:26.106945 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:26.106914    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/kube-rbac-proxy-node/0.log"
Jul 08 07:45:26.130793 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:26.130772    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/kube-rbac-proxy-ovn-metrics/0.log"
Jul 08 07:45:26.155892 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:26.155864    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/northd/0.log"
Jul 08 07:45:26.180518 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:26.180492    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/nbdb/0.log"
Jul 08 07:45:26.205349 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:26.205318    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/sbdb/0.log"
Jul 08 07:45:26.251491 ip-10-0-132-191 kubenswrapper[2565]: I0708 07:45:26.251462    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tst7z_0f740e8d-ee64-4940-9d2b-c9d13d687f07/ovnkube-controller/0.log"